[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:15.801113 20705 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.56.126:39371
I20260709 12:08:15.802762 20705 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:15.803857 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:15.821025 20714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.821043 20712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.821101 20711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:15.822759 20705 server_base.cc:1061] running on GCE node
I20260709 12:08:17.025741 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.026008 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.026278 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598897026244 us; error 0 us; skew 500 ppm
I20260709 12:08:17.027215 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.034006 20705 webserver.cc:533] Webserver started at http://127.20.56.126:45323/ using document root <none> and password file <none>
I20260709 12:08:17.034984 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.035256 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.035739 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.041878 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/master-0-root/instance:
uuid: "a2c0633482e64673b3e3aaf74c6aff36"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-2dwh"
I20260709 12:08:17.050052 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:08:17.055760 20720 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.057087 20705 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:08:17.057497 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/master-0-root
uuid: "a2c0633482e64673b3e3aaf74c6aff36"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-2dwh"
I20260709 12:08:17.057897 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.119602 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.121201 20705 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:17.121670 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.199491 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.126:39371
I20260709 12:08:17.199566 20771 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.126:39371 every 8 connection(s)
I20260709 12:08:17.207952 20772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.230487 20772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36: Bootstrap starting.
I20260709 12:08:17.236547 20772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.238544 20772 log.cc:826] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:17.243424 20772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36: No bootstrap required, opened a new log
I20260709 12:08:17.264307 20772 raft_consensus.cc:359] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c0633482e64673b3e3aaf74c6aff36" member_type: VOTER }
I20260709 12:08:17.264873 20772 raft_consensus.cc:385] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.265204 20772 raft_consensus.cc:740] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c0633482e64673b3e3aaf74c6aff36, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.266151 20772 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c0633482e64673b3e3aaf74c6aff36" member_type: VOTER }
I20260709 12:08:17.266677 20772 raft_consensus.cc:399] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:17.266989 20772 raft_consensus.cc:493] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:17.267329 20772 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.271566 20772 raft_consensus.cc:515] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c0633482e64673b3e3aaf74c6aff36" member_type: VOTER }
I20260709 12:08:17.272395 20772 leader_election.cc:304] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2c0633482e64673b3e3aaf74c6aff36; no voters: 
I20260709 12:08:17.274159 20772 leader_election.cc:290] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:17.274549 20775 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.277189 20775 raft_consensus.cc:697] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 1 LEADER]: Becoming Leader. State: Replica: a2c0633482e64673b3e3aaf74c6aff36, State: Running, Role: LEADER
I20260709 12:08:17.278179 20775 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c0633482e64673b3e3aaf74c6aff36" member_type: VOTER }
I20260709 12:08:17.279345 20772 sys_catalog.cc:565] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:17.289529 20777 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2c0633482e64673b3e3aaf74c6aff36. Latest consensus state: current_term: 1 leader_uuid: "a2c0633482e64673b3e3aaf74c6aff36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c0633482e64673b3e3aaf74c6aff36" member_type: VOTER } }
I20260709 12:08:17.290294 20777 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:17.289479 20776 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2c0633482e64673b3e3aaf74c6aff36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2c0633482e64673b3e3aaf74c6aff36" member_type: VOTER } }
I20260709 12:08:17.291723 20776 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:17.295692 20784 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:17.308903 20784 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:17.311165 20705 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:17.325814 20784 catalog_manager.cc:1383] Generated new cluster ID: 17b956bc34534588a0f708b01345d1fb
I20260709 12:08:17.326146 20784 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:17.349385 20784 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:17.351061 20784 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:17.367065 20784 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36: Generated new TSK 0
I20260709 12:08:17.368132 20784 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:17.378741 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.388751 20794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.390821 20795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.398864 20705 server_base.cc:1061] running on GCE node
W20260709 12:08:17.398705 20797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.399884 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.400084 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.400315 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598897400295 us; error 0 us; skew 500 ppm
I20260709 12:08:17.400928 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.405017 20705 webserver.cc:533] Webserver started at http://127.20.56.65:35197/ using document root <none> and password file <none>
I20260709 12:08:17.405568 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.405786 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.406101 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.407311 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-0-root/instance:
uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-2dwh"
I20260709 12:08:17.413317 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:08:17.418078 20802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.419037 20705 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:08:17.419415 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-2dwh"
I20260709 12:08:17.419826 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.451119 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.452965 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.455832 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.461386 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.461723 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.462034 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.462252 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.555702 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:41801
I20260709 12:08:17.555757 20864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:41801 every 8 connection(s)
I20260709 12:08:17.563771 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.574929 20869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.579250 20870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.582381 20872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.584149 20705 server_base.cc:1061] running on GCE node
I20260709 12:08:17.585215 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.585546 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.585829 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598897585807 us; error 0 us; skew 500 ppm
I20260709 12:08:17.586676 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.592758 20705 webserver.cc:533] Webserver started at http://127.20.56.66:38917/ using document root <none> and password file <none>
I20260709 12:08:17.593325 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.593565 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.594700 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.595167 20865 heartbeater.cc:344] Connected to a master server at 127.20.56.126:39371
I20260709 12:08:17.595657 20865 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.596280 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-1-root/instance:
uuid: "69c4bd8c5bdf413891671e66a98cf43e"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-2dwh"
I20260709 12:08:17.596772 20865 heartbeater.cc:507] Master 127.20.56.126:39371 requested a full tablet report, sending...
I20260709 12:08:17.599745 20737 ts_manager.cc:194] Registered new tserver with Master: bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801)
I20260709 12:08:17.602648 20737 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59500
I20260709 12:08:17.603477 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:08:17.608469 20877 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.609337 20705 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 12:08:17.609661 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-1-root
uuid: "69c4bd8c5bdf413891671e66a98cf43e"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-2dwh"
I20260709 12:08:17.610016 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.631824 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.633157 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.635860 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.639446 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.639653 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.639961 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.640100 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.746939 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.66:35397
I20260709 12:08:17.747049 20939 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.66:35397 every 8 connection(s)
I20260709 12:08:17.754001 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.762243 20943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.770612 20940 heartbeater.cc:344] Connected to a master server at 127.20.56.126:39371
I20260709 12:08:17.771217 20940 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.772403 20940 heartbeater.cc:507] Master 127.20.56.126:39371 requested a full tablet report, sending...
W20260709 12:08:17.774245 20946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.774721 20944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.775300 20705 server_base.cc:1061] running on GCE node
I20260709 12:08:17.775362 20737 ts_manager.cc:194] Registered new tserver with Master: 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:17.776387 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.776638 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.776824 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598897776805 us; error 0 us; skew 500 ppm
I20260709 12:08:17.777223 20737 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59510
I20260709 12:08:17.777566 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.781837 20705 webserver.cc:533] Webserver started at http://127.20.56.67:33935/ using document root <none> and password file <none>
I20260709 12:08:17.782361 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.782646 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.782927 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.784081 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-2-root/instance:
uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-2dwh"
I20260709 12:08:17.789048 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:17.792593 20951 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.793426 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:17.793722 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-2-root
uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-2dwh"
I20260709 12:08:17.794046 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895630772-20705-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.829308 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.830612 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.832136 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.835089 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.835274 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.835561 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.835719 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.932163 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.67:34603
I20260709 12:08:17.932379 21013 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.67:34603 every 8 connection(s)
I20260709 12:08:17.957517 21014 heartbeater.cc:344] Connected to a master server at 127.20.56.126:39371
I20260709 12:08:17.957877 21014 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.958734 21014 heartbeater.cc:507] Master 127.20.56.126:39371 requested a full tablet report, sending...
I20260709 12:08:17.960706 20737 ts_manager.cc:194] Registered new tserver with Master: 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:17.961122 20705 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018006106s
I20260709 12:08:17.962489 20737 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59524
I20260709 12:08:18.020278 20737 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59540:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:18.024171 20737 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:18.161670 20905 tablet_service.cc:1511] Processing CreateTablet for tablet cd6f53d4df2849869f08f47aa411f524 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.163560 20905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6f53d4df2849869f08f47aa411f524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.171808 20979 tablet_service.cc:1511] Processing CreateTablet for tablet cd6f53d4df2849869f08f47aa411f524 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.172093 20978 tablet_service.cc:1511] Processing CreateTablet for tablet 1761087e244c40d1ac6515f932c6b00a (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.175024 20977 tablet_service.cc:1511] Processing CreateTablet for tablet 923e9519c19c4c3593313ac77e4f0dcb (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.175464 20975 tablet_service.cc:1511] Processing CreateTablet for tablet 6811d3031856495a846d6e7979982300 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.174961 20976 tablet_service.cc:1511] Processing CreateTablet for tablet 7210c3eb44834760bb54a02233edb824 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.176664 20973 tablet_service.cc:1511] Processing CreateTablet for tablet c8f37d1b65014770a63986cd7c69bfc7 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.178110 20974 tablet_service.cc:1511] Processing CreateTablet for tablet c8d19d83df2e46b082b530e3acb74934 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.180824 20972 tablet_service.cc:1511] Processing CreateTablet for tablet e59493c182d040f889e1d81984651521 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.183525 20971 tablet_service.cc:1511] Processing CreateTablet for tablet 41ae02245cd841efb3d5878269487438 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.173399 20979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6f53d4df2849869f08f47aa411f524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.185546 20972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59493c182d040f889e1d81984651521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.187821 20974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d19d83df2e46b082b530e3acb74934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.190081 20904 tablet_service.cc:1511] Processing CreateTablet for tablet 1761087e244c40d1ac6515f932c6b00a (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.190747 20973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f37d1b65014770a63986cd7c69bfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.191672 20904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1761087e244c40d1ac6515f932c6b00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.192282 20977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923e9519c19c4c3593313ac77e4f0dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.193720 20976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7210c3eb44834760bb54a02233edb824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.195031 20978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1761087e244c40d1ac6515f932c6b00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.196604 20975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6811d3031856495a846d6e7979982300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.197665 20971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ae02245cd841efb3d5878269487438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.202127 20903 tablet_service.cc:1511] Processing CreateTablet for tablet 923e9519c19c4c3593313ac77e4f0dcb (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.208482 20901 tablet_service.cc:1511] Processing CreateTablet for tablet 6811d3031856495a846d6e7979982300 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.214653 20902 tablet_service.cc:1511] Processing CreateTablet for tablet 7210c3eb44834760bb54a02233edb824 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.221513 20903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923e9519c19c4c3593313ac77e4f0dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.222250 20899 tablet_service.cc:1511] Processing CreateTablet for tablet c8f37d1b65014770a63986cd7c69bfc7 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.223400 20830 tablet_service.cc:1511] Processing CreateTablet for tablet cd6f53d4df2849869f08f47aa411f524 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.230798 20829 tablet_service.cc:1511] Processing CreateTablet for tablet 1761087e244c40d1ac6515f932c6b00a (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.238075 20898 tablet_service.cc:1511] Processing CreateTablet for tablet e59493c182d040f889e1d81984651521 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.236618 20902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7210c3eb44834760bb54a02233edb824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.242875 20897 tablet_service.cc:1511] Processing CreateTablet for tablet 41ae02245cd841efb3d5878269487438 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.239908 20826 tablet_service.cc:1511] Processing CreateTablet for tablet 6811d3031856495a846d6e7979982300 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.248358 20830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6f53d4df2849869f08f47aa411f524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.249519 20898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59493c182d040f889e1d81984651521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.252990 20828 tablet_service.cc:1511] Processing CreateTablet for tablet 923e9519c19c4c3593313ac77e4f0dcb (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.239168 20900 tablet_service.cc:1511] Processing CreateTablet for tablet c8d19d83df2e46b082b530e3acb74934 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.249298 20827 tablet_service.cc:1511] Processing CreateTablet for tablet 7210c3eb44834760bb54a02233edb824 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.267719 20823 tablet_service.cc:1511] Processing CreateTablet for tablet e59493c182d040f889e1d81984651521 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.260650 20825 tablet_service.cc:1511] Processing CreateTablet for tablet c8d19d83df2e46b082b530e3acb74934 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.279346 20829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1761087e244c40d1ac6515f932c6b00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.277351 20824 tablet_service.cc:1511] Processing CreateTablet for tablet c8f37d1b65014770a63986cd7c69bfc7 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.283356 20826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6811d3031856495a846d6e7979982300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.281840 20901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6811d3031856495a846d6e7979982300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.282074 20822 tablet_service.cc:1511] Processing CreateTablet for tablet 41ae02245cd841efb3d5878269487438 (DEFAULT_TABLE table=test-workload [id=1e583ea2584d412ca4d79b0b00948e02]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.287159 20828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923e9519c19c4c3593313ac77e4f0dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.291074 20825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d19d83df2e46b082b530e3acb74934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.293313 20823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59493c182d040f889e1d81984651521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.299022 20824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f37d1b65014770a63986cd7c69bfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.302083 20897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ae02245cd841efb3d5878269487438. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:08:18.304495 20785 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.309867 20827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7210c3eb44834760bb54a02233edb824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.311879 20822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ae02245cd841efb3d5878269487438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.311380 20900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d19d83df2e46b082b530e3acb74934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.322708 20899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f37d1b65014770a63986cd7c69bfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.379714 21032 tablet_bootstrap.cc:492] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e: Bootstrap starting.
I20260709 12:08:18.454463 21033 tablet_bootstrap.cc:492] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6: Bootstrap starting.
I20260709 12:08:18.493535 21032 tablet_bootstrap.cc:654] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.497833 21033 tablet_bootstrap.cc:654] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.520841 21034 tablet_bootstrap.cc:492] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1: Bootstrap starting.
I20260709 12:08:18.527961 21032 tablet_bootstrap.cc:492] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e: No bootstrap required, opened a new log
I20260709 12:08:18.528479 21032 ts_tablet_manager.cc:1403] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.005s
I20260709 12:08:18.534713 21033 tablet_bootstrap.cc:492] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6: No bootstrap required, opened a new log
I20260709 12:08:18.535017 21034 tablet_bootstrap.cc:654] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.535193 21033 ts_tablet_manager.cc:1403] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.009s
I20260709 12:08:18.536803 21032 raft_consensus.cc:359] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:18.537665 21032 raft_consensus.cc:385] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.538038 21032 raft_consensus.cc:740] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.538329 21033 raft_consensus.cc:359] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.539232 21033 raft_consensus.cc:385] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.539602 21033 raft_consensus.cc:740] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.539275 21032 consensus_queue.cc:260] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:18.540822 21033 consensus_queue.cc:260] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.546728 20940 heartbeater.cc:499] Master 127.20.56.126:39371 was elected leader, sending a full tablet report...
I20260709 12:08:18.547840 21032 ts_tablet_manager.cc:1434] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 12:08:18.548833 21032 tablet_bootstrap.cc:492] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e: Bootstrap starting.
I20260709 12:08:18.555640 21032 tablet_bootstrap.cc:654] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.559791 21014 heartbeater.cc:499] Master 127.20.56.126:39371 was elected leader, sending a full tablet report...
I20260709 12:08:18.560341 21033 ts_tablet_manager.cc:1434] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.011s
I20260709 12:08:18.561308 21033 tablet_bootstrap.cc:492] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6: Bootstrap starting.
I20260709 12:08:18.567955 21033 tablet_bootstrap.cc:654] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.569080 21034 tablet_bootstrap.cc:492] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1: No bootstrap required, opened a new log
I20260709 12:08:18.569685 21034 ts_tablet_manager.cc:1403] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.009s
I20260709 12:08:18.570657 21038 raft_consensus.cc:493] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.571209 21038 raft_consensus.cc:515] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:18.572914 21034 raft_consensus.cc:359] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.573637 21034 raft_consensus.cc:385] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.574647 21038 leader_election.cc:290] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603), bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801)
I20260709 12:08:18.581434 21032 tablet_bootstrap.cc:492] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e: No bootstrap required, opened a new log
I20260709 12:08:18.582067 21032 ts_tablet_manager.cc:1403] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.010s
I20260709 12:08:18.585651 21032 raft_consensus.cc:359] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.586620 21032 raft_consensus.cc:385] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.587071 21032 raft_consensus.cc:740] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.587924 21032 consensus_queue.cc:260] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.590567 21032 ts_tablet_manager.cc:1434] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:08:18.591643 21032 tablet_bootstrap.cc:492] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e: Bootstrap starting.
I20260709 12:08:18.598694 21032 tablet_bootstrap.cc:654] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.573947 21034 raft_consensus.cc:740] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.602108 21034 consensus_queue.cc:260] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.606043 20865 heartbeater.cc:499] Master 127.20.56.126:39371 was elected leader, sending a full tablet report...
I20260709 12:08:18.617565 21032 tablet_bootstrap.cc:492] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e: No bootstrap required, opened a new log
I20260709 12:08:18.618247 21032 ts_tablet_manager.cc:1403] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 12:08:18.621480 21032 raft_consensus.cc:359] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.622509 21032 raft_consensus.cc:385] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.623818 21034 ts_tablet_manager.cc:1434] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.001s
I20260709 12:08:18.623013 21032 raft_consensus.cc:740] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.624873 21034 tablet_bootstrap.cc:492] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1: Bootstrap starting.
I20260709 12:08:18.626426 21033 tablet_bootstrap.cc:492] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6: No bootstrap required, opened a new log
I20260709 12:08:18.626277 21032 consensus_queue.cc:260] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.628898 21032 ts_tablet_manager.cc:1434] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:08:18.626909 21033 ts_tablet_manager.cc:1403] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.006s
I20260709 12:08:18.629976 21032 tablet_bootstrap.cc:492] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e: Bootstrap starting.
I20260709 12:08:18.632586 21033 raft_consensus.cc:359] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.635437 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" is_pre_election: true
I20260709 12:08:18.635462 21033 raft_consensus.cc:385] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.636334 21033 raft_consensus.cc:740] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.637072 21033 consensus_queue.cc:260] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
W20260709 12:08:18.637763 20881 leader_election.cc:343] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.638610 21032 tablet_bootstrap.cc:654] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.644060 21033 ts_tablet_manager.cc:1434] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:08:18.645152 21033 tablet_bootstrap.cc:492] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6: Bootstrap starting.
I20260709 12:08:18.645038 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
W20260709 12:08:18.646787 20880 leader_election.cc:343] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.647219 20880 leader_election.cc:304] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e; no voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:18.648072 21038 raft_consensus.cc:2749] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.649667 21034 tablet_bootstrap.cc:654] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.652777 21033 tablet_bootstrap.cc:654] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.656278 21032 tablet_bootstrap.cc:492] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e: No bootstrap required, opened a new log
I20260709 12:08:18.656895 21032 ts_tablet_manager.cc:1403] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.018s
I20260709 12:08:18.660298 21034 tablet_bootstrap.cc:492] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1: No bootstrap required, opened a new log
I20260709 12:08:18.660151 21032 raft_consensus.cc:359] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.660776 21034 ts_tablet_manager.cc:1403] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.000s
I20260709 12:08:18.660912 21032 raft_consensus.cc:385] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.661227 21032 raft_consensus.cc:740] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.662017 21032 consensus_queue.cc:260] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.663852 21034 raft_consensus.cc:359] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.664542 21032 ts_tablet_manager.cc:1434] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:08:18.665596 21032 tablet_bootstrap.cc:492] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e: Bootstrap starting.
I20260709 12:08:18.673142 21032 tablet_bootstrap.cc:654] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.673311 21039 raft_consensus.cc:493] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.673822 21039 raft_consensus.cc:515] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.664588 21034 raft_consensus.cc:385] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.675321 21034 raft_consensus.cc:740] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.676451 21039 leader_election.cc:290] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:18.684082 21034 consensus_queue.cc:260] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.685637 21032 tablet_bootstrap.cc:492] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e: No bootstrap required, opened a new log
I20260709 12:08:18.686268 21032 ts_tablet_manager.cc:1403] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
I20260709 12:08:18.687134 21033 tablet_bootstrap.cc:492] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6: No bootstrap required, opened a new log
I20260709 12:08:18.687603 21033 ts_tablet_manager.cc:1403] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.004s
I20260709 12:08:18.689201 21032 raft_consensus.cc:359] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.689997 21032 raft_consensus.cc:385] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.690331 21034 ts_tablet_manager.cc:1434] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 12:08:18.690307 21032 raft_consensus.cc:740] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.691339 21034 tablet_bootstrap.cc:492] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1: Bootstrap starting.
I20260709 12:08:18.691212 21032 consensus_queue.cc:260] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.693773 21032 ts_tablet_manager.cc:1434] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:08:18.694434 21015 tablet.cc:2406] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:18.694916 21032 tablet_bootstrap.cc:492] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e: Bootstrap starting.
I20260709 12:08:18.700050 21033 raft_consensus.cc:359] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.701846 21033 raft_consensus.cc:385] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.702443 21032 tablet_bootstrap.cc:654] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.702167 21033 raft_consensus.cc:740] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.711434 21033 consensus_queue.cc:260] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.713568 21045 raft_consensus.cc:493] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.714138 21045 raft_consensus.cc:515] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.717149 21045 leader_election.cc:290] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:18.718729 21038 raft_consensus.cc:493] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.719251 21038 raft_consensus.cc:515] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.721599 21038 leader_election.cc:290] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:18.722364 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59493c182d040f889e1d81984651521" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:18.722994 21033 ts_tablet_manager.cc:1434] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.003s
W20260709 12:08:18.723913 20880 leader_election.cc:343] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.727475 21032 tablet_bootstrap.cc:492] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e: No bootstrap required, opened a new log
I20260709 12:08:18.727991 21032 ts_tablet_manager.cc:1403] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.004s
I20260709 12:08:18.729218 21034 tablet_bootstrap.cc:654] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.730634 21033 tablet_bootstrap.cc:492] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6: Bootstrap starting.
I20260709 12:08:18.736398 21038 raft_consensus.cc:493] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.737498 21038 raft_consensus.cc:515] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.741081 21032 raft_consensus.cc:359] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.741976 21032 raft_consensus.cc:385] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.742027 21039 raft_consensus.cc:493] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.742367 21032 raft_consensus.cc:740] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.742617 21039 raft_consensus.cc:515] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.743172 21038 leader_election.cc:290] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:18.744141 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59493c182d040f889e1d81984651521" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" is_pre_election: true
I20260709 12:08:18.744765 21039 leader_election.cc:290] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:18.744837 20989 raft_consensus.cc:2468] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 0.
I20260709 12:08:18.743187 21032 consensus_queue.cc:260] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.748193 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:18.749907 20840 raft_consensus.cc:2468] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 0.
I20260709 12:08:18.749892 20881 leader_election.cc:304] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:18.752125 21038 raft_consensus.cc:2804] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.752697 21038 raft_consensus.cc:493] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.752970 20880 leader_election.cc:304] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:18.753171 21038 raft_consensus.cc:3060] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.765030 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" is_pre_election: true
I20260709 12:08:18.764868 21032 ts_tablet_manager.cc:1434] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:08:18.789005 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:18.789237 21032 tablet_bootstrap.cc:492] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e: Bootstrap starting.
W20260709 12:08:18.786499 20881 leader_election.cc:343] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.793538 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59493c182d040f889e1d81984651521" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:18.795800 21033 tablet_bootstrap.cc:654] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.795943 21057 raft_consensus.cc:2804] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.796419 21057 raft_consensus.cc:493] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:08:18.792768 20954 leader_election.cc:343] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.796797 21057 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:18.799052 20954 leader_election.cc:343] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.801575 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:18.804586 20915 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 0.
I20260709 12:08:18.808597 20805 leader_election.cc:304] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:18.811307 21045 raft_consensus.cc:2804] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.811700 21045 raft_consensus.cc:493] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.812065 21045 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.813781 21038 raft_consensus.cc:515] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.827975 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59493c182d040f889e1d81984651521" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:18.823828 21038 leader_election.cc:290] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:18.830608 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" is_pre_election: true
I20260709 12:08:18.832338 20989 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 0.
I20260709 12:08:18.831905 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59493c182d040f889e1d81984651521" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:18.834877 21034 tablet_bootstrap.cc:492] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1: No bootstrap required, opened a new log
I20260709 12:08:18.835448 21034 ts_tablet_manager.cc:1403] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent bootstrapping tablet: real 0.144s	user 0.000s	sys 0.017s
I20260709 12:08:18.835386 20988 raft_consensus.cc:3060] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.838074 21032 tablet_bootstrap.cc:654] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.841516 21045 raft_consensus.cc:515] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
W20260709 12:08:18.840982 20880 leader_election.cc:343] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.849040 20914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59493c182d040f889e1d81984651521" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:18.849463 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:18.853051 20915 raft_consensus.cc:2468] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 0.
I20260709 12:08:18.852456 20914 raft_consensus.cc:2393] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in current term 1: Already voted for candidate 69c4bd8c5bdf413891671e66a98cf43e in this term.
I20260709 12:08:18.854403 20954 leader_election.cc:304] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:18.855470 21039 raft_consensus.cc:2804] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.855897 21039 raft_consensus.cc:493] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.856238 21039 raft_consensus.cc:3060] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.856088 20954 leader_election.cc:304] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6; no voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:18.850934 21034 raft_consensus.cc:359] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.848784 21057 raft_consensus.cc:515] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.864661 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:18.858238 20914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:18.866037 20914 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.857969 21034 raft_consensus.cc:385] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.866025 20989 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.867147 21034 raft_consensus.cc:740] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.865698 21045 leader_election.cc:290] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 1 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:18.872680 20988 raft_consensus.cc:2468] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 1.
I20260709 12:08:18.873711 21033 tablet_bootstrap.cc:492] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6: No bootstrap required, opened a new log
I20260709 12:08:18.874362 21033 ts_tablet_manager.cc:1403] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.024s
I20260709 12:08:18.874334 20881 leader_election.cc:304] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:18.875857 21038 raft_consensus.cc:2804] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.880227 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:18.880828 20840 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.880486 21033 raft_consensus.cc:359] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:18.881285 21033 raft_consensus.cc:385] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.881580 21033 raft_consensus.cc:740] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.879386 21057 leader_election.cc:290] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:18.885790 21060 raft_consensus.cc:2749] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.883939 21033 consensus_queue.cc:260] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:18.888885 21033 ts_tablet_manager.cc:1434] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:08:18.889809 21033 tablet_bootstrap.cc:492] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6: Bootstrap starting.
I20260709 12:08:18.875136 21034 consensus_queue.cc:260] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.892439 21038 raft_consensus.cc:697] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:18.890756 21039 raft_consensus.cc:515] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.895187 21034 ts_tablet_manager.cc:1434] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:08:18.896183 21039 leader_election.cc:290] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:18.896411 21034 tablet_bootstrap.cc:492] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1: Bootstrap starting.
I20260709 12:08:18.894055 21038 consensus_queue.cc:237] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.898696 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:18.908476 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:18.908388 20839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
W20260709 12:08:18.908833 20881 leader_election.cc:343] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.909607 20915 raft_consensus.cc:3060] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:18.911712 20954 leader_election.cc:343] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.906208 20840 raft_consensus.cc:2468] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 1.
I20260709 12:08:18.906307 20914 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 1.
I20260709 12:08:18.909997 20989 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 1.
I20260709 12:08:18.914935 20880 leader_election.cc:304] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 3812d2d1bb1945e0aae7631b9fc30bd6
I20260709 12:08:18.916165 21061 raft_consensus.cc:2804] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.916683 21061 raft_consensus.cc:697] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:18.918736 20806 leader_election.cc:304] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:18.919528 21045 raft_consensus.cc:2804] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.917883 21061 consensus_queue.cc:237] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.929684 21033 tablet_bootstrap.cc:654] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.932411 21045 raft_consensus.cc:697] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 LEADER]: Becoming Leader. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:18.934152 21045 consensus_queue.cc:237] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.935770 20915 raft_consensus.cc:2468] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 1.
I20260709 12:08:18.937474 20954 leader_election.cc:304] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:18.938975 21039 raft_consensus.cc:2804] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.939471 21039 raft_consensus.cc:697] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:18.939473 21032 tablet_bootstrap.cc:492] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e: No bootstrap required, opened a new log
I20260709 12:08:18.940584 21032 ts_tablet_manager.cc:1403] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent bootstrapping tablet: real 0.152s	user 0.008s	sys 0.014s
I20260709 12:08:18.940407 21039 consensus_queue.cc:237] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.946101 20735 catalog_manager.cc:5697] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 0 to 1, leader changed from <none> to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 1 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.980649 21034 tablet_bootstrap.cc:654] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.985038 21038 raft_consensus.cc:493] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.986229 21038 raft_consensus.cc:515] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:18.989044 21038 leader_election.cc:290] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:18.988749 20737 catalog_manager.cc:5697] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.990245 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ae02245cd841efb3d5878269487438" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" is_pre_election: true
W20260709 12:08:18.992502 20881 leader_election.cc:343] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.990636 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ae02245cd841efb3d5878269487438" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:18.983054 20736 catalog_manager.cc:5697] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: HEALTHY } } }
W20260709 12:08:18.994858 20880 leader_election.cc:343] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.995481 20880 leader_election.cc:304] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e; no voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:18.996748 21038 raft_consensus.cc:2749] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.001156 21032 raft_consensus.cc:359] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.002216 21032 raft_consensus.cc:385] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.002633 21032 raft_consensus.cc:740] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.003535 21032 consensus_queue.cc:260] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.006971 21032 ts_tablet_manager.cc:1434] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.004s
I20260709 12:08:19.009327 21032 tablet_bootstrap.cc:492] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e: Bootstrap starting.
I20260709 12:08:19.010072 21033 tablet_bootstrap.cc:492] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6: No bootstrap required, opened a new log
I20260709 12:08:19.010586 21033 ts_tablet_manager.cc:1403] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.008s
I20260709 12:08:19.014128 21061 raft_consensus.cc:493] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.016180 21033 raft_consensus.cc:359] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.019086 21033 raft_consensus.cc:385] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.019403 21033 raft_consensus.cc:740] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.022094 21034 tablet_bootstrap.cc:492] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1: No bootstrap required, opened a new log
I20260709 12:08:19.022622 21034 ts_tablet_manager.cc:1403] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.002s
I20260709 12:08:19.015597 21061 raft_consensus.cc:515] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.022794 21033 consensus_queue.cc:260] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.022032 21032 tablet_bootstrap.cc:654] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.027334 21061 leader_election.cc:290] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:19.028590 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:19.029410 21033 ts_tablet_manager.cc:1434] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:08:19.029959 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" is_pre_election: true
I20260709 12:08:19.030447 21033 tablet_bootstrap.cc:492] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6: Bootstrap starting.
W20260709 12:08:19.031369 20881 leader_election.cc:343] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.033345 21034 raft_consensus.cc:359] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.037698 21034 raft_consensus.cc:385] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.037992 21034 raft_consensus.cc:740] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.040145 21034 consensus_queue.cc:260] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.041253 20840 raft_consensus.cc:2468] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 0.
I20260709 12:08:19.051797 21034 ts_tablet_manager.cc:1434] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 12:08:19.052865 21034 tablet_bootstrap.cc:492] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1: Bootstrap starting.
I20260709 12:08:19.055512 21032 tablet_bootstrap.cc:492] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e: No bootstrap required, opened a new log
I20260709 12:08:19.055989 21032 ts_tablet_manager.cc:1403] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.002s
I20260709 12:08:19.056994 20880 leader_election.cc:304] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 3812d2d1bb1945e0aae7631b9fc30bd6
I20260709 12:08:19.057780 21061 raft_consensus.cc:2804] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.058182 21061 raft_consensus.cc:493] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.058564 21061 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.061785 21032 raft_consensus.cc:359] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.062486 21032 raft_consensus.cc:385] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.062768 21032 raft_consensus.cc:740] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.068454 21032 consensus_queue.cc:260] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.068645 21061 raft_consensus.cc:515] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.071090 21033 tablet_bootstrap.cc:654] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.071455 21032 ts_tablet_manager.cc:1434] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:08:19.059705 20734 catalog_manager.cc:5697] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 0 to 1, leader changed from <none> to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 1 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.075278 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:19.075575 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:19.075883 20840 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.072345 21032 tablet_bootstrap.cc:492] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e: Bootstrap starting.
I20260709 12:08:19.076763 21061 leader_election.cc:290] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:19.078052 21034 tablet_bootstrap.cc:654] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:19.078519 20881 leader_election.cc:343] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.086115 20840 raft_consensus.cc:2468] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 1.
I20260709 12:08:19.087661 20880 leader_election.cc:304] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 3812d2d1bb1945e0aae7631b9fc30bd6
I20260709 12:08:19.088685 21061 raft_consensus.cc:2804] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.095142 21061 raft_consensus.cc:697] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:19.096261 21061 consensus_queue.cc:237] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.110268 21033 tablet_bootstrap.cc:492] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6: No bootstrap required, opened a new log
I20260709 12:08:19.111152 21033 ts_tablet_manager.cc:1403] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.008s
I20260709 12:08:19.120429 21032 tablet_bootstrap.cc:654] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.121579 21039 raft_consensus.cc:493] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.123443 21039 raft_consensus.cc:515] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:19.127111 21033 raft_consensus.cc:359] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.132033 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:19.132753 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:19.132900 20915 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 0.
W20260709 12:08:19.134322 20954 leader_election.cc:343] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.130153 21033 raft_consensus.cc:385] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.128710 20737 catalog_manager.cc:5697] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 0 to 1, leader changed from <none> to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 1 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.135726 20954 leader_election.cc:304] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:19.136128 21033 raft_consensus.cc:740] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.136829 21060 raft_consensus.cc:2804] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.137320 21060 raft_consensus.cc:493] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.137017 21033 consensus_queue.cc:260] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.137774 21060 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.134842 21039 leader_election.cc:290] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801)
I20260709 12:08:19.155913 21033 ts_tablet_manager.cc:1434] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.003s
I20260709 12:08:19.157157 21033 tablet_bootstrap.cc:492] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6: Bootstrap starting.
I20260709 12:08:19.160548 21032 tablet_bootstrap.cc:492] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e: No bootstrap required, opened a new log
I20260709 12:08:19.161141 21032 ts_tablet_manager.cc:1403] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent bootstrapping tablet: real 0.089s	user 0.004s	sys 0.012s
I20260709 12:08:19.163837 21033 tablet_bootstrap.cc:654] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.164299 21032 raft_consensus.cc:359] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.165155 21032 raft_consensus.cc:385] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.165530 21032 raft_consensus.cc:740] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.166375 21032 consensus_queue.cc:260] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.170234 21060 raft_consensus.cc:515] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:19.174000 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:19.174863 20915 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.175976 21032 ts_tablet_manager.cc:1434] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:08:19.184594 20915 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 1.
I20260709 12:08:19.186344 20954 leader_election.cc:304] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: 
I20260709 12:08:19.187636 21079 raft_consensus.cc:2804] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.188197 21079 raft_consensus.cc:697] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:19.188899 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:19.189134 21079 consensus_queue.cc:237] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
W20260709 12:08:19.190533 20954 leader_election.cc:343] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.187633 21060 leader_election.cc:290] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801)
I20260709 12:08:19.191233 21034 tablet_bootstrap.cc:492] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1: No bootstrap required, opened a new log
I20260709 12:08:19.191993 21034 ts_tablet_manager.cc:1403] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.014s
I20260709 12:08:19.194294 21079 raft_consensus.cc:493] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.196290 21034 raft_consensus.cc:359] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.196348 21079 raft_consensus.cc:515] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.197247 21034 raft_consensus.cc:385] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.197616 21034 raft_consensus.cc:740] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.197659 20737 catalog_manager.cc:5697] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.198664 21034 consensus_queue.cc:260] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.201327 21033 tablet_bootstrap.cc:492] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6: No bootstrap required, opened a new log
I20260709 12:08:19.203949 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6811d3031856495a846d6e7979982300" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:19.204280 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6811d3031856495a846d6e7979982300" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:19.204599 20840 raft_consensus.cc:2468] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 0.
I20260709 12:08:19.204901 20915 raft_consensus.cc:2468] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 0.
I20260709 12:08:19.205986 20954 leader_election.cc:304] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: 
I20260709 12:08:19.202105 21079 leader_election.cc:290] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:19.207137 21060 raft_consensus.cc:2804] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.207500 21060 raft_consensus.cc:493] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.207911 21060 raft_consensus.cc:3060] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.211603 21033 ts_tablet_manager.cc:1403] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.016s
I20260709 12:08:19.213094 21060 raft_consensus.cc:515] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.214922 21034 ts_tablet_manager.cc:1434] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:08:19.215972 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6811d3031856495a846d6e7979982300" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:19.217903 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6811d3031856495a846d6e7979982300" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:19.218182 20840 raft_consensus.cc:3060] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.218554 20915 raft_consensus.cc:3060] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.225071 20915 raft_consensus.cc:2468] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 1.
I20260709 12:08:19.225461 21060 leader_election.cc:290] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:19.217926 21034 tablet_bootstrap.cc:492] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1: Bootstrap starting.
I20260709 12:08:19.226082 20954 leader_election.cc:304] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: 
I20260709 12:08:19.216478 21033 raft_consensus.cc:359] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.226873 21033 raft_consensus.cc:385] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.227124 21060 raft_consensus.cc:2804] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.227725 21033 raft_consensus.cc:740] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.227880 21060 raft_consensus.cc:697] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:19.228827 21060 consensus_queue.cc:237] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.229053 21033 consensus_queue.cc:260] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.231583 21033 ts_tablet_manager.cc:1434] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 12:08:19.232645 21033 tablet_bootstrap.cc:492] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6: Bootstrap starting.
I20260709 12:08:19.233481 21034 tablet_bootstrap.cc:654] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.236044 21039 raft_consensus.cc:493] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.236624 21039 raft_consensus.cc:515] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.238780 21039 leader_election.cc:290] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:19.239594 21033 tablet_bootstrap.cc:654] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.242600 21039 raft_consensus.cc:493] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.227185 20840 raft_consensus.cc:2468] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 1.
I20260709 12:08:19.246742 20839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ae02245cd841efb3d5878269487438" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:19.247383 20839 raft_consensus.cc:2468] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 0.
I20260709 12:08:19.248827 20954 leader_election.cc:304] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:19.243206 21039 raft_consensus.cc:515] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.251199 21039 leader_election.cc:290] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:19.252539 21039 raft_consensus.cc:2804] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.252743 20914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:19.251878 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ae02245cd841efb3d5878269487438" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:19.253468 20915 raft_consensus.cc:2468] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 0.
I20260709 12:08:19.252957 21039 raft_consensus.cc:493] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.254398 21039 raft_consensus.cc:3060] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.254304 20839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:19.255501 20839 raft_consensus.cc:2393] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in current term 1: Already voted for candidate 69c4bd8c5bdf413891671e66a98cf43e in this term.
I20260709 12:08:19.256891 20954 leader_election.cc:304] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6; no voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:19.258391 21079 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.261087 21034 tablet_bootstrap.cc:492] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1: No bootstrap required, opened a new log
I20260709 12:08:19.261579 21034 ts_tablet_manager.cc:1403] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.013s
I20260709 12:08:19.264016 21039 raft_consensus.cc:515] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.264518 21034 raft_consensus.cc:359] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.265935 21034 raft_consensus.cc:385] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.266259 21034 raft_consensus.cc:740] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.266526 21079 raft_consensus.cc:2749] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.267055 21034 consensus_queue.cc:260] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.269641 21034 ts_tablet_manager.cc:1434] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 12:08:19.270679 21034 tablet_bootstrap.cc:492] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1: Bootstrap starting.
I20260709 12:08:19.277678 21034 tablet_bootstrap.cc:654] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.280790 20737 catalog_manager.cc:5697] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.283464 21039 leader_election.cc:290] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:19.287084 20839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ae02245cd841efb3d5878269487438" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:19.287271 21034 tablet_bootstrap.cc:492] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1: No bootstrap required, opened a new log
I20260709 12:08:19.287668 20839 raft_consensus.cc:3060] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.287876 21034 ts_tablet_manager.cc:1403] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:08:19.288368 21033 tablet_bootstrap.cc:492] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6: No bootstrap required, opened a new log
I20260709 12:08:19.288785 21033 ts_tablet_manager.cc:1403] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.003s
I20260709 12:08:19.291137 21034 raft_consensus.cc:359] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:19.291851 21034 raft_consensus.cc:385] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.291666 21033 raft_consensus.cc:359] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.292176 21034 raft_consensus.cc:740] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.292346 21033 raft_consensus.cc:385] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.292610 21033 raft_consensus.cc:740] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.292940 21034 consensus_queue.cc:260] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:19.308308 21034 ts_tablet_manager.cc:1434] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent starting tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:08:19.309330 21034 tablet_bootstrap.cc:492] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1: Bootstrap starting.
W20260709 12:08:19.310148 20785 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:19.301590 20839 raft_consensus.cc:2468] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 1.
I20260709 12:08:19.293243 21033 consensus_queue.cc:260] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.301100 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ae02245cd841efb3d5878269487438" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:19.311026 20915 raft_consensus.cc:3060] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.312623 21033 ts_tablet_manager.cc:1434] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 12:08:19.313589 21033 tablet_bootstrap.cc:492] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6: Bootstrap starting.
I20260709 12:08:19.319025 20915 raft_consensus.cc:2468] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 1.
I20260709 12:08:19.320235 21033 tablet_bootstrap.cc:654] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.320202 20954 leader_election.cc:304] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: 
I20260709 12:08:19.321070 21039 raft_consensus.cc:2804] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.321979 21039 raft_consensus.cc:697] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:19.322820 21039 consensus_queue.cc:237] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.325830 21034 tablet_bootstrap.cc:654] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.331120 21034 tablet_bootstrap.cc:492] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1: No bootstrap required, opened a new log
I20260709 12:08:19.331604 21034 ts_tablet_manager.cc:1403] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 12:08:19.332573 21045 raft_consensus.cc:493] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.332907 20734 catalog_manager.cc:5697] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.333243 21045 raft_consensus.cc:515] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:19.334245 21034 raft_consensus.cc:359] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.335757 21034 raft_consensus.cc:385] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.336015 21034 raft_consensus.cc:740] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.336109 21045 leader_election.cc:290] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:19.336714 21034 consensus_queue.cc:260] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.337615 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" is_pre_election: true
I20260709 12:08:19.339437 21034 ts_tablet_manager.cc:1434] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:08:19.340931 21034 tablet_bootstrap.cc:492] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1: Bootstrap starting.
I20260709 12:08:19.346866 21034 tablet_bootstrap.cc:654] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.348831 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:19.349604 20915 raft_consensus.cc:2393] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in current term 1: Already voted for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in this term.
I20260709 12:08:19.350685 20805 leader_election.cc:304] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:19.351845 21045 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.353973 21033 tablet_bootstrap.cc:492] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6: No bootstrap required, opened a new log
I20260709 12:08:19.354727 21033 ts_tablet_manager.cc:1403] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent bootstrapping tablet: real 0.041s	user 0.005s	sys 0.011s
I20260709 12:08:19.357189 21033 raft_consensus.cc:359] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.357853 21033 raft_consensus.cc:385] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.358110 21033 raft_consensus.cc:740] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.358758 21033 consensus_queue.cc:260] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.360277 21045 raft_consensus.cc:2749] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.363593 21033 ts_tablet_manager.cc:1434] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:08:19.364241 21034 tablet_bootstrap.cc:492] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1: No bootstrap required, opened a new log
I20260709 12:08:19.364635 21034 ts_tablet_manager.cc:1403] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 12:08:19.366950 21034 raft_consensus.cc:359] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.367635 21034 raft_consensus.cc:385] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.367930 21034 raft_consensus.cc:740] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.368595 21034 consensus_queue.cc:260] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.370486 21034 ts_tablet_manager.cc:1434] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:08:19.387142 20989 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.389583 21045 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.394968 21061 consensus_queue.cc:1048] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.402765 21039 raft_consensus.cc:493] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.403290 21039 raft_consensus.cc:515] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.405295 21039 leader_election.cc:290] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:19.409089 21045 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.411002 20839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" is_pre_election: true
I20260709 12:08:19.411681 20839 raft_consensus.cc:2468] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 0.
I20260709 12:08:19.418316 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:19.419055 20915 raft_consensus.cc:2468] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 0.
I20260709 12:08:19.420852 20954 leader_election.cc:304] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: 
I20260709 12:08:19.421993 21039 raft_consensus.cc:2804] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.422386 21039 raft_consensus.cc:493] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.422752 21039 raft_consensus.cc:3060] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.425635 21061 consensus_queue.cc:1048] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.444384 21061 consensus_queue.cc:1048] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.457476 21060 consensus_queue.cc:1048] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.457706 21039 raft_consensus.cc:515] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.460192 21045 raft_consensus.cc:493] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.460665 21045 raft_consensus.cc:515] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.463996 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e" is_pre_election: true
I20260709 12:08:19.464603 21045 leader_election.cc:290] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:19.464818 20987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" is_pre_election: true
I20260709 12:08:19.466493 20806 leader_election.cc:304] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:19.466490 20840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:19.468719 20840 raft_consensus.cc:3060] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.459839 21039 leader_election.cc:290] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:19.476543 20914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:19.477402 20914 raft_consensus.cc:3060] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.478622 21045 raft_consensus.cc:2749] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.490679 20838 raft_consensus.cc:3060] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.504993 21079 consensus_queue.cc:1048] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.508594 20840 raft_consensus.cc:2468] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 1.
I20260709 12:08:19.510174 20954 leader_election.cc:304] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:19.511225 21079 raft_consensus.cc:2804] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.511727 21079 raft_consensus.cc:697] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Becoming Leader. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:19.512574 21079 consensus_queue.cc:237] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.514194 20914 raft_consensus.cc:2468] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 1.
I20260709 12:08:19.525120 20840 raft_consensus.cc:3060] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.537508 21038 consensus_queue.cc:1048] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.556695 20734 catalog_manager.cc:5697] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.591945 21061 consensus_queue.cc:1048] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.592484 20989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
mode: GRACEFUL
new_leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:08:19.593191 20989 raft_consensus.cc:606] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Received request to transfer leadership to TS bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:19.610204 21096 consensus_queue.cc:1048] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.614157 20914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
mode: GRACEFUL
new_leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:34566
I20260709 12:08:19.614792 20914 raft_consensus.cc:606] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Received request to transfer leadership to TS bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:19.624423 20989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
mode: GRACEFUL
new_leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:08:19.625046 20989 raft_consensus.cc:606] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Received request to transfer leadership to TS bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:19.630877 20914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7210c3eb44834760bb54a02233edb824"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
mode: GRACEFUL
new_leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:34566
I20260709 12:08:19.631487 20914 raft_consensus.cc:606] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Received request to transfer leadership to TS bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:19.636781 20989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6811d3031856495a846d6e7979982300"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
mode: GRACEFUL
new_leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:08:19.637306 20989 raft_consensus.cc:606] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Received request to transfer leadership to TS 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:19.642158 20989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
mode: GRACEFUL
new_leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:08:19.642724 20989 raft_consensus.cc:606] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Received request to transfer leadership to TS 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:19.658545 20839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
mode: GRACEFUL
new_leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34132
I20260709 12:08:19.659094 20839 raft_consensus.cc:606] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 LEADER]: Received request to transfer leadership to TS 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:19.715727 21079 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.722676 21039 raft_consensus.cc:993] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6: : Instructing follower bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:19.723168 21039 raft_consensus.cc:1081] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Signalling peer bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:19.725564 20838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:34128
I20260709 12:08:19.726161 20838 raft_consensus.cc:493] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.726539 20838 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.728644 21039 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.734845 20838 raft_consensus.cc:515] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:19.736346 20839 raft_consensus.cc:1240] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Rejecting Update request from peer 3812d2d1bb1945e0aae7631b9fc30bd6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:19.740368 20914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:19.740967 20914 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.741619 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:19.742231 20989 raft_consensus.cc:3055] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.742589 20989 raft_consensus.cc:740] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:19.743441 20989 consensus_queue.cc:260] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:19.744727 20989 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.747855 20914 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 2.
I20260709 12:08:19.747941 20838 leader_election.cc:290] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 2 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:19.750394 20805 leader_election.cc:304] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:19.751363 21064 raft_consensus.cc:2804] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.751827 21064 raft_consensus.cc:697] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Becoming Leader. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:19.752789 20989 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 2.
I20260709 12:08:19.752699 21064 consensus_queue.cc:237] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:19.760524 20736 catalog_manager.cc:5697] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 reported cstate change: term changed from 1 to 2, leader changed from 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67) to bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.783290 21079 consensus_queue.cc:1048] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.797259 21039 consensus_queue.cc:1048] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.805153 21060 raft_consensus.cc:993] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6: : Instructing follower 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:19.805675 21039 raft_consensus.cc:1081] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Signalling peer 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:19.807355 20914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6811d3031856495a846d6e7979982300"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34542
I20260709 12:08:19.807991 20914 raft_consensus.cc:493] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.808364 20914 raft_consensus.cc:3060] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.813319 20914 raft_consensus.cc:515] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.816001 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6811d3031856495a846d6e7979982300" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:19.816176 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6811d3031856495a846d6e7979982300" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:19.816622 20838 raft_consensus.cc:3060] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.816676 20989 raft_consensus.cc:3055] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.817075 20989 raft_consensus.cc:740] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:19.817739 20914 leader_election.cc:290] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 2 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:19.819530 20989 consensus_queue.cc:260] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.820860 20989 raft_consensus.cc:3060] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.824139 20838 raft_consensus.cc:2468] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 2.
I20260709 12:08:19.825541 20880 leader_election.cc:304] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:19.826538 21096 raft_consensus.cc:2804] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.827010 21096 raft_consensus.cc:697] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:19.828023 20989 raft_consensus.cc:2468] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 2.
I20260709 12:08:19.827884 21096 consensus_queue.cc:237] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.835497 20735 catalog_manager.cc:5697] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 1 to 2, leader changed from 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67) to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 2 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.841555 21039 consensus_queue.cc:1048] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.852141 21039 consensus_queue.cc:1048] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.849761 21096 raft_consensus.cc:993] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e: : Instructing follower bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:19.859647 21038 raft_consensus.cc:1081] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Signalling peer bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:19.861490 20839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:34124
I20260709 12:08:19.862056 20839 raft_consensus.cc:493] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.862449 20839 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.870152 20839 raft_consensus.cc:515] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.872777 20914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:19.873363 20914 raft_consensus.cc:3055] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.873505 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:19.873724 20914 raft_consensus.cc:740] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:19.874075 20989 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.874658 20914 consensus_queue.cc:260] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.875839 20914 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.877682 20839 leader_election.cc:290] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 2 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:19.881448 20989 raft_consensus.cc:2468] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 2.
I20260709 12:08:19.882766 20914 raft_consensus.cc:2468] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 2.
I20260709 12:08:19.882733 20806 leader_election.cc:304] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:19.883740 21064 raft_consensus.cc:2804] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.884203 21064 raft_consensus.cc:697] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Becoming Leader. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:19.885064 21064 consensus_queue.cc:237] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.892829 21039 consensus_queue.cc:1048] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.892699 20737 catalog_manager.cc:5697] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 reported cstate change: term changed from 1 to 2, leader changed from 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66) to bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.901418 21060 raft_consensus.cc:993] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6: : Instructing follower bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:19.901870 21060 raft_consensus.cc:1081] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Signalling peer bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:19.903481 20838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:34128
I20260709 12:08:19.904448 20838 raft_consensus.cc:493] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.904911 20838 raft_consensus.cc:3060] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.909782 21060 consensus_queue.cc:1048] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.911855 20838 raft_consensus.cc:515] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.914680 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:19.919009 20838 leader_election.cc:290] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 2 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:19.932085 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:19.932825 20989 raft_consensus.cc:3055] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.933605 20989 raft_consensus.cc:740] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:19.935043 20989 consensus_queue.cc:260] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.936554 20989 raft_consensus.cc:3060] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.943200 20989 raft_consensus.cc:2468] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 2.
I20260709 12:08:19.944236 20806 leader_election.cc:304] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:19.944967 21064 raft_consensus.cc:2804] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.945468 21064 raft_consensus.cc:697] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Becoming Leader. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:19.946260 21064 consensus_queue.cc:237] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.950141 21060 raft_consensus.cc:993] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6: : Instructing follower 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:19.950646 21039 raft_consensus.cc:1081] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Signalling peer 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:19.952348 20914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34542
I20260709 12:08:19.952857 20914 raft_consensus.cc:493] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.953172 20914 raft_consensus.cc:3060] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.954734 20736 catalog_manager.cc:5697] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 reported cstate change: term changed from 1 to 2, leader changed from 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67) to bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.957647 20914 raft_consensus.cc:515] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.960230 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:19.960806 20838 raft_consensus.cc:3060] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.962304 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d19d83df2e46b082b530e3acb74934" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:19.962934 20989 raft_consensus.cc:3055] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.963243 20989 raft_consensus.cc:740] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:19.964179 20989 consensus_queue.cc:260] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.965268 20989 raft_consensus.cc:3060] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.966566 20914 leader_election.cc:290] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 2 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:19.967653 20838 raft_consensus.cc:2468] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 2.
I20260709 12:08:19.968756 20880 leader_election.cc:304] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:19.969564 21038 raft_consensus.cc:2804] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.970010 21038 raft_consensus.cc:697] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:19.971025 21038 consensus_queue.cc:237] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:19.971765 20989 raft_consensus.cc:2468] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 2.
I20260709 12:08:19.977593 20736 catalog_manager.cc:5697] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 1 to 2, leader changed from 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67) to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 2 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.025218 21064 raft_consensus.cc:993] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1: : Instructing follower 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:20.025727 21045 raft_consensus.cc:1081] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 LEADER]: Signalling peer 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:20.027463 20914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34556
I20260709 12:08:20.028131 20914 raft_consensus.cc:493] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.028496 20914 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.032981 20914 raft_consensus.cc:515] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:20.034826 20914 leader_election.cc:290] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 2 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:20.035660 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:20.035979 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:20.036326 20838 raft_consensus.cc:3055] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.036584 20989 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.036710 20838 raft_consensus.cc:740] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:20.037598 20838 consensus_queue.cc:260] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:20.038800 20838 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.041637 20989 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 2.
I20260709 12:08:20.042702 20881 leader_election.cc:304] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: 
I20260709 12:08:20.043422 21038 raft_consensus.cc:2804] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.043861 21038 raft_consensus.cc:697] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:20.044591 21038 consensus_queue.cc:237] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:20.045944 20838 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 2.
I20260709 12:08:20.051877 20736 catalog_manager.cc:5697] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 1 to 2, leader changed from bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65) to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 2 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.128799 21096 raft_consensus.cc:993] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e: : Instructing follower bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:20.129288 21038 raft_consensus.cc:1081] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Signalling peer bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:20.130913 20838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7210c3eb44834760bb54a02233edb824"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:34124
I20260709 12:08:20.131485 20838 raft_consensus.cc:493] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.131836 20838 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.138489 20838 raft_consensus.cc:515] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:20.140875 20838 leader_election.cc:290] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 2 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:20.141819 20989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:20.141963 20914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:20.142493 20989 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.142643 20914 raft_consensus.cc:3055] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.143146 20914 raft_consensus.cc:740] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:20.143970 20914 consensus_queue.cc:260] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:20.145217 20914 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.149343 20989 raft_consensus.cc:2468] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 2.
I20260709 12:08:20.150462 20806 leader_election.cc:304] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:20.151160 21045 raft_consensus.cc:2804] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.151597 21045 raft_consensus.cc:697] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Becoming Leader. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:20.152302 21045 consensus_queue.cc:237] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:20.152586 20914 raft_consensus.cc:2468] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 2.
I20260709 12:08:20.159449 20736 catalog_manager.cc:5697] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 reported cstate change: term changed from 1 to 2, leader changed from 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66) to bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.181408 20914 raft_consensus.cc:1275] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.182794 21045 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.191895 20989 raft_consensus.cc:1275] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.194505 21064 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.324508 20838 raft_consensus.cc:1275] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.325862 21038 consensus_queue.cc:1048] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.335834 20989 raft_consensus.cc:1275] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.337754 21038 consensus_queue.cc:1048] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.360814 20914 raft_consensus.cc:3060] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.368361 20914 raft_consensus.cc:1275] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.369808 21045 consensus_queue.cc:1048] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.378542 20988 raft_consensus.cc:1275] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.380093 21120 consensus_queue.cc:1048] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.380584 20838 raft_consensus.cc:1275] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.382033 21096 consensus_queue.cc:1048] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.396924 20988 raft_consensus.cc:1275] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.398768 21061 consensus_queue.cc:1048] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.428719 20988 raft_consensus.cc:1275] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.430060 21096 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.439765 20839 raft_consensus.cc:1275] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.441138 21038 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.476846 20914 raft_consensus.cc:1275] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.478004 21120 consensus_queue.cc:1048] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.480226 20988 raft_consensus.cc:1275] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.481588 21120 consensus_queue.cc:1048] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.581401 20914 raft_consensus.cc:1275] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.582752 21120 consensus_queue.cc:1048] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.590588 20988 raft_consensus.cc:1275] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.592613 21064 consensus_queue.cc:1048] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.693753 20705 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:22.694623 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:22.709838 20914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
mode: GRACEFUL
new_leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:08:22.710337 20914 raft_consensus.cc:606] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Received request to transfer leadership to TS 3812d2d1bb1945e0aae7631b9fc30bd6
I20260709 12:08:22.720021 20838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
mode: GRACEFUL
new_leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:08:22.720484 20838 raft_consensus.cc:606] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Received request to transfer leadership to TS 3812d2d1bb1945e0aae7631b9fc30bd6
I20260709 12:08:22.721458 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:22.721838 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.846452 21064 raft_consensus.cc:993] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1: : Instructing follower 3812d2d1bb1945e0aae7631b9fc30bd6 to start an election
I20260709 12:08:22.846911 21129 raft_consensus.cc:1081] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Signalling peer 3812d2d1bb1945e0aae7631b9fc30bd6 to start an election
I20260709 12:08:22.848385 20988 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
 from {username='slave'} at 127.0.0.1:52388
I20260709 12:08:22.848873 20988 raft_consensus.cc:493] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.849174 20988 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.853710 20988 raft_consensus.cc:515] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:22.855330 20988 leader_election.cc:290] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 3 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801)
I20260709 12:08:22.856204 20914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:22.856501 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:22.856685 20914 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.857009 20838 raft_consensus.cc:3055] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.857335 20838 raft_consensus.cc:740] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:22.858098 20838 consensus_queue.cc:260] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:22.859313 20838 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.861071 20914 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 3.
I20260709 12:08:22.862150 20954 leader_election.cc:304] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: 
I20260709 12:08:22.862975 21122 raft_consensus.cc:2804] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.864245 21122 raft_consensus.cc:697] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Becoming Leader. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:22.864460 20838 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 3.
I20260709 12:08:22.865082 21122 consensus_queue.cc:237] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:22.872044 20737 catalog_manager.cc:5697] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 reported cstate change: term changed from 2 to 3, leader changed from bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65) to 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67). New cstate: current_term: 3 leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:22.938984 21136 raft_consensus.cc:993] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e: : Instructing follower 3812d2d1bb1945e0aae7631b9fc30bd6 to start an election
I20260709 12:08:22.939495 21136 raft_consensus.cc:1081] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Signalling peer 3812d2d1bb1945e0aae7631b9fc30bd6 to start an election
I20260709 12:08:22.941112 20988 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
 from {username='slave'} at 127.0.0.1:52380
I20260709 12:08:22.941582 20988 raft_consensus.cc:493] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.941854 20988 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.946707 20988 raft_consensus.cc:515] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:22.948321 20988 leader_election.cc:290] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 3 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:22.949249 20839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:22.949465 20914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:22.949854 20839 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.949919 20914 raft_consensus.cc:3055] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.950379 20914 raft_consensus.cc:740] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:22.951159 20914 consensus_queue.cc:260] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:22.952232 20914 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.956472 20839 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 3.
I20260709 12:08:22.957612 20954 leader_election.cc:304] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:22.958236 20914 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 3.
I20260709 12:08:22.958465 21122 raft_consensus.cc:2804] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.958994 21122 raft_consensus.cc:697] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Becoming Leader. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:22.959708 21122 consensus_queue.cc:237] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:22.969336 20737 catalog_manager.cc:5697] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 reported cstate change: term changed from 2 to 3, leader changed from 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66) to 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67). New cstate: current_term: 3 leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:23.252667 20839 raft_consensus.cc:1275] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Refusing update from remote peer 3812d2d1bb1945e0aae7631b9fc30bd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.253973 21122 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.262887 20914 raft_consensus.cc:1275] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Refusing update from remote peer 3812d2d1bb1945e0aae7631b9fc30bd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.264351 21122 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.478196 20839 raft_consensus.cc:1275] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Refusing update from remote peer 3812d2d1bb1945e0aae7631b9fc30bd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.479578 21130 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.489123 20914 raft_consensus.cc:1275] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Refusing update from remote peer 3812d2d1bb1945e0aae7631b9fc30bd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.491714 21122 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.722834 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.727553 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:23.727963 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:24.729012 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.734859 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.735198 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.736065 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.741329 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.741695 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.742775 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.747718 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.748282 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.749478 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.754112 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.754555 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.755595 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.761389 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.761751 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.762723 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.767562 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.767949 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.769022 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.773996 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.774490 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.775457 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.780452 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:31.780956 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.808651 20705 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:32.813380 20988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
mode: GRACEFUL
new_leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:08:32.813970 20988 raft_consensus.cc:606] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Received request to transfer leadership to TS 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:32.818969 20838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
mode: GRACEFUL
new_leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34132
I20260709 12:08:32.819485 20838 raft_consensus.cc:606] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Received request to transfer leadership to TS 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:32.824105 20838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
mode: GRACEFUL
new_leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34132
I20260709 12:08:32.824606 20838 raft_consensus.cc:606] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Received request to transfer leadership to TS 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:32.829059 20838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7210c3eb44834760bb54a02233edb824"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
mode: GRACEFUL
new_leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34132
I20260709 12:08:32.829618 20838 raft_consensus.cc:606] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Received request to transfer leadership to TS 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:32.832274 21152 raft_consensus.cc:993] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6: : Instructing follower 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:32.832816 21148 raft_consensus.cc:1081] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Signalling peer 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:32.834254 20915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34542
I20260709 12:08:32.834793 20915 raft_consensus.cc:493] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.835166 20915 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.839952 20988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
mode: GRACEFUL
new_leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:52390
I20260709 12:08:32.840420 20988 raft_consensus.cc:606] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Received request to transfer leadership to TS 69c4bd8c5bdf413891671e66a98cf43e
I20260709 12:08:32.841643 20915 raft_consensus.cc:515] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:32.843814 20915 leader_election.cc:290] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 4 election: Requested vote from peers 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603), bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801)
I20260709 12:08:32.844446 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:32.845047 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:32.845256 20988 raft_consensus.cc:3055] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:32.845551 20988 raft_consensus.cc:740] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:32.845559 20838 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.846391 20988 consensus_queue.cc:260] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:32.847715 20988 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.850807 20838 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 4.
I20260709 12:08:32.851900 20880 leader_election.cc:304] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:32.852677 21136 raft_consensus.cc:2804] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:32.852815 20988 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 4.
I20260709 12:08:32.853663 21136 raft_consensus.cc:697] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:32.854578 21136 consensus_queue.cc:237] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:32.860932 20736 catalog_manager.cc:5697] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 3 to 4, leader changed from 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67) to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 4 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.873792 21152 raft_consensus.cc:993] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6: : Instructing follower 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:32.874243 21148 raft_consensus.cc:1081] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Signalling peer 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:32.875735 20915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34542
I20260709 12:08:32.876171 20915 raft_consensus.cc:493] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.876427 20915 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.881623 20915 raft_consensus.cc:515] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:32.882263 21151 raft_consensus.cc:993] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1: : Instructing follower 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:32.883003 21159 raft_consensus.cc:1081] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Signalling peer 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:32.883299 20915 leader_election.cc:290] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 4 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:32.884302 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:32.884363 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:32.885071 20838 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.885102 20988 raft_consensus.cc:3055] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:32.885154 20915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34556
I20260709 12:08:32.885682 20988 raft_consensus.cc:740] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:32.885938 20915 raft_consensus.cc:493] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.886379 20915 raft_consensus.cc:3060] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.886536 20988 consensus_queue.cc:260] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:32.887835 20988 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.890146 20838 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 4.
I20260709 12:08:32.891449 20880 leader_election.cc:304] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:32.892336 21136 raft_consensus.cc:2804] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:32.892805 21136 raft_consensus.cc:697] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:32.893006 20915 raft_consensus.cc:515] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:32.893659 21136 consensus_queue.cc:237] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:32.893893 20988 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 4.
I20260709 12:08:32.894913 20915 leader_election.cc:290] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 3 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:32.895942 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:32.896507 20838 raft_consensus.cc:3055] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.896855 20838 raft_consensus.cc:740] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:32.896988 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923e9519c19c4c3593313ac77e4f0dcb" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:32.897496 20988 raft_consensus.cc:3060] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.897830 20838 consensus_queue.cc:260] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:32.901046 20838 raft_consensus.cc:3060] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.903535 20988 raft_consensus.cc:2468] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 3.
I20260709 12:08:32.902980 20736 catalog_manager.cc:5697] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 3 to 4, leader changed from 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67) to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 4 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.904624 20881 leader_election.cc:304] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: 
I20260709 12:08:32.905413 21136 raft_consensus.cc:2804] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.905997 21136 raft_consensus.cc:697] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:32.906077 20838 raft_consensus.cc:2468] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 3.
I20260709 12:08:32.906973 21136 consensus_queue.cc:237] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:32.915555 20736 catalog_manager.cc:5697] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 2 to 3, leader changed from bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65) to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 3 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.028939 21151 raft_consensus.cc:993] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1: : Instructing follower 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:33.029354 21159 raft_consensus.cc:1081] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Signalling peer 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:33.030728 20915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34556
I20260709 12:08:33.031204 20915 raft_consensus.cc:493] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.031483 20915 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.035672 20915 raft_consensus.cc:515] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:33.037268 20915 leader_election.cc:290] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 3 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:33.038079 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:33.038673 20838 raft_consensus.cc:3055] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:33.038709 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:33.038914 20838 raft_consensus.cc:740] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:33.039259 20988 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.039673 20838 consensus_queue.cc:260] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:33.040496 20838 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.043380 20988 raft_consensus.cc:2468] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 3.
I20260709 12:08:33.044301 20881 leader_election.cc:304] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, 69c4bd8c5bdf413891671e66a98cf43e; no voters: 
I20260709 12:08:33.044476 20838 raft_consensus.cc:2468] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 3.
I20260709 12:08:33.045058 21136 raft_consensus.cc:2804] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:33.045480 21136 raft_consensus.cc:697] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:33.046182 21136 consensus_queue.cc:237] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:33.053272 20736 catalog_manager.cc:5697] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 2 to 3, leader changed from bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65) to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 3 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.280757 20988 raft_consensus.cc:1275] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.282136 21136 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.293349 20838 raft_consensus.cc:1275] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.295915 21165 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:33.307643 20838 raft_consensus.cc:1275] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.308997 21165 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.311913 20988 raft_consensus.cc:1275] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.313134 21165 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.363940 20988 raft_consensus.cc:1275] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.365164 21165 consensus_queue.cc:1048] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.368247 21151 raft_consensus.cc:993] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1: : Instructing follower 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:33.368746 21159 raft_consensus.cc:1081] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Signalling peer 69c4bd8c5bdf413891671e66a98cf43e to start an election
I20260709 12:08:33.370520 20915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7210c3eb44834760bb54a02233edb824"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
 from {username='slave'} at 127.0.0.1:34556
I20260709 12:08:33.371012 20915 raft_consensus.cc:493] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.371345 20915 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.376124 20838 raft_consensus.cc:1275] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.377581 21171 consensus_queue.cc:1048] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.378000 20915 raft_consensus.cc:515] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:33.379863 20915 leader_election.cc:290] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 3 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:33.381038 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:33.381392 20839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "69c4bd8c5bdf413891671e66a98cf43e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:33.381644 20988 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.381930 20839 raft_consensus.cc:3055] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:33.382242 20839 raft_consensus.cc:740] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:33.382992 20839 consensus_queue.cc:260] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:33.384132 20839 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.388918 20839 raft_consensus.cc:2468] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 3.
I20260709 12:08:33.390043 20880 leader_election.cc:304] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c4bd8c5bdf413891671e66a98cf43e, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:33.390468 20988 raft_consensus.cc:2468] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69c4bd8c5bdf413891671e66a98cf43e in term 3.
I20260709 12:08:33.391084 21171 raft_consensus.cc:2804] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:33.391548 21171 raft_consensus.cc:697] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Becoming Leader. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:33.392917 21171 consensus_queue.cc:237] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:33.400556 20735 catalog_manager.cc:5697] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e reported cstate change: term changed from 2 to 3, leader changed from bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65) to 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66). New cstate: current_term: 3 leader_uuid: "69c4bd8c5bdf413891671e66a98cf43e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.521862 20988 raft_consensus.cc:1275] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.522979 21171 consensus_queue.cc:1048] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.530936 20838 raft_consensus.cc:1275] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.532680 21172 consensus_queue.cc:1048] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:33.876565 20838 raft_consensus.cc:1275] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.877684 21171 consensus_queue.cc:1048] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.885710 20988 raft_consensus.cc:1275] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Refusing update from remote peer 69c4bd8c5bdf413891671e66a98cf43e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.887902 21171 consensus_queue.cc:1048] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.898968 20705 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:35.900635 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:35.912598 20915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
mode: GRACEFUL
new_leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:08:35.913578 20915 raft_consensus.cc:606] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Received request to transfer leadership to TS bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:35.916350 20915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6811d3031856495a846d6e7979982300"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
mode: GRACEFUL
new_leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:08:35.916817 20915 raft_consensus.cc:606] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Received request to transfer leadership to TS 3812d2d1bb1945e0aae7631b9fc30bd6
I20260709 12:08:35.919225 20915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7210c3eb44834760bb54a02233edb824"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
mode: GRACEFUL
new_leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:08:35.919756 20915 raft_consensus.cc:606] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Received request to transfer leadership to TS 3812d2d1bb1945e0aae7631b9fc30bd6
I20260709 12:08:35.922292 20915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
mode: GRACEFUL
new_leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:08:35.922761 20915 raft_consensus.cc:606] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Received request to transfer leadership to TS bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:35.924701 20915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524"
dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
mode: GRACEFUL
new_leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:52954
I20260709 12:08:35.925072 20915 raft_consensus.cc:606] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Received request to transfer leadership to TS bb8a51e3b65f4b8682f8f77e9f7192e1
I20260709 12:08:35.925974 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:35.926367 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:36.122803 21171 raft_consensus.cc:993] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e: : Instructing follower bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:36.123322 21181 raft_consensus.cc:1081] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Signalling peer bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:36.124780 20838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:34124
I20260709 12:08:36.125211 20838 raft_consensus.cc:493] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.125468 20838 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.130797 20838 raft_consensus.cc:515] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.133118 20838 leader_election.cc:290] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 4 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:36.134105 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:36.134568 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761087e244c40d1ac6515f932c6b00a" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:36.134941 20915 raft_consensus.cc:3055] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:36.135182 20988 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.135279 20915 raft_consensus.cc:740] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:36.136198 20915 consensus_queue.cc:260] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.137866 20915 raft_consensus.cc:3060] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.142565 20988 raft_consensus.cc:2468] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 4.
I20260709 12:08:36.143931 20806 leader_election.cc:304] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:36.144940 20915 raft_consensus.cc:2468] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 4.
I20260709 12:08:36.145634 21183 raft_consensus.cc:2804] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:36.146744 21183 raft_consensus.cc:697] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 LEADER]: Becoming Leader. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:36.147748 21183 consensus_queue.cc:237] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.155252 20735 catalog_manager.cc:5697] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 reported cstate change: term changed from 3 to 4, leader changed from 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66) to bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65). New cstate: current_term: 4 leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:36.181902 21171 raft_consensus.cc:993] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e: : Instructing follower bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:36.182343 21181 raft_consensus.cc:1081] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Signalling peer bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:36.183810 20838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:34124
I20260709 12:08:36.184315 20838 raft_consensus.cc:493] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.184607 20838 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.188750 20838 raft_consensus.cc:515] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:36.190240 20838 leader_election.cc:290] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 5 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:36.191090 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:36.191197 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6f53d4df2849869f08f47aa411f524" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:36.191691 20915 raft_consensus.cc:3055] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:36.191751 20988 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.192142 20915 raft_consensus.cc:740] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:36.192893 20915 consensus_queue.cc:260] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:36.194052 20915 raft_consensus.cc:3060] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.197773 21171 raft_consensus.cc:993] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e: : Instructing follower bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:36.198187 21181 raft_consensus.cc:1081] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Signalling peer bb8a51e3b65f4b8682f8f77e9f7192e1 to start an election
I20260709 12:08:36.198263 20988 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 5.
I20260709 12:08:36.199581 20806 leader_election.cc:304] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:36.200311 21183 raft_consensus.cc:2804] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:36.200441 20915 raft_consensus.cc:2468] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 5.
I20260709 12:08:36.201093 21183 raft_consensus.cc:697] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 LEADER]: Becoming Leader. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:36.202263 20838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7"
dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
 from {username='slave'} at 127.0.0.1:34124
I20260709 12:08:36.202191 21183 consensus_queue.cc:237] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } }
I20260709 12:08:36.202841 20838 raft_consensus.cc:493] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.203199 20838 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.208560 20838 raft_consensus.cc:515] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.210371 20838 leader_election.cc:290] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 5 election: Requested vote from peers 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397), 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67:34603)
I20260709 12:08:36.210990 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:36.211334 20988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f37d1b65014770a63986cd7c69bfc7" candidate_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
I20260709 12:08:36.210376 20735 catalog_manager.cc:5697] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 reported cstate change: term changed from 4 to 5, leader changed from 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66) to bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.211790 20915 raft_consensus.cc:3055] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:36.211869 20988 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.212152 20915 raft_consensus.cc:740] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:36.213102 20915 consensus_queue.cc:260] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.214138 20915 raft_consensus.cc:3060] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.218276 20988 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 5.
I20260709 12:08:36.219386 20806 leader_election.cc:304] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:36.220856 21183 raft_consensus.cc:2804] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:36.221346 21183 raft_consensus.cc:697] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 LEADER]: Becoming Leader. State: Replica: bb8a51e3b65f4b8682f8f77e9f7192e1, State: Running, Role: LEADER
I20260709 12:08:36.221987 20915 raft_consensus.cc:2468] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8a51e3b65f4b8682f8f77e9f7192e1 in term 5.
I20260709 12:08:36.222398 21183 consensus_queue.cc:237] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.228726 20735 catalog_manager.cc:5697] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 reported cstate change: term changed from 4 to 5, leader changed from 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66) to bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:36.255573 21181 raft_consensus.cc:993] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e: : Instructing follower 3812d2d1bb1945e0aae7631b9fc30bd6 to start an election
I20260709 12:08:36.256150 21192 raft_consensus.cc:1081] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Signalling peer 3812d2d1bb1945e0aae7631b9fc30bd6 to start an election
I20260709 12:08:36.257570 20988 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7210c3eb44834760bb54a02233edb824"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
 from {username='slave'} at 127.0.0.1:52380
I20260709 12:08:36.258028 20988 raft_consensus.cc:493] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.258311 20988 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.262168 20988 raft_consensus.cc:515] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.264262 20988 leader_election.cc:290] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 4 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:36.265362 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:36.265563 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7210c3eb44834760bb54a02233edb824" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:36.265976 20838 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.266053 20915 raft_consensus.cc:3055] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:36.266364 20915 raft_consensus.cc:740] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:36.267117 20915 consensus_queue.cc:260] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.268249 20915 raft_consensus.cc:3060] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.272342 20838 raft_consensus.cc:2468] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 4.
I20260709 12:08:36.273581 20954 leader_election.cc:304] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:36.274058 20915 raft_consensus.cc:2468] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 4.
I20260709 12:08:36.274375 21180 raft_consensus.cc:2804] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:36.275839 21180 raft_consensus.cc:697] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 LEADER]: Becoming Leader. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:36.276782 21180 consensus_queue.cc:237] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.283242 20735 catalog_manager.cc:5697] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 reported cstate change: term changed from 3 to 4, leader changed from 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66) to 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67). New cstate: current_term: 4 leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.400025 21181 raft_consensus.cc:993] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e: : Instructing follower 3812d2d1bb1945e0aae7631b9fc30bd6 to start an election
I20260709 12:08:36.400447 21181 raft_consensus.cc:1081] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Signalling peer 3812d2d1bb1945e0aae7631b9fc30bd6 to start an election
I20260709 12:08:36.401767 20988 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6811d3031856495a846d6e7979982300"
dest_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6"
 from {username='slave'} at 127.0.0.1:52380
I20260709 12:08:36.402220 20988 raft_consensus.cc:493] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.402500 20988 raft_consensus.cc:3060] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.406363 20988 raft_consensus.cc:515] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.407892 20988 leader_election.cc:290] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 3 election: Requested vote from peers bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801), 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66:35397)
I20260709 12:08:36.408654 20838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6811d3031856495a846d6e7979982300" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1"
I20260709 12:08:36.408836 20915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6811d3031856495a846d6e7979982300" candidate_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69c4bd8c5bdf413891671e66a98cf43e"
I20260709 12:08:36.409197 20838 raft_consensus.cc:3060] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.409303 20915 raft_consensus.cc:3055] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:36.409614 20915 raft_consensus.cc:740] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 69c4bd8c5bdf413891671e66a98cf43e, State: Running, Role: LEADER
I20260709 12:08:36.410306 20915 consensus_queue.cc:260] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.411422 20915 raft_consensus.cc:3060] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.415373 20838 raft_consensus.cc:2468] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 3.
I20260709 12:08:36.416447 20954 leader_election.cc:304] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3812d2d1bb1945e0aae7631b9fc30bd6, bb8a51e3b65f4b8682f8f77e9f7192e1; no voters: 
I20260709 12:08:36.417147 21180 raft_consensus.cc:2804] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:36.417161 20915 raft_consensus.cc:2468] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3812d2d1bb1945e0aae7631b9fc30bd6 in term 3.
I20260709 12:08:36.417701 21180 raft_consensus.cc:697] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Becoming Leader. State: Replica: 3812d2d1bb1945e0aae7631b9fc30bd6, State: Running, Role: LEADER
I20260709 12:08:36.418569 21180 consensus_queue.cc:237] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } }
I20260709 12:08:36.425189 20735 catalog_manager.cc:5697] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 reported cstate change: term changed from 2 to 3, leader changed from 69c4bd8c5bdf413891671e66a98cf43e (127.20.56.66) to 3812d2d1bb1945e0aae7631b9fc30bd6 (127.20.56.67). New cstate: current_term: 3 leader_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.616129 20915 raft_consensus.cc:1275] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 5 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.617368 21183 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:36.628715 20988 raft_consensus.cc:1275] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 5 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.630354 21198 consensus_queue.cc:1048] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:36.693377 20915 raft_consensus.cc:1275] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.694792 21198 consensus_queue.cc:1048] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.703198 20988 raft_consensus.cc:1275] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.705078 21184 consensus_queue.cc:1048] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:36.780231 20988 raft_consensus.cc:1275] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 5 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.781358 21184 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3812d2d1bb1945e0aae7631b9fc30bd6" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:36.790561 20838 raft_consensus.cc:1275] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Refusing update from remote peer 3812d2d1bb1945e0aae7631b9fc30bd6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.790910 20915 raft_consensus.cc:1275] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 5 FOLLOWER]: Refusing update from remote peer bb8a51e3b65f4b8682f8f77e9f7192e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.792107 21180 consensus_queue.cc:1048] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.792795 21198 consensus_queue.cc:1048] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:36.807235 20915 raft_consensus.cc:1275] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Refusing update from remote peer 3812d2d1bb1945e0aae7631b9fc30bd6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.808784 21180 consensus_queue.cc:1048] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.884523 20839 raft_consensus.cc:1275] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Refusing update from remote peer 3812d2d1bb1945e0aae7631b9fc30bd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.885710 21180 consensus_queue.cc:1048] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8a51e3b65f4b8682f8f77e9f7192e1" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.895620 20915 raft_consensus.cc:1275] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Refusing update from remote peer 3812d2d1bb1945e0aae7631b9fc30bd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.897655 21207 consensus_queue.cc:1048] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c4bd8c5bdf413891671e66a98cf43e" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.927452 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.932580 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:36.932998 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.934027 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.938728 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.939172 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.940158 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.945248 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.945672 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.946743 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.952371 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.952798 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.953915 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.959161 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.959590 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.960543 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.966518 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.967033 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.008232 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.014304 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.014802 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:43.172911 20861 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7060 after lost signal to thread 20708
W20260709 12:08:43.173657 20861 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7740 after lost signal to thread 20771
W20260709 12:08:43.174510 20861 debug-util.cc:398] Leaking SignalData structure 0x7b08000b26c0 after lost signal to thread 20864
W20260709 12:08:43.175235 20861 debug-util.cc:398] Leaking SignalData structure 0x7b08001bb040 after lost signal to thread 20939
W20260709 12:08:43.175900 20861 debug-util.cc:398] Leaking SignalData structure 0x7b080014aa00 after lost signal to thread 21013
I20260709 12:08:44.015934 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.021332 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.021747 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.022887 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:45.027683 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:45.028081 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:46.058902 20705 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:46.059638 20705 tablet_server.cc:179] TabletServer@127.20.56.65:0 shutting down...
I20260709 12:08:46.088842 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.090302 20705 tablet_replica.cc:333] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1: stopping tablet replica
I20260709 12:08:46.091585 20705 raft_consensus.cc:2243] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.092343 20705 raft_consensus.cc:2272] T c8d19d83df2e46b082b530e3acb74934 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:46.092360 20954 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:08:46.095525 20705 tablet_replica.cc:333] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1: stopping tablet replica
W20260709 12:08:46.095973 20954 consensus_peers.cc:597] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 -> Peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Couldn't send request to peer bb8a51e3b65f4b8682f8f77e9f7192e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.096277 20705 raft_consensus.cc:2243] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.096837 20705 raft_consensus.cc:2272] T 923e9519c19c4c3593313ac77e4f0dcb P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.098857 20705 tablet_replica.cc:333] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1: stopping tablet replica
I20260709 12:08:46.099684 20705 raft_consensus.cc:2243] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.100215 20705 raft_consensus.cc:2272] T e59493c182d040f889e1d81984651521 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.102249 20705 tablet_replica.cc:333] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1: stopping tablet replica
I20260709 12:08:46.102893 20705 raft_consensus.cc:2243] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.103559 20705 raft_consensus.cc:2272] T 7210c3eb44834760bb54a02233edb824 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.105948 20705 tablet_replica.cc:333] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1: stopping tablet replica
I20260709 12:08:46.106896 20705 raft_consensus.cc:2243] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.108796 20705 raft_consensus.cc:2272] T cd6f53d4df2849869f08f47aa411f524 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.111842 20705 tablet_replica.cc:333] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1: stopping tablet replica
I20260709 12:08:46.113059 20705 raft_consensus.cc:2243] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.114774 20705 raft_consensus.cc:2272] T 1761087e244c40d1ac6515f932c6b00a P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.117377 20705 tablet_replica.cc:333] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1: stopping tablet replica
W20260709 12:08:46.117815 20880 consensus_peers.cc:597] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e -> Peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Couldn't send request to peer bb8a51e3b65f4b8682f8f77e9f7192e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.118182 20705 raft_consensus.cc:2243] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.118687 20705 raft_consensus.cc:2272] T 41ae02245cd841efb3d5878269487438 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.120397 20705 tablet_replica.cc:333] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1: stopping tablet replica
I20260709 12:08:46.120931 20705 raft_consensus.cc:2243] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.121374 20705 raft_consensus.cc:2272] T 6811d3031856495a846d6e7979982300 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.123241 20705 tablet_replica.cc:333] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1: stopping tablet replica
I20260709 12:08:46.123765 20705 raft_consensus.cc:2243] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.124684 20705 raft_consensus.cc:2272] T c8f37d1b65014770a63986cd7c69bfc7 P bb8a51e3b65f4b8682f8f77e9f7192e1 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:46.216988 20954 consensus_peers.cc:597] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 -> Peer bb8a51e3b65f4b8682f8f77e9f7192e1 (127.20.56.65:41801): Couldn't send request to peer bb8a51e3b65f4b8682f8f77e9f7192e1. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.234211 20705 tablet_server.cc:196] TabletServer@127.20.56.65:0 shutdown complete.
I20260709 12:08:46.252990 20705 tablet_server.cc:179] TabletServer@127.20.56.66:0 shutting down...
I20260709 12:08:46.280670 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.281451 20705 tablet_replica.cc:333] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e: stopping tablet replica
I20260709 12:08:46.282110 20705 raft_consensus.cc:2243] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.282653 20705 raft_consensus.cc:2272] T 6811d3031856495a846d6e7979982300 P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.284399 20705 tablet_replica.cc:333] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e: stopping tablet replica
I20260709 12:08:46.284912 20705 raft_consensus.cc:2243] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.285708 20705 raft_consensus.cc:2272] T 923e9519c19c4c3593313ac77e4f0dcb P 69c4bd8c5bdf413891671e66a98cf43e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.287539 20705 tablet_replica.cc:333] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e: stopping tablet replica
I20260709 12:08:46.288069 20705 raft_consensus.cc:2243] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.288538 20705 raft_consensus.cc:2272] T c8f37d1b65014770a63986cd7c69bfc7 P 69c4bd8c5bdf413891671e66a98cf43e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.290192 20705 tablet_replica.cc:333] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e: stopping tablet replica
I20260709 12:08:46.290709 20705 raft_consensus.cc:2243] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.291474 20705 raft_consensus.cc:2272] T c8d19d83df2e46b082b530e3acb74934 P 69c4bd8c5bdf413891671e66a98cf43e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.293069 20705 tablet_replica.cc:333] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e: stopping tablet replica
I20260709 12:08:46.293570 20705 raft_consensus.cc:2243] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.294019 20705 raft_consensus.cc:2272] T cd6f53d4df2849869f08f47aa411f524 P 69c4bd8c5bdf413891671e66a98cf43e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.295948 20705 tablet_replica.cc:333] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e: stopping tablet replica
I20260709 12:08:46.296428 20705 raft_consensus.cc:2243] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.296821 20705 raft_consensus.cc:2272] T 1761087e244c40d1ac6515f932c6b00a P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.298359 20705 tablet_replica.cc:333] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e: stopping tablet replica
I20260709 12:08:46.298854 20705 raft_consensus.cc:2243] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.299252 20705 raft_consensus.cc:2272] T 41ae02245cd841efb3d5878269487438 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.301229 20705 tablet_replica.cc:333] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e: stopping tablet replica
I20260709 12:08:46.301853 20705 raft_consensus.cc:2243] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.302306 20705 raft_consensus.cc:2272] T 7210c3eb44834760bb54a02233edb824 P 69c4bd8c5bdf413891671e66a98cf43e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.304140 20705 tablet_replica.cc:333] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e: stopping tablet replica
I20260709 12:08:46.304572 20705 raft_consensus.cc:2243] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.305256 20705 raft_consensus.cc:2272] T e59493c182d040f889e1d81984651521 P 69c4bd8c5bdf413891671e66a98cf43e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.334579 20705 tablet_server.cc:196] TabletServer@127.20.56.66:0 shutdown complete.
I20260709 12:08:46.353091 20705 tablet_server.cc:179] TabletServer@127.20.56.67:0 shutting down...
I20260709 12:08:46.382648 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.383412 20705 tablet_replica.cc:333] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6: stopping tablet replica
I20260709 12:08:46.384011 20705 raft_consensus.cc:2243] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.384534 20705 raft_consensus.cc:2272] T 923e9519c19c4c3593313ac77e4f0dcb P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.386698 20705 tablet_replica.cc:333] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6: stopping tablet replica
I20260709 12:08:46.387233 20705 raft_consensus.cc:2243] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.387981 20705 raft_consensus.cc:2272] T 6811d3031856495a846d6e7979982300 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.389858 20705 tablet_replica.cc:333] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6: stopping tablet replica
I20260709 12:08:46.390357 20705 raft_consensus.cc:2243] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.390882 20705 raft_consensus.cc:2272] T c8f37d1b65014770a63986cd7c69bfc7 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.392527 20705 tablet_replica.cc:333] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6: stopping tablet replica
I20260709 12:08:46.393004 20705 raft_consensus.cc:2243] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.393460 20705 raft_consensus.cc:2272] T 1761087e244c40d1ac6515f932c6b00a P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.395125 20705 tablet_replica.cc:333] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6: stopping tablet replica
I20260709 12:08:46.395736 20705 raft_consensus.cc:2243] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.396462 20705 raft_consensus.cc:2272] T 41ae02245cd841efb3d5878269487438 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.398070 20705 tablet_replica.cc:333] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6: stopping tablet replica
I20260709 12:08:46.398612 20705 raft_consensus.cc:2243] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.399103 20705 raft_consensus.cc:2272] T cd6f53d4df2849869f08f47aa411f524 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.400594 20705 tablet_replica.cc:333] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6: stopping tablet replica
I20260709 12:08:46.401080 20705 raft_consensus.cc:2243] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.401841 20705 raft_consensus.cc:2272] T 7210c3eb44834760bb54a02233edb824 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.403343 20705 tablet_replica.cc:333] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6: stopping tablet replica
I20260709 12:08:46.403781 20705 raft_consensus.cc:2243] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.404136 20705 raft_consensus.cc:2272] T e59493c182d040f889e1d81984651521 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.405668 20705 tablet_replica.cc:333] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6: stopping tablet replica
I20260709 12:08:46.406144 20705 raft_consensus.cc:2243] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.406644 20705 raft_consensus.cc:2272] T c8d19d83df2e46b082b530e3acb74934 P 3812d2d1bb1945e0aae7631b9fc30bd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.434177 20705 tablet_server.cc:196] TabletServer@127.20.56.67:0 shutdown complete.
I20260709 12:08:46.451615 20705 master.cc:562] Master@127.20.56.126:39371 shutting down...
I20260709 12:08:46.652604 20705 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.653193 20705 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.653475 20705 tablet_replica.cc:333] T 00000000000000000000000000000000 P a2c0633482e64673b3e3aaf74c6aff36: stopping tablet replica
I20260709 12:08:46.672860 20705 master.cc:584] Master@127.20.56.126:39371 shutdown complete.
3812d2d1bb1945e0aae7631b9fc30bd6  1
69c4bd8c5bdf413891671e66a98cf43e  4
bb8a51e3b65f4b8682f8f77e9f7192e1  4
3812d2d1bb1945e0aae7631b9fc30bd6  3
69c4bd8c5bdf413891671e66a98cf43e  3
bb8a51e3b65f4b8682f8f77e9f7192e1  3
3812d2d1bb1945e0aae7631b9fc30bd6  1
69c4bd8c5bdf413891671e66a98cf43e  8
bb8a51e3b65f4b8682f8f77e9f7192e1  0
3812d2d1bb1945e0aae7631b9fc30bd6  3
69c4bd8c5bdf413891671e66a98cf43e  3
bb8a51e3b65f4b8682f8f77e9f7192e1  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30913 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:46.711823 20705 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.56.126:39009
I20260709 12:08:46.712859 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.718284 21225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.718660 21226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.721194 21228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.722008 20705 server_base.cc:1061] running on GCE node
I20260709 12:08:46.722874 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.723058 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.723172 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598926723161 us; error 0 us; skew 500 ppm
I20260709 12:08:46.723613 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.726084 20705 webserver.cc:533] Webserver started at http://127.20.56.126:36085/ using document root <none> and password file <none>
I20260709 12:08:46.726864 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.727046 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.727267 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.728330 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/master-0-root/instance:
uuid: "e84af1c504354613a0c84758417fb1f6"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-2dwh"
I20260709 12:08:46.732642 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:46.735797 21233 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.736541 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:08:46.736816 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/master-0-root
uuid: "e84af1c504354613a0c84758417fb1f6"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-2dwh"
I20260709 12:08:46.737124 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.753180 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.754390 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.792683 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.126:39009
I20260709 12:08:46.792801 21284 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.126:39009 every 8 connection(s)
I20260709 12:08:46.796630 21285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.807265 21285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6: Bootstrap starting.
I20260709 12:08:46.812412 21285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.816773 21285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6: No bootstrap required, opened a new log
I20260709 12:08:46.819223 21285 raft_consensus.cc:359] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84af1c504354613a0c84758417fb1f6" member_type: VOTER }
I20260709 12:08:46.819728 21285 raft_consensus.cc:385] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.819998 21285 raft_consensus.cc:740] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e84af1c504354613a0c84758417fb1f6, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.820586 21285 consensus_queue.cc:260] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84af1c504354613a0c84758417fb1f6" member_type: VOTER }
I20260709 12:08:46.821111 21285 raft_consensus.cc:399] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:46.821382 21285 raft_consensus.cc:493] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:46.821682 21285 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.826064 21285 raft_consensus.cc:515] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84af1c504354613a0c84758417fb1f6" member_type: VOTER }
I20260709 12:08:46.826694 21285 leader_election.cc:304] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e84af1c504354613a0c84758417fb1f6; no voters: 
I20260709 12:08:46.827860 21285 leader_election.cc:290] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:46.828251 21288 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.829586 21288 raft_consensus.cc:697] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 1 LEADER]: Becoming Leader. State: Replica: e84af1c504354613a0c84758417fb1f6, State: Running, Role: LEADER
I20260709 12:08:46.830276 21288 consensus_queue.cc:237] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84af1c504354613a0c84758417fb1f6" member_type: VOTER }
I20260709 12:08:46.831156 21285 sys_catalog.cc:565] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:46.836140 21290 sys_catalog.cc:455] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e84af1c504354613a0c84758417fb1f6. Latest consensus state: current_term: 1 leader_uuid: "e84af1c504354613a0c84758417fb1f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84af1c504354613a0c84758417fb1f6" member_type: VOTER } }
I20260709 12:08:46.836846 21290 sys_catalog.cc:458] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.836891 21289 sys_catalog.cc:455] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e84af1c504354613a0c84758417fb1f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e84af1c504354613a0c84758417fb1f6" member_type: VOTER } }
I20260709 12:08:46.837580 21289 sys_catalog.cc:458] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.841084 21296 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:46.849014 21296 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:46.849980 20705 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:46.858274 21296 catalog_manager.cc:1383] Generated new cluster ID: fdec2598f0ad42b4b86a22b45cdc5ef7
I20260709 12:08:46.858587 21296 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:46.896623 21296 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:46.897792 21296 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:46.910892 21296 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6: Generated new TSK 0
I20260709 12:08:46.911468 21296 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:46.916167 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.921782 21306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.922947 21307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.924443 21309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.924778 20705 server_base.cc:1061] running on GCE node
I20260709 12:08:46.925689 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.925877 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.926009 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598926925996 us; error 0 us; skew 500 ppm
I20260709 12:08:46.926527 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.928694 20705 webserver.cc:533] Webserver started at http://127.20.56.65:34653/ using document root <none> and password file <none>
I20260709 12:08:46.929138 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.929289 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.929495 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.930559 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-0-root/instance:
uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-2dwh"
I20260709 12:08:46.935027 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:08:46.938189 21314 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.939144 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:08:46.939453 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-2dwh"
I20260709 12:08:46.939739 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.957566 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.958887 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.960317 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.962507 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.962740 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.962982 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.963173 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.002063 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:36889
I20260709 12:08:47.002143 21376 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:36889 every 8 connection(s)
I20260709 12:08:47.007001 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:47.015566 21381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.017395 21382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.021201 20705 server_base.cc:1061] running on GCE node
I20260709 12:08:47.021698 21377 heartbeater.cc:344] Connected to a master server at 127.20.56.126:39009
I20260709 12:08:47.022145 21377 heartbeater.cc:461] Registering TS with master...
W20260709 12:08:47.022083 21384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.023059 21377 heartbeater.cc:507] Master 127.20.56.126:39009 requested a full tablet report, sending...
I20260709 12:08:47.023213 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:47.023511 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:47.023700 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598927023667 us; error 0 us; skew 500 ppm
I20260709 12:08:47.024256 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:47.025584 21250 ts_manager.cc:194] Registered new tserver with Master: 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889)
I20260709 12:08:47.026831 20705 webserver.cc:533] Webserver started at http://127.20.56.66:45945/ using document root <none> and password file <none>
I20260709 12:08:47.027359 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:47.027571 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:47.027688 21250 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47264
I20260709 12:08:47.027844 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:47.029047 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-1-root/instance:
uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-2dwh"
I20260709 12:08:47.033478 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:08:47.036758 21389 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.037544 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:47.037851 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-1-root
uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-2dwh"
I20260709 12:08:47.038162 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:47.069916 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:47.071187 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:47.072669 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:47.074915 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:47.075137 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.075384 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:47.075567 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.114235 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.66:33747
I20260709 12:08:47.114326 21451 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.66:33747 every 8 connection(s)
I20260709 12:08:47.118974 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:47.126868 21455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.128870 21456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.135656 21458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.135885 21452 heartbeater.cc:344] Connected to a master server at 127.20.56.126:39009
I20260709 12:08:47.136296 21452 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:47.137228 21452 heartbeater.cc:507] Master 127.20.56.126:39009 requested a full tablet report, sending...
I20260709 12:08:47.137419 20705 server_base.cc:1061] running on GCE node
I20260709 12:08:47.138459 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:47.138728 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:47.138947 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598927138925 us; error 0 us; skew 500 ppm
I20260709 12:08:47.139539 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:47.139545 21250 ts_manager.cc:194] Registered new tserver with Master: d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:47.141368 21250 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47270
I20260709 12:08:47.142710 20705 webserver.cc:533] Webserver started at http://127.20.56.67:38517/ using document root <none> and password file <none>
I20260709 12:08:47.143296 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:47.143523 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:47.143795 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:47.144902 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-2-root/instance:
uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-2dwh"
I20260709 12:08:47.149400 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:08:47.152531 21463 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.153275 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:47.153574 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-2-root
uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-2dwh"
I20260709 12:08:47.153862 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895630772-20705-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:47.170593 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:47.171844 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:47.173285 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:47.175585 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:47.175827 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.176076 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:47.176254 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.214986 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.67:36581
I20260709 12:08:47.215087 21525 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.67:36581 every 8 connection(s)
I20260709 12:08:47.228770 21526 heartbeater.cc:344] Connected to a master server at 127.20.56.126:39009
I20260709 12:08:47.229216 21526 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:47.229887 21526 heartbeater.cc:507] Master 127.20.56.126:39009 requested a full tablet report, sending...
I20260709 12:08:47.231890 21250 ts_manager.cc:194] Registered new tserver with Master: adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:47.232512 20705 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014380195s
I20260709 12:08:47.233739 21250 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47276
I20260709 12:08:47.261328 21250 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47286:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:47.264210 21250 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:47.345693 21342 tablet_service.cc:1511] Processing CreateTablet for tablet db89b53ed47f4b719db329748af61e52 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.347184 21342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db89b53ed47f4b719db329748af61e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.346903 21341 tablet_service.cc:1511] Processing CreateTablet for tablet 92d95f6da33f48df9f057c3b215f257a (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.348296 21341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d95f6da33f48df9f057c3b215f257a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.352234 21340 tablet_service.cc:1511] Processing CreateTablet for tablet 0c16cc257c4f409ba23eb6a721883a44 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.353552 21340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c16cc257c4f409ba23eb6a721883a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.355968 21491 tablet_service.cc:1511] Processing CreateTablet for tablet db89b53ed47f4b719db329748af61e52 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.357267 21491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db89b53ed47f4b719db329748af61e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.357417 21490 tablet_service.cc:1511] Processing CreateTablet for tablet 92d95f6da33f48df9f057c3b215f257a (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.359604 21489 tablet_service.cc:1511] Processing CreateTablet for tablet 0c16cc257c4f409ba23eb6a721883a44 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.361016 21489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c16cc257c4f409ba23eb6a721883a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.363651 21488 tablet_service.cc:1511] Processing CreateTablet for tablet 3800d6ece16a4a1490158b2af945e005 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.364928 21490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d95f6da33f48df9f057c3b215f257a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.366986 21487 tablet_service.cc:1511] Processing CreateTablet for tablet d04c5d242e394f72a5fa319483abca71 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.368945 21487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d04c5d242e394f72a5fa319483abca71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.371848 21541 tablet_bootstrap.cc:492] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:47.375676 21485 tablet_service.cc:1511] Processing CreateTablet for tablet 9dcb271eb5d04977939d8ea32fdec38a (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.378029 21484 tablet_service.cc:1511] Processing CreateTablet for tablet 0abb8289107a4ba78aa8b0edbbd5f8e7 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.378576 21541 tablet_bootstrap.cc:654] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.380805 21483 tablet_service.cc:1511] Processing CreateTablet for tablet 74d61baf64c54bdfb2bb491ae1219c37 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.374230 21486 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0aa5b1513a4e89b77956cc2e156571 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.384486 21488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3800d6ece16a4a1490158b2af945e005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.387455 21340 tablet_service.cc:1511] Processing CreateTablet for tablet 3800d6ece16a4a1490158b2af945e005 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.388371 21341 tablet_service.cc:1511] Processing CreateTablet for tablet d04c5d242e394f72a5fa319483abca71 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.388794 21340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3800d6ece16a4a1490158b2af945e005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.389657 21341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d04c5d242e394f72a5fa319483abca71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.389333 21339 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0aa5b1513a4e89b77956cc2e156571 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.390640 21339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0aa5b1513a4e89b77956cc2e156571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.391680 21482 tablet_service.cc:1511] Processing CreateTablet for tablet 2e595aad7ec34c2f8b168ab00c98732f (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.398821 21485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dcb271eb5d04977939d8ea32fdec38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.400616 21482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e595aad7ec34c2f8b168ab00c98732f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.400813 21338 tablet_service.cc:1511] Processing CreateTablet for tablet 9dcb271eb5d04977939d8ea32fdec38a (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.402258 21338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dcb271eb5d04977939d8ea32fdec38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.402289 21484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abb8289107a4ba78aa8b0edbbd5f8e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.406800 21483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d61baf64c54bdfb2bb491ae1219c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.410881 21486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0aa5b1513a4e89b77956cc2e156571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.412968 21340 tablet_service.cc:1511] Processing CreateTablet for tablet 0abb8289107a4ba78aa8b0edbbd5f8e7 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.415656 21341 tablet_service.cc:1511] Processing CreateTablet for tablet 74d61baf64c54bdfb2bb491ae1219c37 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.419737 21338 tablet_service.cc:1511] Processing CreateTablet for tablet 2e595aad7ec34c2f8b168ab00c98732f (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.423610 21340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abb8289107a4ba78aa8b0edbbd5f8e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.424295 21341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d61baf64c54bdfb2bb491ae1219c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.425024 21338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e595aad7ec34c2f8b168ab00c98732f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.426270 21417 tablet_service.cc:1511] Processing CreateTablet for tablet db89b53ed47f4b719db329748af61e52 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.427544 21417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db89b53ed47f4b719db329748af61e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.441423 21416 tablet_service.cc:1511] Processing CreateTablet for tablet 92d95f6da33f48df9f057c3b215f257a (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.443768 21415 tablet_service.cc:1511] Processing CreateTablet for tablet 0c16cc257c4f409ba23eb6a721883a44 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.445181 21409 tablet_service.cc:1511] Processing CreateTablet for tablet 74d61baf64c54bdfb2bb491ae1219c37 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.445708 21414 tablet_service.cc:1511] Processing CreateTablet for tablet 3800d6ece16a4a1490158b2af945e005 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.447774 21408 tablet_service.cc:1511] Processing CreateTablet for tablet 2e595aad7ec34c2f8b168ab00c98732f (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.449450 21412 tablet_service.cc:1511] Processing CreateTablet for tablet 9e0aa5b1513a4e89b77956cc2e156571 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.451314 21411 tablet_service.cc:1511] Processing CreateTablet for tablet 9dcb271eb5d04977939d8ea32fdec38a (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.453136 21410 tablet_service.cc:1511] Processing CreateTablet for tablet 0abb8289107a4ba78aa8b0edbbd5f8e7 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.447691 21413 tablet_service.cc:1511] Processing CreateTablet for tablet d04c5d242e394f72a5fa319483abca71 (DEFAULT_TABLE table=test-workload [id=bd421c3792f84ae9b7f55bcb88cc8875]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.462136 21416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d95f6da33f48df9f057c3b215f257a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.467669 21543 tablet_bootstrap.cc:492] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:47.470890 21408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e595aad7ec34c2f8b168ab00c98732f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.474866 21409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d61baf64c54bdfb2bb491ae1219c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.478818 21414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3800d6ece16a4a1490158b2af945e005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.482885 21415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c16cc257c4f409ba23eb6a721883a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.486892 21413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d04c5d242e394f72a5fa319483abca71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.490886 21410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abb8289107a4ba78aa8b0edbbd5f8e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.494735 21411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dcb271eb5d04977939d8ea32fdec38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.498863 21412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e0aa5b1513a4e89b77956cc2e156571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.509281 21543 tablet_bootstrap.cc:654] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.532747 21541 tablet_bootstrap.cc:492] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:47.533455 21541 ts_tablet_manager.cc:1403] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.022s
I20260709 12:08:47.575930 21544 tablet_bootstrap.cc:492] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:47.581151 21543 tablet_bootstrap.cc:492] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:47.581717 21543 ts_tablet_manager.cc:1403] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.066s
I20260709 12:08:47.584993 21543 raft_consensus.cc:359] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.585784 21543 raft_consensus.cc:385] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.553574 21541 raft_consensus.cc:359] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.586113 21543 raft_consensus.cc:740] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.586356 21541 raft_consensus.cc:385] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.586835 21541 raft_consensus.cc:740] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.587628 21541 consensus_queue.cc:260] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.592044 21544 tablet_bootstrap.cc:654] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.591907 21543 consensus_queue.cc:260] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.603458 21377 heartbeater.cc:499] Master 127.20.56.126:39009 was elected leader, sending a full tablet report...
I20260709 12:08:47.609247 21541 ts_tablet_manager.cc:1434] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.007s
I20260709 12:08:47.610543 21541 tablet_bootstrap.cc:492] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:47.619853 21541 tablet_bootstrap.cc:654] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.633368 21541 tablet_bootstrap.cc:492] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:47.634163 21541 ts_tablet_manager.cc:1403] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.001s
I20260709 12:08:47.636050 21526 heartbeater.cc:499] Master 127.20.56.126:39009 was elected leader, sending a full tablet report...
I20260709 12:08:47.636678 21543 ts_tablet_manager.cc:1434] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.055s	user 0.023s	sys 0.027s
I20260709 12:08:47.637740 21543 tablet_bootstrap.cc:492] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:47.638213 21541 raft_consensus.cc:359] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.638700 21544 tablet_bootstrap.cc:492] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:47.638995 21541 raft_consensus.cc:385] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.639394 21541 raft_consensus.cc:740] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.639498 21544 ts_tablet_manager.cc:1403] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.025s
I20260709 12:08:47.640580 21541 consensus_queue.cc:260] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.643172 21541 ts_tablet_manager.cc:1434] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:08:47.644124 21541 tablet_bootstrap.cc:492] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:47.644923 21543 tablet_bootstrap.cc:654] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.644608 21544 raft_consensus.cc:359] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.645432 21544 raft_consensus.cc:385] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.645802 21544 raft_consensus.cc:740] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.646934 21544 consensus_queue.cc:260] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.651046 21541 tablet_bootstrap.cc:654] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.691561 21452 heartbeater.cc:499] Master 127.20.56.126:39009 was elected leader, sending a full tablet report...
I20260709 12:08:47.692174 21544 ts_tablet_manager.cc:1434] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.052s	user 0.019s	sys 0.029s
I20260709 12:08:47.693228 21544 tablet_bootstrap.cc:492] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:47.693598 21543 tablet_bootstrap.cc:492] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:47.694103 21543 ts_tablet_manager.cc:1403] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.057s	user 0.029s	sys 0.026s
I20260709 12:08:47.694882 21541 tablet_bootstrap.cc:492] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:47.695401 21541 ts_tablet_manager.cc:1403] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.051s	user 0.030s	sys 0.021s
I20260709 12:08:47.697021 21543 raft_consensus.cc:359] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.697746 21543 raft_consensus.cc:385] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.698058 21543 raft_consensus.cc:740] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.698484 21541 raft_consensus.cc:359] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.698830 21543 consensus_queue.cc:260] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.699445 21541 raft_consensus.cc:385] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.699851 21541 raft_consensus.cc:740] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.700984 21543 ts_tablet_manager.cc:1434] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:47.700628 21541 consensus_queue.cc:260] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.701987 21543 tablet_bootstrap.cc:492] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:47.704666 21544 tablet_bootstrap.cc:654] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.705236 21541 ts_tablet_manager.cc:1434] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:08:47.706364 21541 tablet_bootstrap.cc:492] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:47.708847 21543 tablet_bootstrap.cc:654] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.713269 21541 tablet_bootstrap.cc:654] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.727998 21546 raft_consensus.cc:493] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.728750 21546 raft_consensus.cc:515] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.734373 21546 leader_election.cc:290] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:47.761243 21543 tablet_bootstrap.cc:492] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:47.761812 21543 ts_tablet_manager.cc:1403] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.060s	user 0.028s	sys 0.028s
I20260709 12:08:47.762487 21541 tablet_bootstrap.cc:492] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:47.762660 21544 tablet_bootstrap.cc:492] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:47.762981 21541 ts_tablet_manager.cc:1403] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.027s
I20260709 12:08:47.763177 21544 ts_tablet_manager.cc:1403] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.070s	user 0.021s	sys 0.016s
I20260709 12:08:47.765039 21543 raft_consensus.cc:359] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.765884 21543 raft_consensus.cc:385] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.765673 21541 raft_consensus.cc:359] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.766276 21543 raft_consensus.cc:740] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.766491 21541 raft_consensus.cc:385] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.766172 21544 raft_consensus.cc:359] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.766853 21541 raft_consensus.cc:740] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.767022 21544 raft_consensus.cc:385] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.767256 21543 consensus_queue.cc:260] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.767658 21541 consensus_queue.cc:260] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.769708 21543 ts_tablet_manager.cc:1434] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:47.769884 21541 ts_tablet_manager.cc:1434] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:47.770861 21543 tablet_bootstrap.cc:492] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:47.771056 21541 tablet_bootstrap.cc:492] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:47.777697 21541 tablet_bootstrap.cc:654] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.778280 21543 tablet_bootstrap.cc:654] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.781109 21544 raft_consensus.cc:740] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.793749 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
W20260709 12:08:47.796304 21316 leader_election.cc:343] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.796252 21544 consensus_queue.cc:260] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.800652 21541 tablet_bootstrap.cc:492] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:47.801057 21544 ts_tablet_manager.cc:1434] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 12:08:47.801261 21541 ts_tablet_manager.cc:1403] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.014s
I20260709 12:08:47.800652 21543 tablet_bootstrap.cc:492] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:47.802239 21544 tablet_bootstrap.cc:492] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:47.802313 21543 ts_tablet_manager.cc:1403] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.014s
I20260709 12:08:47.802852 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
W20260709 12:08:47.804703 21315 leader_election.cc:343] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.804605 21541 raft_consensus.cc:359] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.805334 21315 leader_election.cc:304] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805; no voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:47.805616 21541 raft_consensus.cc:385] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.805434 21543 raft_consensus.cc:359] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.806200 21543 raft_consensus.cc:385] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.806092 21541 raft_consensus.cc:740] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.806592 21543 raft_consensus.cc:740] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.806675 21546 raft_consensus.cc:2749] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.807271 21541 consensus_queue.cc:260] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.807363 21543 consensus_queue.cc:260] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.809664 21541 ts_tablet_manager.cc:1434] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:08:47.809785 21543 ts_tablet_manager.cc:1434] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:47.810815 21543 tablet_bootstrap.cc:492] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:47.810892 21544 tablet_bootstrap.cc:654] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.811379 21541 tablet_bootstrap.cc:492] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:47.817677 21541 tablet_bootstrap.cc:654] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.817677 21543 tablet_bootstrap.cc:654] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.829677 21544 tablet_bootstrap.cc:492] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:47.829677 21541 tablet_bootstrap.cc:492] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:47.830376 21543 tablet_bootstrap.cc:492] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:47.830387 21544 ts_tablet_manager.cc:1403] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 12:08:47.830770 21541 ts_tablet_manager.cc:1403] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 12:08:47.831251 21543 ts_tablet_manager.cc:1403] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:08:47.831511 21551 raft_consensus.cc:493] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.838258 21551 raft_consensus.cc:515] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.839244 21543 raft_consensus.cc:359] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.840091 21543 raft_consensus.cc:385] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.840453 21543 raft_consensus.cc:740] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.839884 21544 raft_consensus.cc:359] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.839418 21541 raft_consensus.cc:359] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.841696 21541 raft_consensus.cc:385] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.842058 21541 raft_consensus.cc:740] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.842463 21544 raft_consensus.cc:385] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.842789 21544 raft_consensus.cc:740] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
W20260709 12:08:47.843565 21298 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:47.843489 21544 consensus_queue.cc:260] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.841384 21543 consensus_queue.cc:260] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.844978 21541 consensus_queue.cc:260] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.846633 21543 ts_tablet_manager.cc:1434] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:08:47.847599 21541 ts_tablet_manager.cc:1434] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:08:47.849011 21541 tablet_bootstrap.cc:492] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:47.849975 21551 leader_election.cc:290] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:47.847674 21543 tablet_bootstrap.cc:492] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:47.861632 21543 tablet_bootstrap.cc:654] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.862684 21547 raft_consensus.cc:493] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.862982 21541 tablet_bootstrap.cc:654] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.863215 21547 raft_consensus.cc:515] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.866183 21547 leader_election.cc:290] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:47.872397 21544 ts_tablet_manager.cc:1434] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.008s
I20260709 12:08:47.873556 21544 tablet_bootstrap.cc:492] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:47.881718 21544 tablet_bootstrap.cc:654] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.887583 21543 tablet_bootstrap.cc:492] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:47.888322 21543 ts_tablet_manager.cc:1403] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.009s
I20260709 12:08:47.892571 21543 raft_consensus.cc:359] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.893694 21543 raft_consensus.cc:385] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.894134 21543 raft_consensus.cc:740] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.895324 21543 consensus_queue.cc:260] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.898248 21543 ts_tablet_manager.cc:1434] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:08:47.899317 21543 tablet_bootstrap.cc:492] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:47.906363 21543 tablet_bootstrap.cc:654] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.920360 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:47.921157 21352 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 0.
I20260709 12:08:47.922551 21391 leader_election.cc:304] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:47.923815 21564 raft_consensus.cc:2804] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.924398 21564 raft_consensus.cc:493] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.924875 21564 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.932752 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
I20260709 12:08:47.933746 21501 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 0.
I20260709 12:08:47.936275 21564 raft_consensus.cc:515] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.941247 21551 raft_consensus.cc:493] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.941927 21551 raft_consensus.cc:515] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.946171 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
W20260709 12:08:47.948578 21391 leader_election.cc:343] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.950096 21551 leader_election.cc:290] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:47.953450 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
I20260709 12:08:47.953653 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:47.954141 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:47.954988 21543 tablet_bootstrap.cc:492] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:47.955518 21543 ts_tablet_manager.cc:1403] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.033s
I20260709 12:08:47.954133 21501 raft_consensus.cc:2468] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 0.
I20260709 12:08:47.956122 21564 leader_election.cc:290] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:47.956358 21544 tablet_bootstrap.cc:492] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:47.956816 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:47.957440 21500 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.954265 21352 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.957996 21390 leader_election.cc:304] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:08:47.958843 21543 raft_consensus.cc:359] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.959617 21543 raft_consensus.cc:385] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.959940 21543 raft_consensus.cc:740] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.960248 21541 tablet_bootstrap.cc:492] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:47.960731 21541 ts_tablet_manager.cc:1403] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.021s
I20260709 12:08:47.960942 21564 raft_consensus.cc:2804] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.961306 21564 raft_consensus.cc:493] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.961735 21564 raft_consensus.cc:3060] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.962283 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:47.963083 21427 raft_consensus.cc:2393] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf3d7c4f70240f1a3d96e61026a0bcc in current term 1: Already voted for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in this term.
I20260709 12:08:47.963927 21541 raft_consensus.cc:359] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.957441 21544 ts_tablet_manager.cc:1403] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.084s	user 0.041s	sys 0.033s
I20260709 12:08:47.960738 21543 consensus_queue.cc:260] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.964413 21465 leader_election.cc:304] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:47.966528 21541 raft_consensus.cc:385] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.966899 21541 raft_consensus.cc:740] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.967788 21544 raft_consensus.cc:359] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.967911 21541 consensus_queue.cc:260] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.968530 21544 raft_consensus.cc:385] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.968849 21544 raft_consensus.cc:740] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.969535 21544 consensus_queue.cc:260] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:47.971779 21544 ts_tablet_manager.cc:1434] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:47.972741 21544 tablet_bootstrap.cc:492] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:47.969902 21543 ts_tablet_manager.cc:1434] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:08:47.974254 21543 tablet_bootstrap.cc:492] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:47.964514 21500 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 1.
I20260709 12:08:47.974953 21547 raft_consensus.cc:2749] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.977063 21390 leader_election.cc:304] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:47.980147 21544 tablet_bootstrap.cc:654] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.980075 21551 raft_consensus.cc:2804] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.984274 21543 tablet_bootstrap.cc:654] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.987634 21541 ts_tablet_manager.cc:1434] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:08:47.990808 21352 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 1.
I20260709 12:08:47.995854 21543 tablet_bootstrap.cc:492] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:47.997433 21543 ts_tablet_manager.cc:1403] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 12:08:47.999675 21564 raft_consensus.cc:515] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.000209 21543 raft_consensus.cc:359] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.000896 21543 raft_consensus.cc:385] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.001192 21543 raft_consensus.cc:740] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.996829 21541 tablet_bootstrap.cc:492] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:48.002823 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
W20260709 12:08:48.004359 21391 leader_election.cc:343] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.001938 21543 consensus_queue.cc:260] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.006848 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.006506 21564 leader_election.cc:290] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.007587 21500 raft_consensus.cc:3060] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.009016 21543 ts_tablet_manager.cc:1434] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:08:48.009977 21543 tablet_bootstrap.cc:492] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:48.014561 21500 raft_consensus.cc:2468] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 1.
I20260709 12:08:48.015652 21541 tablet_bootstrap.cc:654] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.016010 21390 leader_election.cc:304] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:08:48.016752 21543 tablet_bootstrap.cc:654] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.019440 21574 raft_consensus.cc:2804] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.019979 21574 raft_consensus.cc:697] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Becoming Leader. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:08:48.020785 21574 consensus_queue.cc:237] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.023891 21544 tablet_bootstrap.cc:492] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:48.024767 21544 ts_tablet_manager.cc:1403] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.011s
W20260709 12:08:48.025161 21465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:33747, user_credentials={real_user=slave}} blocked reactor thread for 60894.9us
I20260709 12:08:48.024782 21551 raft_consensus.cc:697] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Becoming Leader. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:08:48.028802 21543 tablet_bootstrap.cc:492] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:48.026602 21551 consensus_queue.cc:237] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.029261 21543 ts_tablet_manager.cc:1403] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:08:48.029402 21541 tablet_bootstrap.cc:492] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:48.029282 21544 raft_consensus.cc:359] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.030031 21541 ts_tablet_manager.cc:1403] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 12:08:48.030279 21544 raft_consensus.cc:385] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.030655 21544 raft_consensus.cc:740] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.031395 21544 consensus_queue.cc:260] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.032155 21543 raft_consensus.cc:359] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.033202 21543 raft_consensus.cc:385] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.033399 21546 raft_consensus.cc:493] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.033504 21543 raft_consensus.cc:740] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.033676 21544 ts_tablet_manager.cc:1434] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:48.033958 21546 raft_consensus.cc:515] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.034251 21543 consensus_queue.cc:260] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.035079 21541 raft_consensus.cc:359] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.035712 21541 raft_consensus.cc:385] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.036038 21541 raft_consensus.cc:740] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.036193 21546 leader_election.cc:290] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.036408 21543 ts_tablet_manager.cc:1434] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:48.036818 21541 consensus_queue.cc:260] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.037317 21543 tablet_bootstrap.cc:492] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc: Bootstrap starting.
I20260709 12:08:48.038697 21541 ts_tablet_manager.cc:1434] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:48.034754 21544 tablet_bootstrap.cc:492] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:48.039829 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04c5d242e394f72a5fa319483abca71" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
I20260709 12:08:48.040539 21500 raft_consensus.cc:2468] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 0.
I20260709 12:08:48.041796 21541 tablet_bootstrap.cc:492] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:48.042023 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04c5d242e394f72a5fa319483abca71" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:48.042672 21427 raft_consensus.cc:2468] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 0.
I20260709 12:08:48.043884 21543 tablet_bootstrap.cc:654] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.047390 21544 tablet_bootstrap.cc:654] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.047199 21315 leader_election.cc:304] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.048804 21541 tablet_bootstrap.cc:654] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.048866 21546 raft_consensus.cc:2804] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.049436 21546 raft_consensus.cc:493] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.049769 21546 raft_consensus.cc:3060] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.059259 21574 raft_consensus.cc:493] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.059789 21574 raft_consensus.cc:515] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.061918 21574 leader_election.cc:290] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.066897 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
I20260709 12:08:48.067792 21500 raft_consensus.cc:2468] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 0.
I20260709 12:08:48.069561 21390 leader_election.cc:304] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:48.070752 21574 raft_consensus.cc:2804] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.071187 21574 raft_consensus.cc:493] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.071590 21574 raft_consensus.cc:3060] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.075518 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:48.076421 21352 raft_consensus.cc:2468] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 0.
I20260709 12:08:48.097538 21574 raft_consensus.cc:515] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.098814 21546 raft_consensus.cc:515] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.105540 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:48.106372 21352 raft_consensus.cc:3060] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.108428 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04c5d242e394f72a5fa319483abca71" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.109189 21427 raft_consensus.cc:3060] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.116220 21352 raft_consensus.cc:2468] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 1.
I20260709 12:08:48.117847 21391 leader_election.cc:304] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:48.118920 21564 raft_consensus.cc:2804] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.119050 21427 raft_consensus.cc:2468] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 1.
I20260709 12:08:48.120771 21316 leader_election.cc:304] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:48.125802 21573 raft_consensus.cc:493] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.126295 21573 raft_consensus.cc:515] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.130889 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04c5d242e394f72a5fa319483abca71" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.131197 21573 leader_election.cc:290] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.131600 21500 raft_consensus.cc:3060] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.131906 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
W20260709 12:08:48.133610 21465 leader_election.cc:343] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.142000 21500 raft_consensus.cc:2468] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 1.
I20260709 12:08:48.146400 21546 leader_election.cc:290] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.147758 21546 raft_consensus.cc:2804] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.148452 21546 raft_consensus.cc:697] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:08:48.149664 21546 consensus_queue.cc:237] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.144151 21586 raft_consensus.cc:493] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.152132 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:48.153304 21573 raft_consensus.cc:493] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.163139 21573 raft_consensus.cc:515] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
W20260709 12:08:48.163643 21465 leader_election.cc:343] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.163223 21586 raft_consensus.cc:515] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.164106 21465 leader_election.cc:304] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:48.165560 21573 leader_election.cc:290] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.166747 21544 tablet_bootstrap.cc:492] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:48.166625 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:48.167202 21544 ts_tablet_manager.cc:1403] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.133s	user 0.046s	sys 0.024s
I20260709 12:08:48.154834 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.167768 21500 raft_consensus.cc:3060] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.168579 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:48.154003 21574 leader_election.cc:290] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.166154 21247 catalog_manager.cc:5697] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec reported cstate change: term changed from 0 to 1, leader changed from <none> to d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66). New cstate: current_term: 1 leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.169128 21586 leader_election.cc:290] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.169292 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
W20260709 12:08:48.171028 21315 leader_election.cc:343] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.170915 21544 raft_consensus.cc:359] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.171674 21544 raft_consensus.cc:385] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:08:48.171878 21316 leader_election.cc:343] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.172487 21316 leader_election.cc:304] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805; no voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:48.160795 21564 raft_consensus.cc:697] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Becoming Leader. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:08:48.173372 21586 raft_consensus.cc:2749] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.173791 21543 tablet_bootstrap.cc:492] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc: No bootstrap required, opened a new log
I20260709 12:08:48.169268 21352 raft_consensus.cc:2468] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 0.
I20260709 12:08:48.174268 21543 ts_tablet_manager.cc:1403] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent bootstrapping tablet: real 0.137s	user 0.038s	sys 0.065s
I20260709 12:08:48.173817 21564 consensus_queue.cc:237] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.175386 21465 leader_election.cc:304] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.175691 21541 tablet_bootstrap.cc:492] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:48.166162 21573 raft_consensus.cc:2749] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.171993 21544 raft_consensus.cc:740] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.176277 21547 raft_consensus.cc:2804] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.176723 21547 raft_consensus.cc:493] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.177102 21547 raft_consensus.cc:3060] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.176404 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:48.178015 21543 raft_consensus.cc:359] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.178619 21427 raft_consensus.cc:2468] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 0.
I20260709 12:08:48.178906 21543 raft_consensus.cc:385] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.177065 21544 consensus_queue.cc:260] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.179306 21543 raft_consensus.cc:740] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.181531 21544 ts_tablet_manager.cc:1434] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 12:08:48.181641 21543 consensus_queue.cc:260] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.176288 21541 ts_tablet_manager.cc:1403] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.135s	user 0.042s	sys 0.039s
I20260709 12:08:48.184672 21543 ts_tablet_manager.cc:1434] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:08:48.190923 21544 tablet_bootstrap.cc:492] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:48.190783 21541 raft_consensus.cc:359] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.191884 21541 raft_consensus.cc:385] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.192272 21541 raft_consensus.cc:740] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.193648 21541 consensus_queue.cc:260] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.196488 21541 ts_tablet_manager.cc:1434] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:08:48.197644 21541 tablet_bootstrap.cc:492] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805: Bootstrap starting.
I20260709 12:08:48.198904 21547 raft_consensus.cc:515] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.204593 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:48.205287 21352 raft_consensus.cc:3060] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.205469 21541 tablet_bootstrap.cc:654] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.208298 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.208932 21427 raft_consensus.cc:3060] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.211614 21573 raft_consensus.cc:493] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.211997 21586 raft_consensus.cc:493] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.212149 21573 raft_consensus.cc:515] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.212512 21586 raft_consensus.cc:515] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.214201 21352 raft_consensus.cc:2468] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 1.
I20260709 12:08:48.216005 21586 leader_election.cc:290] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.217428 21547 leader_election.cc:290] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.217698 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800d6ece16a4a1490158b2af945e005" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
I20260709 12:08:48.218053 21573 leader_election.cc:290] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.216568 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800d6ece16a4a1490158b2af945e005" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:48.218355 21501 raft_consensus.cc:2468] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 0.
I20260709 12:08:48.219623 21315 leader_election.cc:304] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.212489 21500 raft_consensus.cc:2468] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 1.
I20260709 12:08:48.220527 21586 raft_consensus.cc:2804] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.220479 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800d6ece16a4a1490158b2af945e005" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:48.221052 21586 raft_consensus.cc:493] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:08:48.221370 21316 leader_election.cc:343] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.221451 21586 raft_consensus.cc:3060] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.225051 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800d6ece16a4a1490158b2af945e005" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
W20260709 12:08:48.228749 21465 leader_election.cc:343] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.229472 21465 leader_election.cc:304] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.230293 21573 raft_consensus.cc:2804] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.230872 21573 raft_consensus.cc:697] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Becoming Leader. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:48.231154 21427 raft_consensus.cc:2468] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 1.
I20260709 12:08:48.231684 21586 raft_consensus.cc:515] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.231848 21573 consensus_queue.cc:237] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.232853 21351 raft_consensus.cc:2393] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf3d7c4f70240f1a3d96e61026a0bcc in current term 1: Already voted for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in this term.
I20260709 12:08:48.232347 21249 catalog_manager.cc:5697] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.235041 21541 tablet_bootstrap.cc:492] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805: No bootstrap required, opened a new log
I20260709 12:08:48.235461 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800d6ece16a4a1490158b2af945e005" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.236147 21586 leader_election.cc:290] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.235491 21541 ts_tablet_manager.cc:1403] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.003s
W20260709 12:08:48.236948 21316 leader_election.cc:343] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.238262 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800d6ece16a4a1490158b2af945e005" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.239001 21500 raft_consensus.cc:3060] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.243306 21465 leader_election.cc:304] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:48.246969 21541 raft_consensus.cc:359] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.247503 21541 raft_consensus.cc:385] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.247763 21541 raft_consensus.cc:740] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.248474 21541 consensus_queue.cc:260] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.250483 21541 ts_tablet_manager.cc:1434] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:08:48.251786 21544 tablet_bootstrap.cc:654] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.252554 21500 raft_consensus.cc:2468] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 1.
I20260709 12:08:48.251876 21246 catalog_manager.cc:5697] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc reported cstate change: term changed from 0 to 1, leader changed from <none> to adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67). New cstate: current_term: 1 leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.253264 21547 raft_consensus.cc:2749] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.255337 21315 leader_election.cc:304] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:48.256632 21586 raft_consensus.cc:2804] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.257309 21586 raft_consensus.cc:697] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:08:48.263617 21586 consensus_queue.cc:237] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.276094 21564 raft_consensus.cc:493] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.276767 21564 raft_consensus.cc:515] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.280248 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:48.280886 21351 raft_consensus.cc:2468] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 0.
I20260709 12:08:48.281841 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
I20260709 12:08:48.282138 21391 leader_election.cc:304] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:48.282692 21500 raft_consensus.cc:2468] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 0.
I20260709 12:08:48.283000 21574 raft_consensus.cc:2804] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.282423 21247 catalog_manager.cc:5697] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec reported cstate change: term changed from 0 to 1, leader changed from <none> to d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66). New cstate: current_term: 1 leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.283371 21574 raft_consensus.cc:493] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.283742 21574 raft_consensus.cc:3060] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.283846 21564 leader_election.cc:290] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.284408 21247 catalog_manager.cc:5697] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec reported cstate change: term changed from 0 to 1, leader changed from <none> to d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66). New cstate: current_term: 1 leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.286863 21586 raft_consensus.cc:493] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.287326 21586 raft_consensus.cc:515] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.289757 21586 leader_election.cc:290] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.289716 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:48.290015 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
I20260709 12:08:48.290076 21574 raft_consensus.cc:515] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.290741 21500 raft_consensus.cc:2468] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 0.
I20260709 12:08:48.291319 21427 raft_consensus.cc:2393] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c3815926c784e8eb3b3ced3c2bd2805 in current term 1: Already voted for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in this term.
I20260709 12:08:48.291919 21315 leader_election.cc:304] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.293201 21586 raft_consensus.cc:2804] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.293463 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:48.293538 21586 raft_consensus.cc:493] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.293645 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.294070 21586 raft_consensus.cc:3060] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.294260 21500 raft_consensus.cc:3060] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.296348 21544 tablet_bootstrap.cc:492] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:48.296828 21544 ts_tablet_manager.cc:1403] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.114s	user 0.025s	sys 0.014s
I20260709 12:08:48.297065 21249 catalog_manager.cc:5697] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.299073 21547 raft_consensus.cc:493] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.299526 21547 raft_consensus.cc:515] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.299947 21544 raft_consensus.cc:359] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.300662 21544 raft_consensus.cc:385] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.301126 21544 raft_consensus.cc:740] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.301672 21547 leader_election.cc:290] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.301956 21544 consensus_queue.cc:260] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.302073 21586 raft_consensus.cc:515] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.303539 21351 raft_consensus.cc:2393] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in current term 1: Already voted for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in this term.
I20260709 12:08:48.303965 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d61baf64c54bdfb2bb491ae1219c37" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:48.304610 21352 raft_consensus.cc:2468] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 0.
I20260709 12:08:48.305418 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.306128 21465 leader_election.cc:304] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.307099 21544 ts_tablet_manager.cc:1434] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:08:48.307063 21586 leader_election.cc:290] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.307893 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.308272 21544 tablet_bootstrap.cc:492] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:48.308420 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d61baf64c54bdfb2bb491ae1219c37" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:48.308678 21427 raft_consensus.cc:2393] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c3815926c784e8eb3b3ced3c2bd2805 in current term 1: Already voted for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in this term.
I20260709 12:08:48.308993 21426 raft_consensus.cc:2468] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 0.
I20260709 12:08:48.309841 21547 raft_consensus.cc:2804] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.310256 21547 raft_consensus.cc:493] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.310194 21316 leader_election.cc:304] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805; no voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:48.310863 21547 raft_consensus.cc:3060] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.311991 21586 raft_consensus.cc:2749] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.316629 21544 tablet_bootstrap.cc:654] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.317834 21574 leader_election.cc:290] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.318260 21500 raft_consensus.cc:2468] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 1.
I20260709 12:08:48.319566 21390 leader_election.cc:304] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:08:48.319567 21547 raft_consensus.cc:515] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.321866 21544 tablet_bootstrap.cc:492] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:48.322295 21544 ts_tablet_manager.cc:1403] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 12:08:48.322664 21547 leader_election.cc:290] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.323266 21574 raft_consensus.cc:2804] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.323732 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d61baf64c54bdfb2bb491ae1219c37" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.323753 21574 raft_consensus.cc:697] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Becoming Leader. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:08:48.324422 21426 raft_consensus.cc:3060] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.324491 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d61baf64c54bdfb2bb491ae1219c37" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:48.325095 21352 raft_consensus.cc:3060] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.324841 21574 consensus_queue.cc:237] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.325672 21544 raft_consensus.cc:359] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.326342 21544 raft_consensus.cc:385] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.326617 21544 raft_consensus.cc:740] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.327363 21544 consensus_queue.cc:260] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.329761 21544 ts_tablet_manager.cc:1434] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:48.330730 21544 tablet_bootstrap.cc:492] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:48.332584 21352 raft_consensus.cc:2468] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 1.
I20260709 12:08:48.333580 21426 raft_consensus.cc:2468] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 1.
I20260709 12:08:48.334090 21465 leader_election.cc:304] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.335000 21547 raft_consensus.cc:2804] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.335467 21547 raft_consensus.cc:697] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Becoming Leader. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:48.336210 21547 consensus_queue.cc:237] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.337219 21544 tablet_bootstrap.cc:654] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.344179 21544 tablet_bootstrap.cc:492] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:48.344658 21544 ts_tablet_manager.cc:1403] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:08:48.341820 21247 catalog_manager.cc:5697] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec reported cstate change: term changed from 0 to 1, leader changed from <none> to d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66). New cstate: current_term: 1 leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.345243 21249 catalog_manager.cc:5697] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc reported cstate change: term changed from 0 to 1, leader changed from <none> to adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67). New cstate: current_term: 1 leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.347587 21544 raft_consensus.cc:359] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.348203 21544 raft_consensus.cc:385] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.348436 21544 raft_consensus.cc:740] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.349013 21544 consensus_queue.cc:260] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.350737 21544 ts_tablet_manager.cc:1434] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:08:48.351539 21544 tablet_bootstrap.cc:492] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Bootstrap starting.
I20260709 12:08:48.356948 21544 tablet_bootstrap.cc:654] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.360913 21544 tablet_bootstrap.cc:492] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec: No bootstrap required, opened a new log
I20260709 12:08:48.361290 21544 ts_tablet_manager.cc:1403] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:08:48.363140 21544 raft_consensus.cc:359] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.363628 21544 raft_consensus.cc:385] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.363847 21544 raft_consensus.cc:740] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.364347 21544 consensus_queue.cc:260] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.365798 21544 ts_tablet_manager.cc:1434] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:08:48.397866 21547 raft_consensus.cc:493] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.398341 21547 raft_consensus.cc:515] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.399937 21547 leader_election.cc:290] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.400808 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:48.400962 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:48.401400 21352 raft_consensus.cc:2468] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 0.
I20260709 12:08:48.401526 21426 raft_consensus.cc:2468] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 0.
I20260709 12:08:48.402372 21465 leader_election.cc:304] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.403051 21547 raft_consensus.cc:2804] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.403337 21547 raft_consensus.cc:493] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.403617 21547 raft_consensus.cc:3060] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.408109 21547 raft_consensus.cc:515] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.409621 21547 leader_election.cc:290] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.410581 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:48.410866 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.411139 21352 raft_consensus.cc:3060] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.411384 21426 raft_consensus.cc:3060] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.416033 21426 raft_consensus.cc:2468] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 1.
I20260709 12:08:48.416070 21352 raft_consensus.cc:2468] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 1.
I20260709 12:08:48.417140 21465 leader_election.cc:304] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.417794 21547 raft_consensus.cc:2804] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.418224 21547 raft_consensus.cc:697] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Becoming Leader. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:48.419057 21547 consensus_queue.cc:237] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.426586 21547 raft_consensus.cc:493] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.425990 21249 catalog_manager.cc:5697] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc reported cstate change: term changed from 0 to 1, leader changed from <none> to adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67). New cstate: current_term: 1 leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.427134 21547 raft_consensus.cc:515] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.429149 21547 leader_election.cc:290] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.429965 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:48.430307 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:48.430567 21352 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 0.
I20260709 12:08:48.430951 21426 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 0.
I20260709 12:08:48.431605 21465 leader_election.cc:304] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.432392 21547 raft_consensus.cc:2804] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.432687 21547 raft_consensus.cc:493] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.433018 21547 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.438098 21547 raft_consensus.cc:515] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.439865 21547 leader_election.cc:290] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.440793 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:48.441183 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.441416 21352 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.441758 21426 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.444690 21586 raft_consensus.cc:493] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.445183 21586 raft_consensus.cc:515] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.446813 21352 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 1.
I20260709 12:08:48.447392 21586 leader_election.cc:290] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.447326 21426 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 1.
I20260709 12:08:48.448261 21465 leader_election.cc:304] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:48.448392 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
I20260709 12:08:48.448945 21547 raft_consensus.cc:2804] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.449075 21500 raft_consensus.cc:2393] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c3815926c784e8eb3b3ced3c2bd2805 in current term 1: Already voted for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in this term.
I20260709 12:08:48.449447 21547 raft_consensus.cc:697] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Becoming Leader. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:48.450177 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" is_pre_election: true
I20260709 12:08:48.450309 21547 consensus_queue.cc:237] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.451464 21316 leader_election.cc:304] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805; no voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:48.452209 21586 raft_consensus.cc:3060] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.458236 21586 raft_consensus.cc:2749] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.458702 21249 catalog_manager.cc:5697] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc reported cstate change: term changed from 0 to 1, leader changed from <none> to adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67). New cstate: current_term: 1 leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.504482 21574 consensus_queue.cc:1048] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.515100 21574 consensus_queue.cc:1048] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.568795 21574 consensus_queue.cc:1048] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.574313 21546 consensus_queue.cc:1048] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.580526 21427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db89b53ed47f4b719db329748af61e52"
dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
mode: GRACEFUL
new_leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:35594
I20260709 12:08:48.581223 21427 raft_consensus.cc:606] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Received request to transfer leadership to TS 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:08:48.582219 21564 consensus_queue.cc:1048] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.598263 21564 raft_consensus.cc:493] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.598781 21564 raft_consensus.cc:515] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.601536 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800d6ece16a4a1490158b2af945e005" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" is_pre_election: true
I20260709 12:08:48.604362 21564 leader_election.cc:290] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.606758 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800d6ece16a4a1490158b2af945e005" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" is_pre_election: true
I20260709 12:08:48.607595 21500 raft_consensus.cc:2393] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in current term 1: Already voted for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in this term.
I20260709 12:08:48.609587 21500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
mode: GRACEFUL
new_leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:52634
I20260709 12:08:48.610153 21500 raft_consensus.cc:606] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Received request to transfer leadership to TS 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:08:48.610916 21390 leader_election.cc:304] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc
I20260709 12:08:48.612085 21551 raft_consensus.cc:3060] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.617169 21500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
mode: GRACEFUL
new_leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:52634
I20260709 12:08:48.617820 21500 raft_consensus.cc:606] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Received request to transfer leadership to TS 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:08:48.620400 21584 consensus_queue.cc:1048] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.621042 21551 raft_consensus.cc:2749] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.628360 21551 consensus_queue.cc:1048] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.634153 21501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
mode: GRACEFUL
new_leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
 from {username='slave'} at 127.0.0.1:52634
I20260709 12:08:48.634835 21501 raft_consensus.cc:606] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Received request to transfer leadership to TS d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:48.640523 21585 consensus_queue.cc:1048] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.643610 21547 consensus_queue.cc:1048] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.652068 21500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74d61baf64c54bdfb2bb491ae1219c37"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
mode: GRACEFUL
new_leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
 from {username='slave'} at 127.0.0.1:52634
I20260709 12:08:48.652616 21500 raft_consensus.cc:606] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Received request to transfer leadership to TS d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:48.658179 21547 consensus_queue.cc:1048] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.669780 21427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f"
dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
mode: GRACEFUL
new_leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:35594
I20260709 12:08:48.670451 21427 raft_consensus.cc:606] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Received request to transfer leadership to TS adf3d7c4f70240f1a3d96e61026a0bcc
I20260709 12:08:48.683957 21573 raft_consensus.cc:993] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc: : Instructing follower d23ca4f6294f4f51b6d2f5dc7dae4cec to start an election
I20260709 12:08:48.684419 21547 raft_consensus.cc:1081] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Signalling peer d23ca4f6294f4f51b6d2f5dc7dae4cec to start an election
I20260709 12:08:48.687467 21426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571"
dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
 from {username='slave'} at 127.0.0.1:35588
I20260709 12:08:48.688170 21426 raft_consensus.cc:493] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.688561 21426 raft_consensus.cc:3060] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.693521 21426 raft_consensus.cc:515] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.695180 21426 leader_election.cc:290] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 2 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.696039 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:48.696238 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.696631 21352 raft_consensus.cc:3060] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.696739 21500 raft_consensus.cc:3055] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.697062 21500 raft_consensus.cc:740] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:48.697865 21500 consensus_queue.cc:260] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.699106 21500 raft_consensus.cc:3060] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.703563 21352 raft_consensus.cc:2468] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 2.
I20260709 12:08:48.704717 21391 leader_election.cc:304] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:48.705421 21564 raft_consensus.cc:2804] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.705453 21500 raft_consensus.cc:2468] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 2.
I20260709 12:08:48.706053 21564 raft_consensus.cc:697] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 LEADER]: Becoming Leader. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:08:48.706921 21564 consensus_queue.cc:237] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.713406 21246 catalog_manager.cc:5697] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec reported cstate change: term changed from 1 to 2, leader changed from adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67) to d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66). New cstate: current_term: 2 leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.723065 21573 consensus_queue.cc:1048] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.733506 21619 consensus_queue.cc:1048] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.742157 21547 raft_consensus.cc:993] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc: : Instructing follower d23ca4f6294f4f51b6d2f5dc7dae4cec to start an election
I20260709 12:08:48.742642 21619 raft_consensus.cc:1081] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Signalling peer d23ca4f6294f4f51b6d2f5dc7dae4cec to start an election
I20260709 12:08:48.744165 21426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74d61baf64c54bdfb2bb491ae1219c37"
dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
 from {username='slave'} at 127.0.0.1:35588
I20260709 12:08:48.744716 21426 raft_consensus.cc:493] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.745122 21426 raft_consensus.cc:3060] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.749774 21426 raft_consensus.cc:515] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.751674 21426 leader_election.cc:290] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 2 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.752393 21352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d61baf64c54bdfb2bb491ae1219c37" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:48.752724 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d61baf64c54bdfb2bb491ae1219c37" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.753005 21352 raft_consensus.cc:3060] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.753273 21500 raft_consensus.cc:3055] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.753583 21500 raft_consensus.cc:740] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:48.754385 21500 consensus_queue.cc:260] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.755630 21500 raft_consensus.cc:3060] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.757927 21584 consensus_queue.cc:1048] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.760355 21352 raft_consensus.cc:2468] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 2.
I20260709 12:08:48.761490 21391 leader_election.cc:304] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:48.762137 21500 raft_consensus.cc:2468] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 2.
I20260709 12:08:48.762550 21564 raft_consensus.cc:2804] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.763123 21564 raft_consensus.cc:697] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 LEADER]: Becoming Leader. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:08:48.763958 21564 consensus_queue.cc:237] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.772395 21584 consensus_queue.cc:1048] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.778723 21247 catalog_manager.cc:5697] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec reported cstate change: term changed from 1 to 2, leader changed from adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67) to d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66). New cstate: current_term: 2 leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.780169 21564 consensus_queue.cc:1048] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.787889 21551 raft_consensus.cc:993] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec: : Instructing follower adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:08:48.788334 21551 raft_consensus.cc:1081] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Signalling peer adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:08:48.790827 21500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:52632
I20260709 12:08:48.791388 21500 raft_consensus.cc:493] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.791729 21500 raft_consensus.cc:3060] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.792646 21551 consensus_queue.cc:1048] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.799125 21500 raft_consensus.cc:515] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.800196 21501 raft_consensus.cc:1240] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Rejecting Update request from peer d23ca4f6294f4f51b6d2f5dc7dae4cec for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:48.803799 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:48.806744 21551 consensus_queue.cc:1059] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.807233 21500 leader_election.cc:290] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 2 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:48.807749 21574 raft_consensus.cc:3055] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.808136 21574 raft_consensus.cc:740] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:08:48.808985 21574 consensus_queue.cc:260] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.809652 21619 consensus_queue.cc:1048] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.809809 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e595aad7ec34c2f8b168ab00c98732f" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.810262 21574 raft_consensus.cc:3060] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.816475 21547 raft_consensus.cc:993] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc: : Instructing follower 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:08:48.816915 21547 raft_consensus.cc:1081] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Signalling peer 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:08:48.820518 21352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:33342
I20260709 12:08:48.823603 21352 raft_consensus.cc:493] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.823997 21352 raft_consensus.cc:3060] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.822928 21426 raft_consensus.cc:2468] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 2.
I20260709 12:08:48.824424 21547 consensus_queue.cc:1048] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.832463 21352 raft_consensus.cc:515] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.834268 21465 leader_election.cc:304] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:08:48.835386 21619 raft_consensus.cc:2804] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.835865 21619 raft_consensus.cc:697] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 LEADER]: Becoming Leader. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:48.836645 21619 consensus_queue.cc:237] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.838496 21352 leader_election.cc:290] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.838841 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.838006 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.839372 21500 raft_consensus.cc:3055] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.839704 21500 raft_consensus.cc:740] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:48.840822 21500 consensus_queue.cc:260] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.842140 21500 raft_consensus.cc:3060] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.848026 21500 raft_consensus.cc:2468] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 2.
I20260709 12:08:48.849015 21315 leader_election.cc:304] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:08:48.849696 21584 raft_consensus.cc:2804] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.850201 21584 raft_consensus.cc:697] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:08:48.850979 21584 consensus_queue.cc:237] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.857415 21547 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.858006 21247 catalog_manager.cc:5697] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 1 to 2, leader changed from adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67) to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.861146 21246 catalog_manager.cc:5697] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc reported cstate change: term changed from 1 to 2, leader changed from d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66) to adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67). New cstate: current_term: 2 leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.867028 21619 raft_consensus.cc:993] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc: : Instructing follower 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:08:48.867475 21619 raft_consensus.cc:1081] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Signalling peer 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:08:48.869585 21351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:33342
I20260709 12:08:48.870090 21351 raft_consensus.cc:493] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.870493 21351 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.872465 21619 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.877550 21351 raft_consensus.cc:515] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.878696 21352 raft_consensus.cc:1240] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Rejecting Update request from peer adf3d7c4f70240f1a3d96e61026a0bcc for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:48.882285 21619 consensus_queue.cc:1059] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.883093 21573 raft_consensus.cc:3055] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.883435 21573 raft_consensus.cc:740] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:48.883354 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:48.884099 21426 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.884346 21573 consensus_queue.cc:260] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.885253 21573 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.891040 21426 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 2.
I20260709 12:08:48.892067 21316 leader_election.cc:304] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:48.892208 21351 leader_election.cc:290] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:48.892927 21584 raft_consensus.cc:2804] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.893391 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:48.893378 21584 raft_consensus.cc:697] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:08:48.894466 21584 consensus_queue.cc:237] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:48.900189 21500 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 2.
I20260709 12:08:48.901690 21247 catalog_manager.cc:5697] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 1 to 2, leader changed from adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67) to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.018801 21551 raft_consensus.cc:993] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec: : Instructing follower 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:08:49.019289 21551 raft_consensus.cc:1081] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Signalling peer 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:08:49.020757 21351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db89b53ed47f4b719db329748af61e52"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:33340
I20260709 12:08:49.021277 21351 raft_consensus.cc:493] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.021591 21351 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.026175 21351 raft_consensus.cc:515] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:49.028036 21351 leader_election.cc:290] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:08:49.028766 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:49.029219 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:08:49.029371 21426 raft_consensus.cc:3055] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.029780 21426 raft_consensus.cc:740] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:08:49.029817 21500 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.030597 21426 consensus_queue.cc:260] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:49.031502 21426 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.034731 21500 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 2.
I20260709 12:08:49.035707 21315 leader_election.cc:304] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:08:49.036427 21584 raft_consensus.cc:2804] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.036448 21426 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 2.
I20260709 12:08:49.036937 21584 raft_consensus.cc:697] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:08:49.037712 21584 consensus_queue.cc:237] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:49.043668 21247 catalog_manager.cc:5697] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 1 to 2, leader changed from d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66) to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.205111 21351 raft_consensus.cc:1275] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Refusing update from remote peer d23ca4f6294f4f51b6d2f5dc7dae4cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.206233 21564 consensus_queue.cc:1048] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.213992 21500 raft_consensus.cc:1275] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Refusing update from remote peer d23ca4f6294f4f51b6d2f5dc7dae4cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.215332 21574 consensus_queue.cc:1048] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.225548 21500 raft_consensus.cc:1275] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Refusing update from remote peer d23ca4f6294f4f51b6d2f5dc7dae4cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.227028 21574 consensus_queue.cc:1048] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.234292 21351 raft_consensus.cc:1275] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Refusing update from remote peer d23ca4f6294f4f51b6d2f5dc7dae4cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.235872 21574 consensus_queue.cc:1048] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.305043 21500 raft_consensus.cc:1275] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.306267 21546 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.314174 21426 raft_consensus.cc:1275] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.315881 21546 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.347611 21426 raft_consensus.cc:1275] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.348827 21573 consensus_queue.cc:1048] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.356599 21351 raft_consensus.cc:3060] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.363224 21351 raft_consensus.cc:1275] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.364434 21547 consensus_queue.cc:1048] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.406571 21500 raft_consensus.cc:1275] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.407763 21546 consensus_queue.cc:1048] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.414887 21426 raft_consensus.cc:3060] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.421531 21426 raft_consensus.cc:1275] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.422993 21546 consensus_queue.cc:1048] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.562084 21426 raft_consensus.cc:1275] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.563349 21546 consensus_queue.cc:1048] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.571774 21500 raft_consensus.cc:1275] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.573349 21586 consensus_queue.cc:1048] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:51.701243 20705 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:51.701854 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:51.717530 21351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
mode: GRACEFUL
new_leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:49666
I20260709 12:08:51.718001 21351 raft_consensus.cc:606] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Received request to transfer leadership to TS adf3d7c4f70240f1a3d96e61026a0bcc
I20260709 12:08:51.720203 21351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db89b53ed47f4b719db329748af61e52"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
mode: GRACEFUL
new_leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:49666
I20260709 12:08:51.720621 21351 raft_consensus.cc:606] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Received request to transfer leadership to TS adf3d7c4f70240f1a3d96e61026a0bcc
I20260709 12:08:51.721544 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:51.721916 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:52.029608 21586 raft_consensus.cc:993] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805: : Instructing follower adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:08:52.030052 21640 raft_consensus.cc:1081] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Signalling peer adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:08:52.031620 21501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:52628
I20260709 12:08:52.032217 21501 raft_consensus.cc:493] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.032586 21501 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.037708 21501 raft_consensus.cc:515] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:52.039577 21501 leader_election.cc:290] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 3 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:52.040473 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:52.041002 21351 raft_consensus.cc:3055] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:52.040819 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:52.041325 21351 raft_consensus.cc:740] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:08:52.041559 21426 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.042168 21351 consensus_queue.cc:260] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:52.043215 21351 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.046083 21426 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 3.
I20260709 12:08:52.047219 21465 leader_election.cc:304] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:52.047982 21635 raft_consensus.cc:2804] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:52.047922 21351 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 3.
I20260709 12:08:52.049175 21635 raft_consensus.cc:697] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Becoming Leader. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:52.049943 21635 consensus_queue.cc:237] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:52.057224 21247 catalog_manager.cc:5697] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc reported cstate change: term changed from 2 to 3, leader changed from 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65) to adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67). New cstate: current_term: 3 leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.152060 21586 raft_consensus.cc:993] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805: : Instructing follower adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:08:52.152530 21640 raft_consensus.cc:1081] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Signalling peer adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:08:52.153790 21501 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db89b53ed47f4b719db329748af61e52"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:52628
I20260709 12:08:52.154284 21501 raft_consensus.cc:493] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.154611 21501 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.159251 21501 raft_consensus.cc:515] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:52.160869 21501 leader_election.cc:290] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 3 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:08:52.161721 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:08:52.161849 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:08:52.162371 21351 raft_consensus.cc:3055] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:52.162452 21426 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.162735 21351 raft_consensus.cc:740] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:08:52.163455 21351 consensus_queue.cc:260] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:52.164331 21351 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.166678 21426 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 3.
I20260709 12:08:52.167842 21465 leader_election.cc:304] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:08:52.168627 21635 raft_consensus.cc:2804] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:52.169082 21635 raft_consensus.cc:697] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Becoming Leader. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:08:52.169363 21351 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 3.
I20260709 12:08:52.169915 21635 consensus_queue.cc:237] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:08:52.176683 21247 catalog_manager.cc:5697] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc reported cstate change: term changed from 2 to 3, leader changed from 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65) to adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67). New cstate: current_term: 3 leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.561815 21426 raft_consensus.cc:1275] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.563031 21635 consensus_queue.cc:1048] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.574023 21351 raft_consensus.cc:1275] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.575347 21651 consensus_queue.cc:1048] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.633006 21351 raft_consensus.cc:1275] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.634177 21651 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.642302 21426 raft_consensus.cc:1275] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.643620 21651 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.722725 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.727857 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:52.728273 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.729228 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.735260 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.735831 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:54.736707 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.742734 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.743170 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.744213 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.749532 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.749974 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.751259 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.757002 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.757454 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.758728 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.763919 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.764334 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.765297 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.771390 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.771812 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.772891 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.778266 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.778721 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.779680 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.785812 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:00.786212 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:01.815591 20705 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:01.819964 21501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db89b53ed47f4b719db329748af61e52"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
mode: GRACEFUL
new_leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:52634
I20260709 12:09:01.820595 21501 raft_consensus.cc:606] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Received request to transfer leadership to TS 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:09:01.827255 21501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
mode: GRACEFUL
new_leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:52634
I20260709 12:09:01.827716 21501 raft_consensus.cc:606] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Received request to transfer leadership to TS 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:09:01.836509 21662 raft_consensus.cc:993] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc: : Instructing follower 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:01.837029 21662 raft_consensus.cc:1081] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Signalling peer 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:01.837433 21426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571"
dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
mode: GRACEFUL
new_leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:35594
I20260709 12:09:01.837949 21426 raft_consensus.cc:606] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 LEADER]: Received request to transfer leadership to TS 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:09:01.838714 21351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db89b53ed47f4b719db329748af61e52"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:33342
I20260709 12:09:01.839360 21351 raft_consensus.cc:493] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.839800 21351 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.843178 21426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a"
dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
mode: GRACEFUL
new_leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:35594
I20260709 12:09:01.843708 21426 raft_consensus.cc:606] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Received request to transfer leadership to TS 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:09:01.846671 21351 raft_consensus.cc:515] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.848404 21426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7"
dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
mode: GRACEFUL
new_leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:35594
I20260709 12:09:01.848964 21426 raft_consensus.cc:606] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Received request to transfer leadership to TS 3c3815926c784e8eb3b3ced3c2bd2805
I20260709 12:09:01.849119 21351 leader_election.cc:290] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 4 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:09:01.849591 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:09:01.850400 21427 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.854710 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db89b53ed47f4b719db329748af61e52" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:09:01.855276 21501 raft_consensus.cc:3055] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:01.855671 21501 raft_consensus.cc:740] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:09:01.855993 21427 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 4.
I20260709 12:09:01.856475 21501 consensus_queue.cc:260] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.857569 21316 leader_election.cc:304] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:09:01.857931 21501 raft_consensus.cc:3060] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.858510 21640 raft_consensus.cc:2804] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:01.863003 21501 raft_consensus.cc:2468] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 4.
I20260709 12:09:01.863819 21640 raft_consensus.cc:697] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:09:01.864950 21640 consensus_queue.cc:237] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.871873 21249 catalog_manager.cc:5697] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 3 to 4, leader changed from adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67) to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 4 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.887039 21669 raft_consensus.cc:993] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec: : Instructing follower 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:01.887594 21660 raft_consensus.cc:1081] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 LEADER]: Signalling peer 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:01.889050 21351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:33340
I20260709 12:09:01.889484 21351 raft_consensus.cc:493] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.889758 21351 raft_consensus.cc:3060] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.894052 21351 raft_consensus.cc:515] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.895478 21351 leader_election.cc:290] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 3 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:09:01.896385 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:09:01.896543 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e0aa5b1513a4e89b77956cc2e156571" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:09:01.897009 21427 raft_consensus.cc:3055] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:01.897070 21501 raft_consensus.cc:3060] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.897337 21427 raft_consensus.cc:740] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:09:01.898104 21427 consensus_queue.cc:260] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.899152 21427 raft_consensus.cc:3060] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:01.901463 21501 raft_consensus.cc:2468] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 3.
I20260709 12:09:01.902575 21315 leader_election.cc:304] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:09:01.903275 21640 raft_consensus.cc:2804] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:01.903648 21640 raft_consensus.cc:697] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:09:01.904476 21427 raft_consensus.cc:2468] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 3.
I20260709 12:09:01.904371 21640 consensus_queue.cc:237] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.913287 21249 catalog_manager.cc:5697] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 2 to 3, leader changed from d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66) to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 3 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.921526 21651 raft_consensus.cc:993] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc: : Instructing follower 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:01.922065 21662 raft_consensus.cc:1081] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Signalling peer 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:01.923523 21351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:33342
I20260709 12:09:01.924024 21351 raft_consensus.cc:493] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.924324 21351 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.928777 21351 raft_consensus.cc:515] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.930495 21351 leader_election.cc:290] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 4 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:09:01.931269 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:09:01.931524 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:09:01.931937 21427 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.932060 21501 raft_consensus.cc:3055] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:01.932430 21501 raft_consensus.cc:740] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:09:01.933125 21501 consensus_queue.cc:260] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.934062 21501 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.937516 21427 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 4.
I20260709 12:09:01.938052 21501 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 4.
I20260709 12:09:01.938627 21316 leader_election.cc:304] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:09:01.939567 21640 raft_consensus.cc:2804] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:01.940049 21640 raft_consensus.cc:697] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:09:01.940779 21640 consensus_queue.cc:237] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.947913 21249 catalog_manager.cc:5697] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 3 to 4, leader changed from adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67) to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 4 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.955652 21669 raft_consensus.cc:993] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec: : Instructing follower 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:01.956121 21660 raft_consensus.cc:1081] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Signalling peer 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:01.957669 21351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:33340
I20260709 12:09:01.958112 21351 raft_consensus.cc:493] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.958352 21351 raft_consensus.cc:3060] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.962316 21351 raft_consensus.cc:515] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.963814 21351 leader_election.cc:290] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:09:01.964689 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:09:01.964831 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:09:01.965270 21427 raft_consensus.cc:3055] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:01.965320 21501 raft_consensus.cc:3060] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.965713 21427 raft_consensus.cc:740] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:09:01.966656 21427 consensus_queue.cc:260] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.967664 21427 raft_consensus.cc:3060] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.969744 21501 raft_consensus.cc:2468] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 2.
I20260709 12:09:01.970729 21315 leader_election.cc:304] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:09:01.971709 21640 raft_consensus.cc:2804] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:01.972179 21640 raft_consensus.cc:697] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:09:01.972810 21640 consensus_queue.cc:237] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:01.973312 21427 raft_consensus.cc:2468] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 2.
I20260709 12:09:01.979496 21249 catalog_manager.cc:5697] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 1 to 2, leader changed from d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66) to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.121910 21669 raft_consensus.cc:993] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec: : Instructing follower 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:02.122454 21660 raft_consensus.cc:1081] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Signalling peer 3c3815926c784e8eb3b3ced3c2bd2805 to start an election
I20260709 12:09:02.123903 21351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
 from {username='slave'} at 127.0.0.1:33340
I20260709 12:09:02.124369 21351 raft_consensus.cc:493] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.124744 21351 raft_consensus.cc:3060] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.128701 21351 raft_consensus.cc:515] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:02.130023 21351 leader_election.cc:290] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Requested vote from peers d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:09:02.130905 21427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:09:02.131050 21501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:09:02.131484 21501 raft_consensus.cc:3060] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.131484 21427 raft_consensus.cc:3055] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:02.131923 21427 raft_consensus.cc:740] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:09:02.132731 21427 consensus_queue.cc:260] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:02.133944 21427 raft_consensus.cc:3060] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.137971 21501 raft_consensus.cc:2468] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 2.
I20260709 12:09:02.139127 21315 leader_election.cc:304] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3815926c784e8eb3b3ced3c2bd2805, adf3d7c4f70240f1a3d96e61026a0bcc; no voters: 
I20260709 12:09:02.139959 21640 raft_consensus.cc:2804] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:02.140349 21640 raft_consensus.cc:697] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Leader. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:09:02.140601 21427 raft_consensus.cc:2468] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3815926c784e8eb3b3ced3c2bd2805 in term 2.
I20260709 12:09:02.141268 21640 consensus_queue.cc:237] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:02.147976 21249 catalog_manager.cc:5697] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 reported cstate change: term changed from 1 to 2, leader changed from d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66) to 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.266829 21427 raft_consensus.cc:1275] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 4 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.267920 21640 consensus_queue.cc:1048] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.280396 21501 raft_consensus.cc:1275] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 4 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.282720 21640 consensus_queue.cc:1048] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.335708 21427 raft_consensus.cc:1275] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.336879 21640 consensus_queue.cc:1048] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.345175 21501 raft_consensus.cc:1275] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.346858 21663 consensus_queue.cc:1048] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:02.401393 21427 raft_consensus.cc:1275] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.402772 21677 consensus_queue.cc:1048] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:02.411413 21501 raft_consensus.cc:1275] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.413151 21681 consensus_queue.cc:1048] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:02.418673 21500 raft_consensus.cc:1275] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 4 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.420217 21681 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.428321 21427 raft_consensus.cc:1275] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 4 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.429883 21640 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.563472 21501 raft_consensus.cc:1275] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.564813 21640 consensus_queue.cc:1048] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:02.572878 21427 raft_consensus.cc:1275] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Refusing update from remote peer 3c3815926c784e8eb3b3ced3c2bd2805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.574669 21640 consensus_queue.cc:1048] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:04.890200 20705 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:04.890868 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:04.898151 21351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
mode: GRACEFUL
new_leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
 from {username='slave'} at 127.0.0.1:49666
I20260709 12:09:04.898643 21351 raft_consensus.cc:606] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Received request to transfer leadership to TS d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:09:04.900923 21351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
mode: GRACEFUL
new_leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
 from {username='slave'} at 127.0.0.1:49666
I20260709 12:09:04.901355 21351 raft_consensus.cc:606] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 LEADER]: Received request to transfer leadership to TS d23ca4f6294f4f51b6d2f5dc7dae4cec
I20260709 12:09:04.903378 21351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
mode: GRACEFUL
new_leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:49666
I20260709 12:09:04.903780 21351 raft_consensus.cc:606] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Received request to transfer leadership to TS adf3d7c4f70240f1a3d96e61026a0bcc
I20260709 12:09:04.905915 21351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a"
dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
mode: GRACEFUL
new_leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:49666
I20260709 12:09:04.906337 21351 raft_consensus.cc:606] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Received request to transfer leadership to TS adf3d7c4f70240f1a3d96e61026a0bcc
I20260709 12:09:04.907239 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:04.907682 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:05.058950 21689 raft_consensus.cc:993] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805: : Instructing follower d23ca4f6294f4f51b6d2f5dc7dae4cec to start an election
I20260709 12:09:05.059465 21677 raft_consensus.cc:1081] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Signalling peer d23ca4f6294f4f51b6d2f5dc7dae4cec to start an election
I20260709 12:09:05.061054 21426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7"
dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
 from {username='slave'} at 127.0.0.1:35572
I20260709 12:09:05.061486 21426 raft_consensus.cc:493] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.061753 21426 raft_consensus.cc:3060] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.065994 21426 raft_consensus.cc:515] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.068121 21426 leader_election.cc:290] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 3 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:09:05.068951 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:09:05.069502 21500 raft_consensus.cc:3060] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.069761 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abb8289107a4ba78aa8b0edbbd5f8e7" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:09:05.070313 21351 raft_consensus.cc:3055] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.070624 21351 raft_consensus.cc:740] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:09:05.071199 21351 consensus_queue.cc:260] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.072016 21351 raft_consensus.cc:3060] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.074201 21500 raft_consensus.cc:2468] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 3.
I20260709 12:09:05.075251 21390 leader_election.cc:304] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:09:05.075894 21660 raft_consensus.cc:2804] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.076308 21351 raft_consensus.cc:2468] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 3.
I20260709 12:09:05.076891 21660 raft_consensus.cc:697] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 LEADER]: Becoming Leader. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:09:05.077701 21660 consensus_queue.cc:237] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.083880 21247 catalog_manager.cc:5697] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec reported cstate change: term changed from 2 to 3, leader changed from 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65) to d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66). New cstate: current_term: 3 leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.108388 21689 raft_consensus.cc:993] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805: : Instructing follower adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:09:05.108814 21677 raft_consensus.cc:1081] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Signalling peer adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:09:05.110101 21500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:52628
I20260709 12:09:05.110565 21500 raft_consensus.cc:493] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.110853 21500 raft_consensus.cc:3060] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.114955 21500 raft_consensus.cc:515] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.116763 21500 leader_election.cc:290] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 3 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:09:05.117671 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:09:05.118067 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d95f6da33f48df9f057c3b215f257a" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:09:05.118353 21351 raft_consensus.cc:3055] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.118631 21426 raft_consensus.cc:3060] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.118733 21351 raft_consensus.cc:740] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:09:05.119565 21351 consensus_queue.cc:260] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.120813 21351 raft_consensus.cc:3060] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.125490 21426 raft_consensus.cc:2468] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 3.
I20260709 12:09:05.126952 21465 leader_election.cc:304] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:09:05.127631 21351 raft_consensus.cc:2468] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 3.
I20260709 12:09:05.127874 21662 raft_consensus.cc:2804] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.129500 21662 raft_consensus.cc:697] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Becoming Leader. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:09:05.130401 21662 consensus_queue.cc:237] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.138387 21247 catalog_manager.cc:5697] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc reported cstate change: term changed from 2 to 3, leader changed from 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65) to adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67). New cstate: current_term: 3 leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.229822 21689 raft_consensus.cc:993] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805: : Instructing follower adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:09:05.230315 21689 raft_consensus.cc:1081] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Signalling peer adf3d7c4f70240f1a3d96e61026a0bcc to start an election
I20260709 12:09:05.231784 21500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a"
dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
 from {username='slave'} at 127.0.0.1:52628
I20260709 12:09:05.232355 21500 raft_consensus.cc:493] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.232642 21500 raft_consensus.cc:3060] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.237162 21500 raft_consensus.cc:515] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.238672 21500 leader_election.cc:290] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 3 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747)
I20260709 12:09:05.239494 21426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
I20260709 12:09:05.239446 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcb271eb5d04977939d8ea32fdec38a" candidate_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:09:05.240128 21426 raft_consensus.cc:3060] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.240237 21351 raft_consensus.cc:3055] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.240614 21351 raft_consensus.cc:740] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:09:05.241266 21351 consensus_queue.cc:260] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.242194 21351 raft_consensus.cc:3060] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.244829 21426 raft_consensus.cc:2468] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 3.
I20260709 12:09:05.245751 21465 leader_election.cc:304] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:09:05.246465 21662 raft_consensus.cc:2804] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.246621 21351 raft_consensus.cc:2468] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf3d7c4f70240f1a3d96e61026a0bcc in term 3.
I20260709 12:09:05.246872 21662 raft_consensus.cc:697] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Becoming Leader. State: Replica: adf3d7c4f70240f1a3d96e61026a0bcc, State: Running, Role: LEADER
I20260709 12:09:05.247753 21662 consensus_queue.cc:237] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.254190 21247 catalog_manager.cc:5697] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc reported cstate change: term changed from 2 to 3, leader changed from 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65) to adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67). New cstate: current_term: 3 leader_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.359867 21677 raft_consensus.cc:993] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805: : Instructing follower d23ca4f6294f4f51b6d2f5dc7dae4cec to start an election
I20260709 12:09:05.360282 21689 raft_consensus.cc:1081] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 LEADER]: Signalling peer d23ca4f6294f4f51b6d2f5dc7dae4cec to start an election
I20260709 12:09:05.361445 21426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44"
dest_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec"
 from {username='slave'} at 127.0.0.1:35572
I20260709 12:09:05.361850 21426 raft_consensus.cc:493] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.362123 21426 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.366214 21426 raft_consensus.cc:515] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.367767 21426 leader_election.cc:290] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 5 election: Requested vote from peers 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889), adf3d7c4f70240f1a3d96e61026a0bcc (127.20.56.67:36581)
I20260709 12:09:05.368448 21351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3c3815926c784e8eb3b3ced3c2bd2805"
I20260709 12:09:05.368649 21500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c16cc257c4f409ba23eb6a721883a44" candidate_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc"
I20260709 12:09:05.368954 21351 raft_consensus.cc:3055] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:05.369159 21500 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.369292 21351 raft_consensus.cc:740] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3c3815926c784e8eb3b3ced3c2bd2805, State: Running, Role: LEADER
I20260709 12:09:05.369957 21351 consensus_queue.cc:260] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.370785 21351 raft_consensus.cc:3060] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.373437 21500 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 5.
I20260709 12:09:05.374341 21390 leader_election.cc:304] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf3d7c4f70240f1a3d96e61026a0bcc, d23ca4f6294f4f51b6d2f5dc7dae4cec; no voters: 
I20260709 12:09:05.374929 21351 raft_consensus.cc:2468] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23ca4f6294f4f51b6d2f5dc7dae4cec in term 5.
I20260709 12:09:05.375083 21660 raft_consensus.cc:2804] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:05.375649 21660 raft_consensus.cc:697] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 5 LEADER]: Becoming Leader. State: Replica: d23ca4f6294f4f51b6d2f5dc7dae4cec, State: Running, Role: LEADER
I20260709 12:09:05.376513 21660 consensus_queue.cc:237] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } }
I20260709 12:09:05.382714 21247 catalog_manager.cc:5697] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec reported cstate change: term changed from 4 to 5, leader changed from 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65) to d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66). New cstate: current_term: 5 leader_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.604632 21500 raft_consensus.cc:1275] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Refusing update from remote peer d23ca4f6294f4f51b6d2f5dc7dae4cec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.605765 21660 consensus_queue.cc:1048] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.615548 21351 raft_consensus.cc:1275] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Refusing update from remote peer d23ca4f6294f4f51b6d2f5dc7dae4cec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.616914 21702 consensus_queue.cc:1048] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.695528 21426 raft_consensus.cc:1275] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.696699 21662 consensus_queue.cc:1048] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.705221 21351 raft_consensus.cc:1275] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.706539 21662 consensus_queue.cc:1048] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.712666 21350 raft_consensus.cc:1275] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.714033 21696 consensus_queue.cc:1048] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.724059 21426 raft_consensus.cc:1275] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Refusing update from remote peer adf3d7c4f70240f1a3d96e61026a0bcc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.725879 21707 consensus_queue.cc:1048] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23ca4f6294f4f51b6d2f5dc7dae4cec" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:05.806919 21350 raft_consensus.cc:1275] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 5 FOLLOWER]: Refusing update from remote peer d23ca4f6294f4f51b6d2f5dc7dae4cec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:05.808296 21702 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3815926c784e8eb3b3ced3c2bd2805" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:05.816902 21500 raft_consensus.cc:1275] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 5 FOLLOWER]: Refusing update from remote peer d23ca4f6294f4f51b6d2f5dc7dae4cec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:05.818579 21660 consensus_queue.cc:1048] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf3d7c4f70240f1a3d96e61026a0bcc" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 36581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:05.908635 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.914032 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:05.914561 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:06.915746 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.921537 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.921994 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.923213 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.928386 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.928838 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.929782 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.935204 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.935616 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.936591 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.943490 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.943909 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.944773 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.949926 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.950361 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:11.951349 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.957780 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.958206 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.959184 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.964381 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.964843 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.965720 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.970955 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.971374 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:15.000826 20705 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:15.001345 20705 tablet_server.cc:179] TabletServer@127.20.56.65:0 shutting down...
I20260709 12:09:15.029373 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.030004 20705 tablet_replica.cc:333] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.030725 20705 raft_consensus.cc:2243] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.031394 20705 raft_consensus.cc:2272] T 74d61baf64c54bdfb2bb491ae1219c37 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.033352 20705 tablet_replica.cc:333] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.033921 20705 raft_consensus.cc:2243] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.034345 20705 raft_consensus.cc:2272] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.036051 20705 tablet_replica.cc:333] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.036552 20705 raft_consensus.cc:2243] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.037297 20705 raft_consensus.cc:2272] T 9e0aa5b1513a4e89b77956cc2e156571 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.039117 20705 tablet_replica.cc:333] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.039669 20705 raft_consensus.cc:2243] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.040122 20705 raft_consensus.cc:2272] T 9dcb271eb5d04977939d8ea32fdec38a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.042021 20705 tablet_replica.cc:333] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.042632 20705 raft_consensus.cc:2243] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.043596 20705 raft_consensus.cc:2272] T 3800d6ece16a4a1490158b2af945e005 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.045583 20705 tablet_replica.cc:333] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.046038 20705 raft_consensus.cc:2243] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.046839 20705 raft_consensus.cc:2272] T db89b53ed47f4b719db329748af61e52 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.048518 20705 tablet_replica.cc:333] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.048936 20705 raft_consensus.cc:2243] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.049571 20705 raft_consensus.cc:2272] T d04c5d242e394f72a5fa319483abca71 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.051244 20705 tablet_replica.cc:333] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.051654 20705 raft_consensus.cc:2243] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.052003 20705 raft_consensus.cc:2272] T 0c16cc257c4f409ba23eb6a721883a44 P 3c3815926c784e8eb3b3ced3c2bd2805 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.053580 20705 tablet_replica.cc:333] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.054000 20705 raft_consensus.cc:2243] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.054361 20705 raft_consensus.cc:2272] T 2e595aad7ec34c2f8b168ab00c98732f P 3c3815926c784e8eb3b3ced3c2bd2805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.056099 20705 tablet_replica.cc:333] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805: stopping tablet replica
I20260709 12:09:15.056479 20705 raft_consensus.cc:2243] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.056854 20705 raft_consensus.cc:2272] T 92d95f6da33f48df9f057c3b215f257a P 3c3815926c784e8eb3b3ced3c2bd2805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.086699 20705 tablet_server.cc:196] TabletServer@127.20.56.65:0 shutdown complete.
I20260709 12:09:15.107709 20705 tablet_server.cc:179] TabletServer@127.20.56.66:0 shutting down...
W20260709 12:09:15.112381 21465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.56.65:36889: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260709 12:09:15.117734 21465 consensus_peers.cc:597] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc -> Peer 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889): Couldn't send request to peer 3c3815926c784e8eb3b3ced3c2bd2805. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:36889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.146123 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.146987 20705 tablet_replica.cc:333] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.147796 20705 raft_consensus.cc:2243] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.148311 20705 raft_consensus.cc:2272] T 3800d6ece16a4a1490158b2af945e005 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.151363 20705 tablet_replica.cc:333] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.152133 20705 raft_consensus.cc:2243] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.152731 20705 raft_consensus.cc:2272] T 92d95f6da33f48df9f057c3b215f257a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.153432 21391 consensus_peers.cc:597] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec -> Peer 3c3815926c784e8eb3b3ced3c2bd2805 (127.20.56.65:36889): Couldn't send request to peer 3c3815926c784e8eb3b3ced3c2bd2805. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:36889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.154965 20705 tablet_replica.cc:333] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.155663 20705 raft_consensus.cc:2243] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.156123 20705 raft_consensus.cc:2272] T 2e595aad7ec34c2f8b168ab00c98732f P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.157918 20705 tablet_replica.cc:333] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.158495 20705 raft_consensus.cc:2243] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.158936 20705 raft_consensus.cc:2272] T 9dcb271eb5d04977939d8ea32fdec38a P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.160683 20705 tablet_replica.cc:333] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.161180 20705 raft_consensus.cc:2243] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.161593 20705 raft_consensus.cc:2272] T 9e0aa5b1513a4e89b77956cc2e156571 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.163322 20705 tablet_replica.cc:333] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.163944 20705 raft_consensus.cc:2243] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.164799 20705 raft_consensus.cc:2272] T 0c16cc257c4f409ba23eb6a721883a44 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.166191 21465 consensus_peers.cc:597] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc -> Peer d23ca4f6294f4f51b6d2f5dc7dae4cec (127.20.56.66:33747): Couldn't send request to peer d23ca4f6294f4f51b6d2f5dc7dae4cec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.167102 20705 tablet_replica.cc:333] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.167569 20705 raft_consensus.cc:2243] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.167900 20705 raft_consensus.cc:2272] T d04c5d242e394f72a5fa319483abca71 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.169459 20705 tablet_replica.cc:333] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.169883 20705 raft_consensus.cc:2243] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.170603 20705 raft_consensus.cc:2272] T 74d61baf64c54bdfb2bb491ae1219c37 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.172160 20705 tablet_replica.cc:333] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.172618 20705 raft_consensus.cc:2243] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.173238 20705 raft_consensus.cc:2272] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.174806 20705 tablet_replica.cc:333] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec: stopping tablet replica
I20260709 12:09:15.175182 20705 raft_consensus.cc:2243] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.175551 20705 raft_consensus.cc:2272] T db89b53ed47f4b719db329748af61e52 P d23ca4f6294f4f51b6d2f5dc7dae4cec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.204521 20705 tablet_server.cc:196] TabletServer@127.20.56.66:0 shutdown complete.
I20260709 12:09:15.223825 20705 tablet_server.cc:179] TabletServer@127.20.56.67:0 shutting down...
I20260709 12:09:15.249120 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.249847 20705 tablet_replica.cc:333] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.250558 20705 raft_consensus.cc:2243] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.251333 20705 raft_consensus.cc:2272] T 9dcb271eb5d04977939d8ea32fdec38a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.253196 20705 tablet_replica.cc:333] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.253829 20705 raft_consensus.cc:2243] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.254266 20705 raft_consensus.cc:2272] T 9e0aa5b1513a4e89b77956cc2e156571 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.256065 20705 tablet_replica.cc:333] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.256502 20705 raft_consensus.cc:2243] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.257193 20705 raft_consensus.cc:2272] T 2e595aad7ec34c2f8b168ab00c98732f P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.258805 20705 tablet_replica.cc:333] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.259233 20705 raft_consensus.cc:2243] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.259913 20705 raft_consensus.cc:2272] T 92d95f6da33f48df9f057c3b215f257a P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.261649 20705 tablet_replica.cc:333] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.262079 20705 raft_consensus.cc:2243] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.262485 20705 raft_consensus.cc:2272] T 3800d6ece16a4a1490158b2af945e005 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.264046 20705 tablet_replica.cc:333] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.264479 20705 raft_consensus.cc:2243] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.264856 20705 raft_consensus.cc:2272] T 0c16cc257c4f409ba23eb6a721883a44 P adf3d7c4f70240f1a3d96e61026a0bcc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.266362 20705 tablet_replica.cc:333] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.266893 20705 raft_consensus.cc:2243] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.267204 20705 raft_consensus.cc:2272] T d04c5d242e394f72a5fa319483abca71 P adf3d7c4f70240f1a3d96e61026a0bcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.268568 20705 tablet_replica.cc:333] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.268983 20705 raft_consensus.cc:2243] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.269320 20705 raft_consensus.cc:2272] T 74d61baf64c54bdfb2bb491ae1219c37 P adf3d7c4f70240f1a3d96e61026a0bcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.270836 20705 tablet_replica.cc:333] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.271229 20705 raft_consensus.cc:2243] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.271559 20705 raft_consensus.cc:2272] T 0abb8289107a4ba78aa8b0edbbd5f8e7 P adf3d7c4f70240f1a3d96e61026a0bcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.273056 20705 tablet_replica.cc:333] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc: stopping tablet replica
I20260709 12:09:15.273437 20705 raft_consensus.cc:2243] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.273759 20705 raft_consensus.cc:2272] T db89b53ed47f4b719db329748af61e52 P adf3d7c4f70240f1a3d96e61026a0bcc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.302802 20705 tablet_server.cc:196] TabletServer@127.20.56.67:0 shutdown complete.
I20260709 12:09:15.321763 20705 master.cc:562] Master@127.20.56.126:39009 shutting down...
I20260709 12:09:15.344157 20705 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.344745 20705 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.345088 20705 tablet_replica.cc:333] T 00000000000000000000000000000000 P e84af1c504354613a0c84758417fb1f6: stopping tablet replica
I20260709 12:09:15.364369 20705 master.cc:584] Master@127.20.56.126:39009 shutdown complete.
3c3815926c784e8eb3b3ced3c2bd2805  5
adf3d7c4f70240f1a3d96e61026a0bcc  1
d23ca4f6294f4f51b6d2f5dc7dae4cec  4
3c3815926c784e8eb3b3ced3c2bd2805  3
adf3d7c4f70240f1a3d96e61026a0bcc  3
d23ca4f6294f4f51b6d2f5dc7dae4cec  4
3c3815926c784e8eb3b3ced3c2bd2805  8
adf3d7c4f70240f1a3d96e61026a0bcc  1
d23ca4f6294f4f51b6d2f5dc7dae4cec  1
3c3815926c784e8eb3b3ced3c2bd2805  4
adf3d7c4f70240f1a3d96e61026a0bcc  3
d23ca4f6294f4f51b6d2f5dc7dae4cec  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28693 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:15.405228 20705 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.56.126:35507
I20260709 12:09:15.406373 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.412211 21726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.412267 21725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.412588 21728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.414047 20705 server_base.cc:1061] running on GCE node
I20260709 12:09:15.414986 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.415159 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.415279 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598955415268 us; error 0 us; skew 500 ppm
I20260709 12:09:15.415719 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.417910 20705 webserver.cc:533] Webserver started at http://127.20.56.126:33471/ using document root <none> and password file <none>
I20260709 12:09:15.418337 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.418565 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.418795 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.419842 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/master-0-root/instance:
uuid: "18e701898a2848c494bb06576eb2cdd4"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-2dwh"
I20260709 12:09:15.424352 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:09:15.427983 21733 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.428686 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:09:15.428990 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/master-0-root
uuid: "18e701898a2848c494bb06576eb2cdd4"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-2dwh"
I20260709 12:09:15.429277 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.438318 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.439561 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.476153 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.126:35507
I20260709 12:09:15.476253 21784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.126:35507 every 8 connection(s)
I20260709 12:09:15.480051 21785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.490052 21785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Bootstrap starting.
I20260709 12:09:15.494526 21785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.498291 21785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: No bootstrap required, opened a new log
I20260709 12:09:15.500375 21785 raft_consensus.cc:359] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18e701898a2848c494bb06576eb2cdd4" member_type: VOTER }
I20260709 12:09:15.500763 21785 raft_consensus.cc:385] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.500952 21785 raft_consensus.cc:740] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e701898a2848c494bb06576eb2cdd4, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.501406 21785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18e701898a2848c494bb06576eb2cdd4" member_type: VOTER }
I20260709 12:09:15.501824 21785 raft_consensus.cc:399] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:15.502007 21785 raft_consensus.cc:493] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:15.502215 21785 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.506088 21785 raft_consensus.cc:515] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18e701898a2848c494bb06576eb2cdd4" member_type: VOTER }
I20260709 12:09:15.506598 21785 leader_election.cc:304] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18e701898a2848c494bb06576eb2cdd4; no voters: 
I20260709 12:09:15.507750 21785 leader_election.cc:290] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:15.508087 21788 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.509333 21788 raft_consensus.cc:697] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 1 LEADER]: Becoming Leader. State: Replica: 18e701898a2848c494bb06576eb2cdd4, State: Running, Role: LEADER
I20260709 12:09:15.510015 21788 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18e701898a2848c494bb06576eb2cdd4" member_type: VOTER }
I20260709 12:09:15.510725 21785 sys_catalog.cc:565] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:15.515285 21789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18e701898a2848c494bb06576eb2cdd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18e701898a2848c494bb06576eb2cdd4" member_type: VOTER } }
I20260709 12:09:15.516002 21789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:15.521363 21790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18e701898a2848c494bb06576eb2cdd4. Latest consensus state: current_term: 1 leader_uuid: "18e701898a2848c494bb06576eb2cdd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18e701898a2848c494bb06576eb2cdd4" member_type: VOTER } }
I20260709 12:09:15.523329 21790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:15.527819 21794 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:15.534011 21794 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:15.534984 20705 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:15.542402 21794 catalog_manager.cc:1383] Generated new cluster ID: 02071a2af96d46c09ebba3122b37d524
I20260709 12:09:15.542706 21794 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:15.571491 21794 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:15.572860 21794 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:15.585117 21794 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Generated new TSK 0
I20260709 12:09:15.585748 21794 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:15.601059 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.606869 21806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.607837 21807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.609573 20705 server_base.cc:1061] running on GCE node
W20260709 12:09:15.610039 21809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.610971 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.611191 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.611366 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598955611349 us; error 0 us; skew 500 ppm
I20260709 12:09:15.611902 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.614120 20705 webserver.cc:533] Webserver started at http://127.20.56.65:33103/ using document root <none> and password file <none>
I20260709 12:09:15.614660 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.614871 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.615154 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.616245 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/instance:
uuid: "cffb5c192e144f7caa7b94271976ed42"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-2dwh"
I20260709 12:09:15.620600 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:09:15.623708 21814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.624404 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:09:15.624688 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "cffb5c192e144f7caa7b94271976ed42"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-2dwh"
I20260709 12:09:15.624972 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.636665 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.637851 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.639302 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:15.641501 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:15.641728 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.641984 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:15.642172 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.680994 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:42093
I20260709 12:09:15.681087 21876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:42093 every 8 connection(s)
I20260709 12:09:15.686069 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.693253 21881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.695013 21882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.696485 21884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.697623 20705 server_base.cc:1061] running on GCE node
I20260709 12:09:15.699431 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.699657 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.699797 21877 heartbeater.cc:344] Connected to a master server at 127.20.56.126:35507
I20260709 12:09:15.699884 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598955699864 us; error 0 us; skew 500 ppm
I20260709 12:09:15.700261 21877 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:15.700690 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.701196 21877 heartbeater.cc:507] Master 127.20.56.126:35507 requested a full tablet report, sending...
I20260709 12:09:15.703449 20705 webserver.cc:533] Webserver started at http://127.20.56.66:36465/ using document root <none> and password file <none>
I20260709 12:09:15.703549 21750 ts_manager.cc:194] Registered new tserver with Master: cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:15.704033 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.704270 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.704536 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.705399 21750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58722
I20260709 12:09:15.705744 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/instance:
uuid: "ecd8f47cd089480aa1f77728a400384a"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-2dwh"
I20260709 12:09:15.710501 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 12:09:15.713581 21889 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.714303 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:09:15.714629 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root
uuid: "ecd8f47cd089480aa1f77728a400384a"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-2dwh"
I20260709 12:09:15.714936 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.735548 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.736732 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.738119 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:15.740334 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:15.740554 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.740785 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:15.740953 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.778235 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.66:34757
I20260709 12:09:15.778319 21951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.66:34757 every 8 connection(s)
I20260709 12:09:15.782922 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.789568 21955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.791113 21956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.792906 20705 server_base.cc:1061] running on GCE node
W20260709 12:09:15.793709 21959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.794118 21952 heartbeater.cc:344] Connected to a master server at 127.20.56.126:35507
I20260709 12:09:15.794534 21952 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:15.794662 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.794929 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.795120 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598955795104 us; error 0 us; skew 500 ppm
I20260709 12:09:15.795384 21952 heartbeater.cc:507] Master 127.20.56.126:35507 requested a full tablet report, sending...
I20260709 12:09:15.795743 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.797592 21750 ts_manager.cc:194] Registered new tserver with Master: ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:15.798563 20705 webserver.cc:533] Webserver started at http://127.20.56.67:36283/ using document root <none> and password file <none>
I20260709 12:09:15.799197 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.799424 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.799437 21750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58736
I20260709 12:09:15.799849 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.801088 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/instance:
uuid: "73070a828b23480e9c3588e376bce2ab"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-2dwh"
I20260709 12:09:15.805343 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:09:15.808610 21963 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.809319 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:09:15.809605 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root
uuid: "73070a828b23480e9c3588e376bce2ab"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-2dwh"
I20260709 12:09:15.809875 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.819844 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.820981 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.822351 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:15.824553 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:15.824783 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.825028 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:15.825201 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.863255 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.67:39721
I20260709 12:09:15.863353 22025 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.67:39721 every 8 connection(s)
I20260709 12:09:15.876381 22026 heartbeater.cc:344] Connected to a master server at 127.20.56.126:35507
I20260709 12:09:15.876708 22026 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:15.877422 22026 heartbeater.cc:507] Master 127.20.56.126:35507 requested a full tablet report, sending...
I20260709 12:09:15.879299 21750 ts_manager.cc:194] Registered new tserver with Master: 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:15.879707 20705 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013342768s
I20260709 12:09:15.880651 21750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58738
I20260709 12:09:15.904870 21750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58740:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:15.911052 21750 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:16.139061 21991 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc81c27d5d3424db1dfbfc977e0369d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.141367 21991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc81c27d5d3424db1dfbfc977e0369d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.141022 21990 tablet_service.cc:1511] Processing CreateTablet for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.142568 21990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.144328 21989 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4600c62493468899ff64fcf08d4fbe (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.145685 21989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4600c62493468899ff64fcf08d4fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.151240 21988 tablet_service.cc:1511] Processing CreateTablet for tablet 265f2ffa166449ee9bfd498dacfcc48f (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.152628 21988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265f2ffa166449ee9bfd498dacfcc48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.155647 21987 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7597e7938d4462a3e662f6b63d059a (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.157500 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7597e7938d4462a3e662f6b63d059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.160892 21986 tablet_service.cc:1511] Processing CreateTablet for tablet 3e9858619e3a4ae383caadbb133747bc (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.162899 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e9858619e3a4ae383caadbb133747bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.168517 21917 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc81c27d5d3424db1dfbfc977e0369d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.170256 21917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc81c27d5d3424db1dfbfc977e0369d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.170426 21985 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce2d558023440ebf41a6f0ed6a062b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.170859 21916 tablet_service.cc:1511] Processing CreateTablet for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.171877 21985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce2d558023440ebf41a6f0ed6a062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.172173 21916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.175709 21915 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4600c62493468899ff64fcf08d4fbe (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.176241 21984 tablet_service.cc:1511] Processing CreateTablet for tablet 74ed463cf25c4e46900f103087ec2300 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.177066 21915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4600c62493468899ff64fcf08d4fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.177562 21984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ed463cf25c4e46900f103087ec2300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.179666 21914 tablet_service.cc:1511] Processing CreateTablet for tablet 265f2ffa166449ee9bfd498dacfcc48f (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.181037 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265f2ffa166449ee9bfd498dacfcc48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.183725 21913 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7597e7938d4462a3e662f6b63d059a (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.184139 21983 tablet_service.cc:1511] Processing CreateTablet for tablet 3849f2f975df439d82d57276c716d6b8 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.185212 21913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7597e7938d4462a3e662f6b63d059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.185506 21983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3849f2f975df439d82d57276c716d6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.187749 21912 tablet_service.cc:1511] Processing CreateTablet for tablet 3e9858619e3a4ae383caadbb133747bc (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.188210 21982 tablet_service.cc:1511] Processing CreateTablet for tablet d50c36e857cb4e33997aee7e5dd39447 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.193154 21911 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce2d558023440ebf41a6f0ed6a062b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.194844 21982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50c36e857cb4e33997aee7e5dd39447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.198132 21910 tablet_service.cc:1511] Processing CreateTablet for tablet 74ed463cf25c4e46900f103087ec2300 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.204660 21908 tablet_service.cc:1511] Processing CreateTablet for tablet d50c36e857cb4e33997aee7e5dd39447 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.201658 21909 tablet_service.cc:1511] Processing CreateTablet for tablet 3849f2f975df439d82d57276c716d6b8 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.213662 21912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e9858619e3a4ae383caadbb133747bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.222940 21909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3849f2f975df439d82d57276c716d6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.224529 21908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50c36e857cb4e33997aee7e5dd39447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.234970 21910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ed463cf25c4e46900f103087ec2300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.238925 21911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce2d558023440ebf41a6f0ed6a062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.254216 21842 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc81c27d5d3424db1dfbfc977e0369d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.255760 21842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc81c27d5d3424db1dfbfc977e0369d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.260175 21841 tablet_service.cc:1511] Processing CreateTablet for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.261534 21841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.264149 21840 tablet_service.cc:1511] Processing CreateTablet for tablet 2f4600c62493468899ff64fcf08d4fbe (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.266991 21839 tablet_service.cc:1511] Processing CreateTablet for tablet 265f2ffa166449ee9bfd498dacfcc48f (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.269851 21838 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7597e7938d4462a3e662f6b63d059a (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.274072 21837 tablet_service.cc:1511] Processing CreateTablet for tablet 3e9858619e3a4ae383caadbb133747bc (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.279668 21836 tablet_service.cc:1511] Processing CreateTablet for tablet 8fce2d558023440ebf41a6f0ed6a062b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.282123 21835 tablet_service.cc:1511] Processing CreateTablet for tablet 74ed463cf25c4e46900f103087ec2300 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.284596 21834 tablet_service.cc:1511] Processing CreateTablet for tablet 3849f2f975df439d82d57276c716d6b8 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.288908 21833 tablet_service.cc:1511] Processing CreateTablet for tablet d50c36e857cb4e33997aee7e5dd39447 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.302678 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7597e7938d4462a3e662f6b63d059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.303435 21836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce2d558023440ebf41a6f0ed6a062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.306908 21839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265f2ffa166449ee9bfd498dacfcc48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.310680 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e9858619e3a4ae383caadbb133747bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.313447 21834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3849f2f975df439d82d57276c716d6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.321024 21835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ed463cf25c4e46900f103087ec2300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.329897 21840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f4600c62493468899ff64fcf08d4fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.338838 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50c36e857cb4e33997aee7e5dd39447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.345829 21991 tablet_service.cc:1511] Processing CreateTablet for tablet d194e05a662143ea99bad3093bf3e0dd (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.347239 21991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d194e05a662143ea99bad3093bf3e0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.356305 21917 tablet_service.cc:1511] Processing CreateTablet for tablet 3b662199918843a1a8139ac42424d3f6 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.358088 21917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b662199918843a1a8139ac42424d3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.347045 21916 tablet_service.cc:1511] Processing CreateTablet for tablet d194e05a662143ea99bad3093bf3e0dd (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.382679 21916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d194e05a662143ea99bad3093bf3e0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.422703 21983 tablet_service.cc:1511] Processing CreateTablet for tablet 8145e629270b44a298b6e1c1b249989f (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.424127 21983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8145e629270b44a298b6e1c1b249989f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.428654 21988 tablet_service.cc:1511] Processing CreateTablet for tablet 3b662199918843a1a8139ac42424d3f6 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.433394 21917 tablet_service.cc:1511] Processing CreateTablet for tablet 8145e629270b44a298b6e1c1b249989f (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.451258 22042 tablet_bootstrap.cc:492] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:16.443365 21988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b662199918843a1a8139ac42424d3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.458846 22043 tablet_bootstrap.cc:492] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:16.461453 21909 tablet_service.cc:1511] Processing CreateTablet for tablet 11bd5972700f42709d3ebcb0a6d9b51c (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:16.466354 21915 tablet_service.cc:1511] Processing CreateTablet for tablet 52d6c6b59b7b44f4b009fc6edfc800eb (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:16.469043 21908 tablet_service.cc:1511] Processing CreateTablet for tablet 03e031f17c4d400c9fe7c2c101148ff0 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.472674 21838 tablet_service.cc:1511] Processing CreateTablet for tablet 3b662199918843a1a8139ac42424d3f6 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.503775 21913 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3f324c9e584d26829ebc2cadc84629 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:16.505010 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b662199918843a1a8139ac42424d3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.504792 21910 tablet_service.cc:1511] Processing CreateTablet for tablet ae7bfef0e495480e843989cbb71b4330 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:16.487658 21990 tablet_service.cc:1511] Processing CreateTablet for tablet 03e031f17c4d400c9fe7c2c101148ff0 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.506631 21990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e031f17c4d400c9fe7c2c101148ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.488173 21911 tablet_service.cc:1511] Processing CreateTablet for tablet fe6b96986b574ee88589e15157b5260b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.495180 21987 tablet_service.cc:1511] Processing CreateTablet for tablet fe6b96986b574ee88589e15157b5260b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.496105 21982 tablet_service.cc:1511] Processing CreateTablet for tablet 5937d593814d4b568742fc86c954922d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.502300 21914 tablet_service.cc:1511] Processing CreateTablet for tablet 032f8014213a49d395c150ebc9f55752 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.457252 21917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8145e629270b44a298b6e1c1b249989f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.536775 22044 tablet_bootstrap.cc:492] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:16.538738 21911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6b96986b574ee88589e15157b5260b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.500710 21986 tablet_service.cc:1511] Processing CreateTablet for tablet 11bd5972700f42709d3ebcb0a6d9b51c (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:16.544832 21910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7bfef0e495480e843989cbb71b4330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.547912 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd5972700f42709d3ebcb0a6d9b51c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.549055 21984 tablet_service.cc:1511] Processing CreateTablet for tablet ae7bfef0e495480e843989cbb71b4330 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:16.550027 21908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e031f17c4d400c9fe7c2c101148ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.516183 22043 tablet_bootstrap.cc:654] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.515795 21841 tablet_service.cc:1511] Processing CreateTablet for tablet 8145e629270b44a298b6e1c1b249989f (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.554909 21915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d6c6b59b7b44f4b009fc6edfc800eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.498291 21989 tablet_service.cc:1511] Processing CreateTablet for tablet 032f8014213a49d395c150ebc9f55752 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.523142 21912 tablet_service.cc:1511] Processing CreateTablet for tablet 5937d593814d4b568742fc86c954922d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.521633 21837 tablet_service.cc:1511] Processing CreateTablet for tablet 11bd5972700f42709d3ebcb0a6d9b51c (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:16.557570 22042 tablet_bootstrap.cc:654] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.525064 21839 tablet_service.cc:1511] Processing CreateTablet for tablet d194e05a662143ea99bad3093bf3e0dd (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.527902 21838 tablet_service.cc:1511] Processing CreateTablet for tablet 52d6c6b59b7b44f4b009fc6edfc800eb (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
W20260709 12:09:16.531492 21798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:16.555366 21841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8145e629270b44a298b6e1c1b249989f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.518574 21985 tablet_service.cc:1511] Processing CreateTablet for tablet 52d6c6b59b7b44f4b009fc6edfc800eb (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:16.547672 21833 tablet_service.cc:1511] Processing CreateTablet for tablet fe6b96986b574ee88589e15157b5260b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.561640 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6b96986b574ee88589e15157b5260b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.559173 21909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd5972700f42709d3ebcb0a6d9b51c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.564323 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd5972700f42709d3ebcb0a6d9b51c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.566334 21912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5937d593814d4b568742fc86c954922d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.567250 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d6c6b59b7b44f4b009fc6edfc800eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.569451 21839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d194e05a662143ea99bad3093bf3e0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.572346 21840 tablet_service.cc:1511] Processing CreateTablet for tablet 5937d593814d4b568742fc86c954922d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.579273 21840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5937d593814d4b568742fc86c954922d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.584131 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032f8014213a49d395c150ebc9f55752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.524523 21842 tablet_service.cc:1511] Processing CreateTablet for tablet 03e031f17c4d400c9fe7c2c101148ff0 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.587617 21842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e031f17c4d400c9fe7c2c101148ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.588887 21913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3f324c9e584d26829ebc2cadc84629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.587913 21836 tablet_service.cc:1511] Processing CreateTablet for tablet ae7bfef0e495480e843989cbb71b4330 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:16.559502 21991 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3f324c9e584d26829ebc2cadc84629 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:16.561928 21834 tablet_service.cc:1511] Processing CreateTablet for tablet 032f8014213a49d395c150ebc9f55752 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.596628 21834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032f8014213a49d395c150ebc9f55752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.550346 21984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7bfef0e495480e843989cbb71b4330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.600210 21985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d6c6b59b7b44f4b009fc6edfc800eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.600798 21991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3f324c9e584d26829ebc2cadc84629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.601056 21836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7bfef0e495480e843989cbb71b4330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.601358 21982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5937d593814d4b568742fc86c954922d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.605820 22044 tablet_bootstrap.cc:654] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.621337 21835 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3f324c9e584d26829ebc2cadc84629 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:16.630179 21989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032f8014213a49d395c150ebc9f55752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.645498 21917 tablet_service.cc:1511] Processing CreateTablet for tablet c93911a59a2c46bb9745487e082af441 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:16.647141 21917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93911a59a2c46bb9745487e082af441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.652712 21988 tablet_service.cc:1511] Processing CreateTablet for tablet c93911a59a2c46bb9745487e082af441 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:16.653120 21985 tablet_service.cc:1511] Processing CreateTablet for tablet c2526f3581f34316a1eb1e329b5d5af9 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:16.658913 21842 tablet_service.cc:1511] Processing CreateTablet for tablet c2526f3581f34316a1eb1e329b5d5af9 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:16.660996 21833 tablet_service.cc:1511] Processing CreateTablet for tablet c93911a59a2c46bb9745487e082af441 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:16.662164 21838 tablet_service.cc:1511] Processing CreateTablet for tablet 02f67b74a580421b99787adc89841d21 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:16.664424 21836 tablet_service.cc:1511] Processing CreateTablet for tablet 28c070f8afb4493ca787ffc8b1482e7a (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:16.593235 21916 tablet_service.cc:1511] Processing CreateTablet for tablet c2526f3581f34316a1eb1e329b5d5af9 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:16.670157 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6b96986b574ee88589e15157b5260b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.676975 21835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3f324c9e584d26829ebc2cadc84629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.692492 21916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2526f3581f34316a1eb1e329b5d5af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.693220 21983 tablet_service.cc:1511] Processing CreateTablet for tablet 02f67b74a580421b99787adc89841d21 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:16.698635 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93911a59a2c46bb9745487e082af441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.703924 21915 tablet_service.cc:1511] Processing CreateTablet for tablet 02f67b74a580421b99787adc89841d21 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:16.708341 21877 heartbeater.cc:499] Master 127.20.56.126:35507 was elected leader, sending a full tablet report...
I20260709 12:09:16.707928 21915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f67b74a580421b99787adc89841d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.720772 22042 tablet_bootstrap.cc:492] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:16.721299 22042 ts_tablet_manager.cc:1403] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.270s	user 0.015s	sys 0.008s
I20260709 12:09:16.723042 21986 tablet_service.cc:1511] Processing CreateTablet for tablet 28c070f8afb4493ca787ffc8b1482e7a (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:16.724465 21988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93911a59a2c46bb9745487e082af441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.725590 22043 tablet_bootstrap.cc:492] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:16.729009 21985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2526f3581f34316a1eb1e329b5d5af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.737107 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c070f8afb4493ca787ffc8b1482e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.739811 21990 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2003af45914197b88e4cc3389271af (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:16.740823 21983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f67b74a580421b99787adc89841d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.741453 21914 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2003af45914197b88e4cc3389271af (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:16.742722 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2003af45914197b88e4cc3389271af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.745126 21911 tablet_service.cc:1511] Processing CreateTablet for tablet 372e433359ec4224868a6883dfc642e3 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:16.747328 22043 ts_tablet_manager.cc:1403] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.289s	user 0.019s	sys 0.011s
I20260709 12:09:16.733494 22042 raft_consensus.cc:359] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
I20260709 12:09:16.750870 22042 raft_consensus.cc:385] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.751248 22042 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.752112 22042 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
I20260709 12:09:16.756138 22044 tablet_bootstrap.cc:492] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:16.756639 22044 ts_tablet_manager.cc:1403] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.220s	user 0.024s	sys 0.022s
I20260709 12:09:16.752358 21912 tablet_service.cc:1511] Processing CreateTablet for tablet 77a9143d931e458e9c5824195395a69b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:16.770961 21914 tablet_service.cc:1511] Processing CreateTablet for tablet dae741cd77e441b281f9ed48a672f87d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:16.771474 22044 raft_consensus.cc:359] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:16.772104 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f67b74a580421b99787adc89841d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.773499 21837 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2003af45914197b88e4cc3389271af (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:16.775065 21991 tablet_service.cc:1511] Processing CreateTablet for tablet 77a9143d931e458e9c5824195395a69b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:16.776280 21839 tablet_service.cc:1511] Processing CreateTablet for tablet 77a9143d931e458e9c5824195395a69b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:16.777511 21836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c070f8afb4493ca787ffc8b1482e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.772197 22044 raft_consensus.cc:385] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.782373 22044 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.784245 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2003af45914197b88e4cc3389271af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.785790 22044 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:16.792213 21984 tablet_service.cc:1511] Processing CreateTablet for tablet dae741cd77e441b281f9ed48a672f87d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:16.793052 21990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2003af45914197b88e4cc3389271af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.782505 21911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372e433359ec4224868a6883dfc642e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.795790 21839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a9143d931e458e9c5824195395a69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.796867 21909 tablet_service.cc:1511] Processing CreateTablet for tablet 3732a691799e4f2abfe58158cddce045 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:16.798688 22042 ts_tablet_manager.cc:1434] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.009s
I20260709 12:09:16.799240 21913 tablet_service.cc:1511] Processing CreateTablet for tablet 574068a837ce42d6a654b65aa3b4a614 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:16.800171 21952 heartbeater.cc:499] Master 127.20.56.126:35507 was elected leader, sending a full tablet report...
I20260709 12:09:16.799196 21842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2526f3581f34316a1eb1e329b5d5af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.807575 21987 tablet_service.cc:1511] Processing CreateTablet for tablet 574068a837ce42d6a654b65aa3b4a614 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:16.810451 21841 tablet_service.cc:1511] Processing CreateTablet for tablet 372e433359ec4224868a6883dfc642e3 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:16.811991 21841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372e433359ec4224868a6883dfc642e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.814781 21991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a9143d931e458e9c5824195395a69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.815430 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574068a837ce42d6a654b65aa3b4a614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.817039 22042 tablet_bootstrap.cc:492] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:16.824966 21915 tablet_service.cc:1511] Processing CreateTablet for tablet f127c5582f284fbd97aa877ecdd4d4f4 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:16.825120 21910 tablet_service.cc:1511] Processing CreateTablet for tablet 01221e34ce744d078265a58313d176a5 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:16.750311 22043 raft_consensus.cc:359] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:16.827548 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae741cd77e441b281f9ed48a672f87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.831240 21912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a9143d931e458e9c5824195395a69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.834703 21913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574068a837ce42d6a654b65aa3b4a614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.829639 22043 raft_consensus.cc:385] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.838734 22043 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.839525 22043 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:16.807775 21908 tablet_service.cc:1511] Processing CreateTablet for tablet 28c070f8afb4493ca787ffc8b1482e7a (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:16.844940 21840 tablet_service.cc:1511] Processing CreateTablet for tablet dae741cd77e441b281f9ed48a672f87d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:16.845534 21836 tablet_service.cc:1511] Processing CreateTablet for tablet 574068a837ce42d6a654b65aa3b4a614 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:16.846204 21840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae741cd77e441b281f9ed48a672f87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.846083 21915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f127c5582f284fbd97aa877ecdd4d4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.846931 21982 tablet_service.cc:1511] Processing CreateTablet for tablet 372e433359ec4224868a6883dfc642e3 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:16.850973 21984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae741cd77e441b281f9ed48a672f87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.852886 21985 tablet_service.cc:1511] Processing CreateTablet for tablet 3732a691799e4f2abfe58158cddce045 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:16.854503 22044 ts_tablet_manager.cc:1434] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.098s	user 0.012s	sys 0.010s
I20260709 12:09:16.861133 21837 tablet_service.cc:1511] Processing CreateTablet for tablet 3732a691799e4f2abfe58158cddce045 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:16.881100 21835 tablet_service.cc:1511] Processing CreateTablet for tablet f127c5582f284fbd97aa877ecdd4d4f4 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:16.881856 22044 tablet_bootstrap.cc:492] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:16.882032 21985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3732a691799e4f2abfe58158cddce045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.883558 22026 heartbeater.cc:499] Master 127.20.56.126:35507 was elected leader, sending a full tablet report...
I20260709 12:09:16.891206 21982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372e433359ec4224868a6883dfc642e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.864723 22042 tablet_bootstrap.cc:654] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.864853 22043 ts_tablet_manager.cc:1434] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.117s	user 0.003s	sys 0.003s
I20260709 12:09:16.892709 22043 tablet_bootstrap.cc:492] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
W20260709 12:09:16.867902 22027 tablet.cc:2406] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:16.868489 21988 tablet_service.cc:1511] Processing CreateTablet for tablet f127c5582f284fbd97aa877ecdd4d4f4 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:16.895956 21988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f127c5582f284fbd97aa877ecdd4d4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.896051 21834 tablet_service.cc:1511] Processing CreateTablet for tablet 3804cba5d43c4079bb7bb28082798098 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:16.897253 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3732a691799e4f2abfe58158cddce045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.901351 22049 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.901903 22049 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:16.904631 22049 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:16.870885 21986 tablet_service.cc:1511] Processing CreateTablet for tablet 3804cba5d43c4079bb7bb28082798098 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:16.907284 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3804cba5d43c4079bb7bb28082798098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.873224 21989 tablet_service.cc:1511] Processing CreateTablet for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:16.876327 21910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01221e34ce744d078265a58313d176a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.914664 21836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574068a837ce42d6a654b65aa3b4a614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.916421 21834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3804cba5d43c4079bb7bb28082798098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.921751 21908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c070f8afb4493ca787ffc8b1482e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.877878 21833 tablet_service.cc:1511] Processing CreateTablet for tablet 01221e34ce744d078265a58313d176a5 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:16.863139 21983 tablet_service.cc:1511] Processing CreateTablet for tablet 01221e34ce744d078265a58313d176a5 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:16.923219 21983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01221e34ce744d078265a58313d176a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.926992 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01221e34ce744d078265a58313d176a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.927204 21909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3732a691799e4f2abfe58158cddce045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.931846 21838 tablet_service.cc:1511] Processing CreateTablet for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:16.933175 21989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.936640 22043 tablet_bootstrap.cc:654] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.946065 21839 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7076f768c74a41bc54edd6bcaaaf83 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:16.959069 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.972029 22048 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.975530 21991 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7076f768c74a41bc54edd6bcaaaf83 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:16.976011 21839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7076f768c74a41bc54edd6bcaaaf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.976796 21991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7076f768c74a41bc54edd6bcaaaf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.980082 21841 tablet_service.cc:1511] Processing CreateTablet for tablet 1634cc7afa814a3889101c2be1c108ad (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:16.980587 21916 tablet_service.cc:1511] Processing CreateTablet for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:16.981312 21841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1634cc7afa814a3889101c2be1c108ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.981835 21916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.982722 21836 tablet_service.cc:1511] Processing CreateTablet for tablet abcd87e902c445c5b3c3a383d5f1b3eb (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:16.983484 21835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f127c5582f284fbd97aa877ecdd4d4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.934247 21912 tablet_service.cc:1511] Processing CreateTablet for tablet 3804cba5d43c4079bb7bb28082798098 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:16.987761 21912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3804cba5d43c4079bb7bb28082798098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.993672 21914 tablet_service.cc:1511] Processing CreateTablet for tablet 1634cc7afa814a3889101c2be1c108ad (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:16.997848 22044 tablet_bootstrap.cc:654] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.974128 22048 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
I20260709 12:09:17.008881 22048 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:17.031209 21839 tablet_service.cc:1511] Processing CreateTablet for tablet 87ec2fd4639346c6b0a138de0c31852f (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.033375 21915 tablet_service.cc:1511] Processing CreateTablet for tablet abcd87e902c445c5b3c3a383d5f1b3eb (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.035955 21990 tablet_service.cc:1511] Processing CreateTablet for tablet abcd87e902c445c5b3c3a383d5f1b3eb (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.037247 21990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcd87e902c445c5b3c3a383d5f1b3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.038095 21911 tablet_service.cc:1511] Processing CreateTablet for tablet 87ec2fd4639346c6b0a138de0c31852f (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.042673 21908 tablet_service.cc:1511] Processing CreateTablet for tablet e47334283cbf402c8d1c42ff7264f7e7 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.048643 21987 tablet_service.cc:1511] Processing CreateTablet for tablet 87ec2fd4639346c6b0a138de0c31852f (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.031311 21917 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7076f768c74a41bc54edd6bcaaaf83 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.024901 21836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcd87e902c445c5b3c3a383d5f1b3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.088032 21839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ec2fd4639346c6b0a138de0c31852f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.067492 22043 tablet_bootstrap.cc:492] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:17.068591 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1634cc7afa814a3889101c2be1c108ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.089879 21911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ec2fd4639346c6b0a138de0c31852f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.090611 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ec2fd4639346c6b0a138de0c31852f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.080376 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:17.094832 21915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcd87e902c445c5b3c3a383d5f1b3eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.095896 21817 leader_election.cc:343] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.096685 22043 ts_tablet_manager.cc:1403] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.204s	user 0.017s	sys 0.009s
I20260709 12:09:17.098795 21917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7076f768c74a41bc54edd6bcaaaf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.099658 22043 raft_consensus.cc:359] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
I20260709 12:09:17.100382 22043 raft_consensus.cc:385] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.100648 22043 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.083451 21842 tablet_service.cc:1511] Processing CreateTablet for tablet e47334283cbf402c8d1c42ff7264f7e7 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.101953 21842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47334283cbf402c8d1c42ff7264f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.086653 21986 tablet_service.cc:1511] Processing CreateTablet for tablet 1634cc7afa814a3889101c2be1c108ad (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.104888 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1634cc7afa814a3889101c2be1c108ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.106698 21908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47334283cbf402c8d1c42ff7264f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.120630 21833 tablet_service.cc:1511] Processing CreateTablet for tablet fbfd595fdbf3470193f7cd91b4969857 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.132196 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd595fdbf3470193f7cd91b4969857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.135103 22042 tablet_bootstrap.cc:492] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:17.135649 22042 ts_tablet_manager.cc:1403] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.319s	user 0.004s	sys 0.016s
I20260709 12:09:17.142977 21837 tablet_service.cc:1511] Processing CreateTablet for tablet 279111025ee54aba83c27bba63339332 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.144438 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279111025ee54aba83c27bba63339332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.153100 22043 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
I20260709 12:09:17.155457 22043 ts_tablet_manager.cc:1434] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 12:09:17.156462 22043 tablet_bootstrap.cc:492] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:17.183243 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:17.187885 21838 tablet_service.cc:1511] Processing CreateTablet for tablet d28906331f4545a29562f950eacb999e (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.189684 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28906331f4545a29562f950eacb999e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.192049 21989 tablet_service.cc:1511] Processing CreateTablet for tablet 279111025ee54aba83c27bba63339332 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.191843 21991 tablet_service.cc:1511] Processing CreateTablet for tablet e47334283cbf402c8d1c42ff7264f7e7 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.197098 21989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279111025ee54aba83c27bba63339332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.200709 21990 tablet_service.cc:1511] Processing CreateTablet for tablet fbfd595fdbf3470193f7cd91b4969857 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.201787 22043 tablet_bootstrap.cc:654] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.202054 21990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd595fdbf3470193f7cd91b4969857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.213866 22044 tablet_bootstrap.cc:492] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:17.214383 22044 ts_tablet_manager.cc:1403] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.333s	user 0.018s	sys 0.022s
I20260709 12:09:17.217367 22044 raft_consensus.cc:359] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.218086 22044 raft_consensus.cc:385] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.218528 22044 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.219272 22044 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.221580 22044 ts_tablet_manager.cc:1434] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
W20260709 12:09:17.222018 21815 leader_election.cc:343] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.222487 21815 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:17.223243 22049 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.224381 21991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47334283cbf402c8d1c42ff7264f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.228976 21917 tablet_service.cc:1511] Processing CreateTablet for tablet fbfd595fdbf3470193f7cd91b4969857 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.176882 22042 raft_consensus.cc:359] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.230266 22042 raft_consensus.cc:385] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.230600 22042 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.231050 22050 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.231542 22050 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.231532 22042 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.232901 21917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd595fdbf3470193f7cd91b4969857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.235451 22050 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.242152 21989 tablet_service.cc:1511] Processing CreateTablet for tablet d28906331f4545a29562f950eacb999e (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.243606 21915 tablet_service.cc:1511] Processing CreateTablet for tablet 279111025ee54aba83c27bba63339332 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.244158 21914 tablet_service.cc:1511] Processing CreateTablet for tablet d28906331f4545a29562f950eacb999e (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.244972 21915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279111025ee54aba83c27bba63339332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.245136 22042 ts_tablet_manager.cc:1434] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.109s	user 0.000s	sys 0.007s
I20260709 12:09:17.245579 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28906331f4545a29562f950eacb999e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.246835 21916 tablet_service.cc:1511] Processing CreateTablet for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:17.253976 21989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28906331f4545a29562f950eacb999e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.256543 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:17.259347 21916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.259197 21892 leader_election.cc:343] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.261540 21839 tablet_service.cc:1511] Processing CreateTablet for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:17.262845 21839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.272552 21837 tablet_service.cc:1511] Processing CreateTablet for tablet 947619c833644483a9745291e5d8ba38 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:17.273936 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947619c833644483a9745291e5d8ba38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.284195 22042 tablet_bootstrap.cc:492] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:17.297976 21842 tablet_service.cc:1511] Processing CreateTablet for tablet cba6603cbc59405eabb68cb5355bb01e (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:17.299337 21842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba6603cbc59405eabb68cb5355bb01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.301388 22044 tablet_bootstrap.cc:492] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:17.312158 22043 tablet_bootstrap.cc:492] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:17.312165 21908 tablet_service.cc:1511] Processing CreateTablet for tablet 947619c833644483a9745291e5d8ba38 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:17.312841 22043 ts_tablet_manager.cc:1403] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.157s	user 0.009s	sys 0.004s
I20260709 12:09:17.313624 21908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947619c833644483a9745291e5d8ba38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.315557 22043 raft_consensus.cc:359] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.316215 22043 raft_consensus.cc:385] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.319998 22043 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.320987 22043 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.323349 22043 ts_tablet_manager.cc:1434] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:17.323701 22042 tablet_bootstrap.cc:654] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.324455 22043 tablet_bootstrap.cc:492] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:17.322263 22044 tablet_bootstrap.cc:654] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.336861 21915 tablet_service.cc:1511] Processing CreateTablet for tablet cba6603cbc59405eabb68cb5355bb01e (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:17.338231 21915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba6603cbc59405eabb68cb5355bb01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.344545 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:17.344552 21837 tablet_service.cc:1511] Processing CreateTablet for tablet a6e5de589d8b434b87a0bf4f41fb63ba (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:17.345861 21927 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:17.345144 22050 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.346552 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e5de589d8b434b87a0bf4f41fb63ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.346638 22050 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.348706 22050 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.350559 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:17.351977 22043 tablet_bootstrap.cc:654] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:17.352183 21964 leader_election.cc:343] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.351887 21910 tablet_service.cc:1511] Processing CreateTablet for tablet a6e5de589d8b434b87a0bf4f41fb63ba (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:17.353467 21964 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:17.354346 22050 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.355327 22050 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.355758 22050 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.361583 21839 tablet_service.cc:1511] Processing CreateTablet for tablet f74e6f0a66904748bff04fe46aed7685 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:17.362901 21910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e5de589d8b434b87a0bf4f41fb63ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.365499 21914 tablet_service.cc:1511] Processing CreateTablet for tablet f74e6f0a66904748bff04fe46aed7685 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:17.374645 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74e6f0a66904748bff04fe46aed7685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.370687 22050 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.362896 21839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74e6f0a66904748bff04fe46aed7685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.384806 21837 tablet_service.cc:1511] Processing CreateTablet for tablet 68b43b3517064c3b81e50b88c21938ce (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:17.386173 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b43b3517064c3b81e50b88c21938ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.386561 21989 tablet_service.cc:1511] Processing CreateTablet for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:17.388197 21989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.392182 22049 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.392678 22049 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.396339 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:09:17.397732 21815 leader_election.cc:343] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.398569 22049 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:17.400041 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:17.400421 21908 tablet_service.cc:1511] Processing CreateTablet for tablet 68b43b3517064c3b81e50b88c21938ce (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:09:17.401448 21817 leader_election.cc:343] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.401683 21908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b43b3517064c3b81e50b88c21938ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.401894 21817 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:17.404470 22049 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.413004 22044 tablet_bootstrap.cc:492] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:17.413511 22044 ts_tablet_manager.cc:1403] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.020s
I20260709 12:09:17.413785 21837 tablet_service.cc:1511] Processing CreateTablet for tablet 1238ec38c933498cadf6153a5554f6e0 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:17.415688 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1238ec38c933498cadf6153a5554f6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.416558 22044 raft_consensus.cc:359] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.417263 22044 raft_consensus.cc:385] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.417542 22044 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.418372 22044 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.420786 22044 ts_tablet_manager.cc:1434] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:17.421746 22044 tablet_bootstrap.cc:492] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:17.423861 22050 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.426031 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:17.426627 21927 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.426364 21986 tablet_service.cc:1511] Processing CreateTablet for tablet a6e5de589d8b434b87a0bf4f41fb63ba (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:17.427026 21990 tablet_service.cc:1511] Processing CreateTablet for tablet cba6603cbc59405eabb68cb5355bb01e (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:17.427685 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e5de589d8b434b87a0bf4f41fb63ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.428815 21991 tablet_service.cc:1511] Processing CreateTablet for tablet 947619c833644483a9745291e5d8ba38 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:17.430061 21991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947619c833644483a9745291e5d8ba38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.430768 21990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba6603cbc59405eabb68cb5355bb01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.436416 21910 tablet_service.cc:1511] Processing CreateTablet for tablet 1238ec38c933498cadf6153a5554f6e0 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:17.436887 21927 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:17.437801 21910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1238ec38c933498cadf6153a5554f6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.438158 21964 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:17.440063 21987 tablet_service.cc:1511] Processing CreateTablet for tablet f74e6f0a66904748bff04fe46aed7685 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:17.440292 21982 tablet_service.cc:1511] Processing CreateTablet for tablet 68b43b3517064c3b81e50b88c21938ce (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:17.441540 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:17.442247 22001 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:17.443763 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:17.445032 21982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b43b3517064c3b81e50b88c21938ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.445263 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:17.445981 21851 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:17.447481 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:17.450481 22044 tablet_bootstrap.cc:654] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.452330 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74e6f0a66904748bff04fe46aed7685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.453871 21892 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:17.457670 22048 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.458027 22048 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.457903 21837 tablet_service.cc:1511] Processing CreateTablet for tablet 6edcbe9f33b9434baee189a40cf203b1 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:17.458359 22048 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.459062 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6edcbe9f33b9434baee189a40cf203b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.454208 22050 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.469401 21984 tablet_service.cc:1511] Processing CreateTablet for tablet 1238ec38c933498cadf6153a5554f6e0 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:17.470755 21984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1238ec38c933498cadf6153a5554f6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.476127 21917 tablet_service.cc:1511] Processing CreateTablet for tablet 6edcbe9f33b9434baee189a40cf203b1 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:17.477443 21917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6edcbe9f33b9434baee189a40cf203b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.478286 21911 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7b85a6bcce421ebd09faebda5437e0 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:17.479574 21911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7b85a6bcce421ebd09faebda5437e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.479859 21838 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3beb28cf484708af67a4cafaaa657b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:17.481061 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3beb28cf484708af67a4cafaaa657b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.481724 22048 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
I20260709 12:09:17.484432 21836 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7b85a6bcce421ebd09faebda5437e0 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:17.485683 21836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7b85a6bcce421ebd09faebda5437e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.476158 21916 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3beb28cf484708af67a4cafaaa657b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:17.487789 21916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3beb28cf484708af67a4cafaaa657b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.501116 22048 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
W20260709 12:09:17.501976 21966 leader_election.cc:343] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.502178 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:09:17.503630 21892 leader_election.cc:343] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.505484 22043 tablet_bootstrap.cc:492] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:17.505533 21915 tablet_service.cc:1511] Processing CreateTablet for tablet f1837f1c346048738233aa4a75fc384d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:17.507128 21915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1837f1c346048738233aa4a75fc384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.506145 22043 ts_tablet_manager.cc:1403] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.182s	user 0.010s	sys 0.009s
I20260709 12:09:17.509492 21842 tablet_service.cc:1511] Processing CreateTablet for tablet f1837f1c346048738233aa4a75fc384d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:17.521318 22042 tablet_bootstrap.cc:492] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:17.523186 22042 ts_tablet_manager.cc:1403] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.239s	user 0.022s	sys 0.016s
I20260709 12:09:17.527784 21842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1837f1c346048738233aa4a75fc384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.541344 21912 tablet_service.cc:1511] Processing CreateTablet for tablet f2e5283f63d24660b50b74440e20aef8 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:17.542665 21912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e5283f63d24660b50b74440e20aef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.546020 21914 tablet_service.cc:1511] Processing CreateTablet for tablet 209865ca9a104769a09f3a5f4a1e8b79 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:17.547382 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 209865ca9a104769a09f3a5f4a1e8b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.549350 21833 tablet_service.cc:1511] Processing CreateTablet for tablet 209865ca9a104769a09f3a5f4a1e8b79 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:17.549425 21909 tablet_service.cc:1511] Processing CreateTablet for tablet 207491536b034836987ee3a520d08ff6 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:17.550840 21909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207491536b034836987ee3a520d08ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.551332 21835 tablet_service.cc:1511] Processing CreateTablet for tablet 207491536b034836987ee3a520d08ff6 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:17.560345 21837 tablet_service.cc:1511] Processing CreateTablet for tablet f2e5283f63d24660b50b74440e20aef8 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 12:09:17.562664 21798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:17.533103 22050 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:17.575552 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 209865ca9a104769a09f3a5f4a1e8b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.575846 21841 tablet_service.cc:1511] Processing CreateTablet for tablet ff3fa17120b9481fbb27a63e11e13340 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:17.577771 21914 tablet_service.cc:1511] Processing CreateTablet for tablet ff3fa17120b9481fbb27a63e11e13340 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:17.578828 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3fa17120b9481fbb27a63e11e13340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.580557 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e5283f63d24660b50b74440e20aef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.586383 21841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3fa17120b9481fbb27a63e11e13340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.589201 21909 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7beebb504f4966b0b73ec1fd85c8d1 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:17.590471 21909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7beebb504f4966b0b73ec1fd85c8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.590893 21835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207491536b034836987ee3a520d08ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.596179 21839 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7beebb504f4966b0b73ec1fd85c8d1 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:17.597414 21839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7beebb504f4966b0b73ec1fd85c8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.607193 22050 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.608237 22044 tablet_bootstrap.cc:492] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:17.608726 22044 ts_tablet_manager.cc:1403] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.187s	user 0.013s	sys 0.009s
I20260709 12:09:17.611693 22044 raft_consensus.cc:359] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.612566 22044 raft_consensus.cc:385] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.612910 22044 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.613653 22044 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.615633 22044 ts_tablet_manager.cc:1434] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:17.618273 22044 tablet_bootstrap.cc:492] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:17.620911 22042 raft_consensus.cc:359] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.621649 22042 raft_consensus.cc:385] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.621935 22042 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.566867 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:17.623090 22070 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.622761 22043 raft_consensus.cc:359] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.623471 22070 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.623538 22043 raft_consensus.cc:385] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.623859 22070 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.623909 22043 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
W20260709 12:09:17.625516 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 90727us
I20260709 12:09:17.630542 22070 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.633502 22070 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.633749 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:09:17.626339 21966 leader_election.cc:343] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.635237 21964 leader_election.cc:343] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.635038 22043 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.637442 22043 ts_tablet_manager.cc:1434] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.002s
I20260709 12:09:17.637738 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:17.638057 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:17.640031 21986 tablet_service.cc:1511] Processing CreateTablet for tablet 6edcbe9f33b9434baee189a40cf203b1 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:17.641938 21990 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3beb28cf484708af67a4cafaaa657b (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:17.643446 22001 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.643855 21850 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.643621 22042 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.645556 21990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3beb28cf484708af67a4cafaaa657b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.653280 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6edcbe9f33b9434baee189a40cf203b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.647208 21982 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7b85a6bcce421ebd09faebda5437e0 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:17.658074 21982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7b85a6bcce421ebd09faebda5437e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.660475 22043 tablet_bootstrap.cc:492] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:17.660881 22050 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.663187 22050 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.649524 22044 tablet_bootstrap.cc:654] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.657008 21850 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:17.671401 22042 ts_tablet_manager.cc:1434] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.146s	user 0.002s	sys 0.006s
I20260709 12:09:17.672739 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:17.672803 21989 tablet_service.cc:1511] Processing CreateTablet for tablet f1837f1c346048738233aa4a75fc384d (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:17.674093 21989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1837f1c346048738233aa4a75fc384d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.674165 21964 leader_election.cc:343] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.674851 22050 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.676961 22042 tablet_bootstrap.cc:492] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:17.674115 22001 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:17.686955 22042 tablet_bootstrap.cc:654] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.687083 21987 tablet_service.cc:1511] Processing CreateTablet for tablet f2e5283f63d24660b50b74440e20aef8 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:17.687655 21991 tablet_service.cc:1511] Processing CreateTablet for tablet 209865ca9a104769a09f3a5f4a1e8b79 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:17.688393 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e5283f63d24660b50b74440e20aef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.693385 22043 tablet_bootstrap.cc:654] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.694741 22042 tablet_bootstrap.cc:492] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:17.695304 22042 ts_tablet_manager.cc:1403] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:09:17.695525 21984 tablet_service.cc:1511] Processing CreateTablet for tablet 207491536b034836987ee3a520d08ff6 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:17.696810 21984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207491536b034836987ee3a520d08ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.698482 22042 raft_consensus.cc:359] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.699273 22042 raft_consensus.cc:385] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.699618 22042 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.700533 22042 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.701555 21982 tablet_service.cc:1511] Processing CreateTablet for tablet ff3fa17120b9481fbb27a63e11e13340 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:17.702847 21982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3fa17120b9481fbb27a63e11e13340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.702878 22042 ts_tablet_manager.cc:1434] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:17.704136 22042 tablet_bootstrap.cc:492] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:17.707844 21987 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7beebb504f4966b0b73ec1fd85c8d1 (DEFAULT_TABLE table=test-workload [id=972f15b6d1324875aea51ac58b88c06c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:17.708472 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:17.712455 21850 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:17.713104 22044 tablet_bootstrap.cc:492] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:17.713606 22044 ts_tablet_manager.cc:1403] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.001s
I20260709 12:09:17.714273 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7beebb504f4966b0b73ec1fd85c8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.709932 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:17.710692 21892 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:17.717350 21991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 209865ca9a104769a09f3a5f4a1e8b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.717280 22048 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.711000 21750 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.719828 22042 tablet_bootstrap.cc:654] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.723577 22050 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.724205 22050 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:17.725296 22050 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.731418 22042 tablet_bootstrap.cc:492] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:17.732002 22042 ts_tablet_manager.cc:1403] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.006s
I20260709 12:09:17.735064 22042 raft_consensus.cc:359] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.735954 22042 raft_consensus.cc:385] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.736341 22042 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.737222 22042 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.735980 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:17.739627 22050 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.740049 22050 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.740442 22050 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.740650 22048 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:17.741552 22048 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
I20260709 12:09:17.716652 22044 raft_consensus.cc:359] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
I20260709 12:09:17.743490 22044 raft_consensus.cc:385] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.743818 22044 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.749505 22049 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.750026 22049 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.750268 22050 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.752125 22049 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:17.752897 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:17.753822 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:17.753585 22044 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
W20260709 12:09:17.754377 21815 leader_election.cc:343] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.755234 21817 leader_election.cc:343] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.755647 21817 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:17.755863 22044 ts_tablet_manager.cc:1434] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:09:17.755863 22042 ts_tablet_manager.cc:1434] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.003s
I20260709 12:09:17.755993 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:17.756731 21850 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.757751 22042 tablet_bootstrap.cc:492] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:17.758536 22043 tablet_bootstrap.cc:492] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:17.758993 22043 ts_tablet_manager.cc:1403] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.099s	user 0.002s	sys 0.009s
I20260709 12:09:17.760257 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:09:17.761649 21964 leader_election.cc:343] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.767994 22042 tablet_bootstrap.cc:654] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.768335 22050 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.768317 21850 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:17.771072 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:17.771847 22050 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.772185 22049 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.772478 22050 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:17.773720 22044 tablet_bootstrap.cc:492] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:17.773440 22050 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.761826 22043 raft_consensus.cc:359] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.777506 22043 raft_consensus.cc:385] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.777842 22043 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.778707 22043 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.780732 22042 tablet_bootstrap.cc:492] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:17.781261 22042 ts_tablet_manager.cc:1403] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 12:09:17.784061 22042 raft_consensus.cc:359] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.784911 22042 raft_consensus.cc:385] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.785257 22042 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.785784 22043 ts_tablet_manager.cc:1434] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:09:17.786234 22042 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.788648 22042 ts_tablet_manager.cc:1434] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:17.789685 22042 tablet_bootstrap.cc:492] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:17.791401 22044 tablet_bootstrap.cc:654] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.786826 22043 tablet_bootstrap.cc:492] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:17.787916 21749 catalog_manager.cc:5697] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.797641 22044 tablet_bootstrap.cc:492] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:17.798125 22044 ts_tablet_manager.cc:1403] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 12:09:17.801167 22044 raft_consensus.cc:359] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.801939 22044 raft_consensus.cc:385] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.802397 22044 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.803187 22044 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.803968 22042 tablet_bootstrap.cc:654] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.805563 22044 ts_tablet_manager.cc:1434] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:17.802006 22043 tablet_bootstrap.cc:654] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.806893 22044 tablet_bootstrap.cc:492] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:17.815267 22044 tablet_bootstrap.cc:654] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.816391 22042 tablet_bootstrap.cc:492] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:17.817003 22042 ts_tablet_manager.cc:1403] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
I20260709 12:09:17.820006 22042 raft_consensus.cc:359] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.820696 22042 raft_consensus.cc:385] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.821018 22042 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.821930 22042 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.824545 22042 ts_tablet_manager.cc:1434] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:09:17.825578 22042 tablet_bootstrap.cc:492] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:17.826835 22044 tablet_bootstrap.cc:492] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:17.827323 22044 ts_tablet_manager.cc:1403] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 12:09:17.830344 22044 raft_consensus.cc:359] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.831094 22044 raft_consensus.cc:385] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.831418 22044 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.833176 22042 tablet_bootstrap.cc:654] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.832106 22044 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.835594 22043 tablet_bootstrap.cc:492] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:17.836130 22043 ts_tablet_manager.cc:1403] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.017s
I20260709 12:09:17.837165 22044 ts_tablet_manager.cc:1434] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:17.838464 22044 tablet_bootstrap.cc:492] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:17.839212 22043 raft_consensus.cc:359] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.840005 22043 raft_consensus.cc:385] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.840350 22043 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.841114 22043 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.843696 22043 ts_tablet_manager.cc:1434] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:09:17.844691 22043 tablet_bootstrap.cc:492] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:17.848255 22044 tablet_bootstrap.cc:654] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.848145 21749 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.850064 21749 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.853408 22043 tablet_bootstrap.cc:654] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.855657 22082 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.856154 22082 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.856958 22048 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.857586 22048 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.859951 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:17.860301 22048 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:17.860998 21927 raft_consensus.cc:2393] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 1: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:09:17.862114 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:09:17.863430 21892 leader_election.cc:343] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.863806 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:17.865136 22050 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.865768 22050 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:17.869275 21892 leader_election.cc:343] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.869879 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:17.871910 22048 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.872354 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:17.872849 22050 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.873308 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:17.873898 21966 leader_election.cc:343] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.874944 21817 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:17.876022 22049 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.879014 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:17.879830 21927 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:17.881459 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:17.882606 22050 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.883042 22050 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.883505 22050 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.908607 22095 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.909343 22095 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } }
I20260709 12:09:17.909880 22049 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.910562 22082 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:17.913115 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:17.913870 22001 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 1: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:09:17.897935 22050 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.916967 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:17.918525 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:17.918540 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:17.920042 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:17.920574 21927 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:17.920668 21966 leader_election.cc:343] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.921787 22095 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.922982 22095 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.926564 22050 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.929874 21927 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:17.931154 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:17.931212 22048 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.932301 22050 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.931931 22048 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.932984 22050 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:17.933882 22050 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.934757 22048 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:17.937180 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:17.938606 21892 leader_election.cc:343] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.939402 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:17.940122 21850 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:17.941386 22042 tablet_bootstrap.cc:492] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:17.941187 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:17.941785 22042 ts_tablet_manager.cc:1403] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.116s	user 0.063s	sys 0.045s
I20260709 12:09:17.942001 22048 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.942350 22048 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.942704 22048 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.944439 22042 raft_consensus.cc:359] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.945092 22042 raft_consensus.cc:385] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.945358 22042 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.946329 22095 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.946115 22042 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.947928 22043 tablet_bootstrap.cc:492] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:17.948288 22044 tablet_bootstrap.cc:492] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:17.948375 22043 ts_tablet_manager.cc:1403] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.031s
I20260709 12:09:17.948755 22044 ts_tablet_manager.cc:1403] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.111s	user 0.038s	sys 0.027s
I20260709 12:09:17.950744 22042 ts_tablet_manager.cc:1434] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:17.951339 22044 raft_consensus.cc:359] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.951603 22042 tablet_bootstrap.cc:492] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:17.951989 22044 raft_consensus.cc:385] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.951571 22043 raft_consensus.cc:359] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.952257 22044 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.952338 22043 raft_consensus.cc:385] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.952656 22043 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.952980 22044 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.953388 22043 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.955905 22043 ts_tablet_manager.cc:1434] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:17.959337 22043 tablet_bootstrap.cc:492] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:17.982511 22044 ts_tablet_manager.cc:1434] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.033s	user 0.022s	sys 0.003s
I20260709 12:09:17.962718 21749 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.984575 22042 tablet_bootstrap.cc:654] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.985186 22048 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.986588 22043 tablet_bootstrap.cc:654] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.987442 22044 tablet_bootstrap.cc:492] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:17.990041 22042 tablet_bootstrap.cc:492] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:17.989887 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:17.990482 22042 ts_tablet_manager.cc:1403] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.039s	user 0.026s	sys 0.009s
I20260709 12:09:17.990450 21850 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.993400 22044 tablet_bootstrap.cc:654] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.993141 22042 raft_consensus.cc:359] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.993778 22042 raft_consensus.cc:385] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.994042 22042 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.994663 22050 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.994817 22042 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.995123 22050 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:17.997166 22050 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:17.998726 22079 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.999157 22079 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.001052 22079 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.002656 22042 ts_tablet_manager.cc:1434] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:18.003549 22042 tablet_bootstrap.cc:492] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.004643 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:18.005239 21927 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:18.006570 21964 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:18.009008 22042 tablet_bootstrap.cc:654] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.012724 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.012719 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.014055 22050 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.014611 22050 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.015048 22050 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.021700 22042 tablet_bootstrap.cc:492] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.022197 22042 ts_tablet_manager.cc:1403] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.006s
I20260709 12:09:18.022763 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.023581 21851 raft_consensus.cc:2393] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 1: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:09:18.025544 21892 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:18.026350 22079 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.023145 21966 leader_election.cc:343] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.034868 22079 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.039811 22042 raft_consensus.cc:359] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.041373 22042 raft_consensus.cc:385] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.042529 22042 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.045933 22042 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.047535 22044 tablet_bootstrap.cc:492] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.047639 22042 ts_tablet_manager.cc:1434] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:09:18.048020 22044 ts_tablet_manager.cc:1403] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.040s
I20260709 12:09:18.042125 22048 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.043622 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:18.049737 22043 tablet_bootstrap.cc:492] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:18.050177 22043 ts_tablet_manager.cc:1403] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.091s	user 0.028s	sys 0.049s
W20260709 12:09:18.050068 21892 leader_election.cc:343] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.037968 22050 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.040904 21850 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:18.050755 22044 raft_consensus.cc:359] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.061971 22044 raft_consensus.cc:385] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.055298 22042 tablet_bootstrap.cc:492] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.062274 22044 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.063010 22044 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.063633 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:18.064960 22044 ts_tablet_manager.cc:1434] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.017s	user 0.013s	sys 0.003s
W20260709 12:09:18.065264 21966 leader_election.cc:343] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.066220 22044 tablet_bootstrap.cc:492] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.068745 22042 tablet_bootstrap.cc:654] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.071044 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:18.072350 22044 tablet_bootstrap.cc:654] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.076187 22048 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.076730 22048 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:18.077600 22048 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.082054 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:18.082684 21927 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.063865 22043 raft_consensus.cc:359] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.083712 22043 raft_consensus.cc:385] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.083994 22043 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.084782 22043 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.086848 22043 ts_tablet_manager.cc:1434] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:09:18.087939 22043 tablet_bootstrap.cc:492] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:18.089558 22044 tablet_bootstrap.cc:492] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.090056 22044 ts_tablet_manager.cc:1403] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.012s
I20260709 12:09:18.090745 22070 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.091499 21927 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:18.092645 21964 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:18.092734 22044 raft_consensus.cc:359] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.093520 22043 tablet_bootstrap.cc:654] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.093603 22044 raft_consensus.cc:385] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.093643 22070 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.094643 22050 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:18.097206 22044 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.098696 22044 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.101547 22042 tablet_bootstrap.cc:492] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.102061 22042 ts_tablet_manager.cc:1403] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.012s
I20260709 12:09:18.103195 22044 ts_tablet_manager.cc:1434] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:09:18.105042 22042 raft_consensus.cc:359] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.105728 22042 raft_consensus.cc:385] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.105988 22042 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.106971 22044 tablet_bootstrap.cc:492] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.106654 22042 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.109462 22042 ts_tablet_manager.cc:1434] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:18.110538 22042 tablet_bootstrap.cc:492] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.116149 22070 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:18.116257 22079 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.116899 22079 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.120371 22043 tablet_bootstrap.cc:492] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:18.120386 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.120713 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.120966 22043 ts_tablet_manager.cc:1403] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
I20260709 12:09:18.121172 21850 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:18.121742 22079 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.121236 22001 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:18.122469 22042 tablet_bootstrap.cc:654] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.122339 21892 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:18.123682 22043 raft_consensus.cc:359] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.124399 22043 raft_consensus.cc:385] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.124652 22043 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.124805 22079 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.125218 22079 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.125640 22079 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.125335 22043 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.123538 22070 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.128772 21749 catalog_manager.cc:5697] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.130872 22050 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.133859 22044 tablet_bootstrap.cc:654] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.135742 22043 ts_tablet_manager.cc:1434] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:18.146312 22043 tablet_bootstrap.cc:492] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:18.147464 22103 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:18.153466 22095 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.153976 22095 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.156073 22095 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.155814 22079 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.157898 22079 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.157855 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.158617 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:18.158740 22001 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:18.159232 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:18.159265 21851 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.160007 22000 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.160948 21817 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:18.162142 22049 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.162781 22049 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.163213 22049 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.167232 22000 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:18.168479 21892 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:18.169505 22079 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.169960 22079 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:18.170897 21851 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:18.170821 22079 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.172158 21925 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.172899 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:18.175014 22049 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.173586 21926 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:18.182550 22103 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.183115 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:18.183817 22000 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.190613 22049 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.192302 21748 catalog_manager.cc:5697] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.201784 22043 tablet_bootstrap.cc:654] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.201875 22000 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:18.193320 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:18.203204 21926 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.203981 21747 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.205446 21817 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:18.206775 22049 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.207473 22049 raft_consensus.cc:697] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:18.208415 22049 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.213927 22042 tablet_bootstrap.cc:492] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.214484 22042 ts_tablet_manager.cc:1403] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.013s
I20260709 12:09:18.215497 22044 tablet_bootstrap.cc:492] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.215961 22044 ts_tablet_manager.cc:1403] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.109s	user 0.007s	sys 0.003s
I20260709 12:09:18.220127 22042 raft_consensus.cc:359] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.220817 22042 raft_consensus.cc:385] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.221061 22042 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.227566 22103 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.233309 22042 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.239490 22044 raft_consensus.cc:359] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.240831 22044 raft_consensus.cc:385] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.241210 22044 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.244828 21926 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:18.242081 22044 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.245445 22050 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.249693 22042 ts_tablet_manager.cc:1434] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:09:18.251250 22042 tablet_bootstrap.cc:492] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.252547 22079 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.255589 22111 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.262842 22043 tablet_bootstrap.cc:492] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:18.263523 22043 ts_tablet_manager.cc:1403] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.024s
I20260709 12:09:18.256373 22111 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.275032 22044 ts_tablet_manager.cc:1434] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.000s
I20260709 12:09:18.276396 22044 tablet_bootstrap.cc:492] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.279364 22095 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.277638 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.281127 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:18.283146 21852 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:18.283375 21924 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:18.281664 22095 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.284615 21966 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:18.274464 22111 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:18.287084 22095 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.285575 22050 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.287756 22050 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.289625 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.288596 22050 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.292742 21750 catalog_manager.cc:5697] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:18.295339 21817 leader_election.cc:343] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.356842 22042 tablet_bootstrap.cc:654] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.370119 22050 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.371006 22048 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.375192 22082 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.376654 22082 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.380774 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.384739 22082 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.386977 22048 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.387624 22048 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.406912 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:09:18.409415 21892 leader_election.cc:343] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.418836 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:18.419713 21927 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.419171 22044 tablet_bootstrap.cc:654] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.420912 22043 raft_consensus.cc:359] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.421572 22043 raft_consensus.cc:385] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.421900 22043 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.423837 22043 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.431540 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:18.432205 21849 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.421628 22050 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:18.436838 22043 ts_tablet_manager.cc:1434] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.173s	user 0.007s	sys 0.008s
I20260709 12:09:18.434379 22048 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.441403 22043 tablet_bootstrap.cc:492] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:18.432500 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:18.443130 21926 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 1: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:09:18.444377 21815 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:18.446866 21848 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.452088 21927 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:18.440793 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:09:18.454517 22121 log.cc:927] Time spent T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.053s	user 0.000s	sys 0.006s
I20260709 12:09:18.454778 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:18.457943 22050 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.458303 22050 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:18.458971 22050 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.459705 22049 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.460134 22049 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.462246 22049 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.455407 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:18.463896 21892 leader_election.cc:343] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.464121 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:18.464347 21892 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:18.464995 21927 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 1: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:09:18.465441 22048 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.465575 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.467486 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:18.468627 22049 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.470242 22032 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.20.56.126:35507, user_credentials={real_user=slave}} blocked reactor thread for 127569us
I20260709 12:09:18.455849 21924 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:18.473448 22095 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.475248 22111 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.477629 22049 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.478816 21815 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:18.479626 22049 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.480825 22049 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.481237 22049 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.481271 22111 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.488583 21849 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:18.494079 21750 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.496841 22042 tablet_bootstrap.cc:492] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.498327 22042 ts_tablet_manager.cc:1403] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.247s	user 0.015s	sys 0.007s
I20260709 12:09:18.508879 22042 raft_consensus.cc:359] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.509680 22042 raft_consensus.cc:385] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.510360 22042 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.514201 22042 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.517752 22043 tablet_bootstrap.cc:654] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.522722 22049 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.524199 22042 ts_tablet_manager.cc:1434] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:09:18.525516 22042 tablet_bootstrap.cc:492] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.526150 22044 tablet_bootstrap.cc:492] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.526643 22044 ts_tablet_manager.cc:1403] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.251s	user 0.024s	sys 0.006s
I20260709 12:09:18.531947 22049 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.532946 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:18.533533 22000 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.534768 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:18.534601 22044 raft_consensus.cc:359] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.535295 21927 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.535297 22044 raft_consensus.cc:385] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.535799 22044 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.536480 22044 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.538437 22044 ts_tablet_manager.cc:1434] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:18.539254 22044 tablet_bootstrap.cc:492] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.540632 22000 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:18.541267 22042 tablet_bootstrap.cc:654] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.541703 21927 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:18.541862 21817 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:18.543090 22095 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.543586 22095 raft_consensus.cc:697] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:18.544384 22095 consensus_queue.cc:237] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.546856 22044 tablet_bootstrap.cc:654] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.551971 22050 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:18.567602 21798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:09:18.568809 21892 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.571630 22042 tablet_bootstrap.cc:492] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.572106 22042 ts_tablet_manager.cc:1403] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.013s
I20260709 12:09:18.574692 22042 raft_consensus.cc:359] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.575433 22044 tablet_bootstrap.cc:492] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.575850 22044 ts_tablet_manager.cc:1403] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.013s
I20260709 12:09:18.578599 22050 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.575340 22042 raft_consensus.cc:385] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.579401 22042 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.579598 22044 raft_consensus.cc:359] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.580354 22044 raft_consensus.cc:385] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.577265 21748 catalog_manager.cc:5697] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.580081 22042 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.580601 22044 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.581240 22044 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.582747 22042 ts_tablet_manager.cc:1434] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:09:18.583211 22044 ts_tablet_manager.cc:1434] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:18.583670 22042 tablet_bootstrap.cc:492] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.584048 22044 tablet_bootstrap.cc:492] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.595654 22048 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.617599 22043 tablet_bootstrap.cc:492] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:18.618124 22043 ts_tablet_manager.cc:1403] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.177s	user 0.022s	sys 0.004s
I20260709 12:09:18.618516 22042 tablet_bootstrap.cc:654] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.618513 22044 tablet_bootstrap.cc:654] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.620793 22043 raft_consensus.cc:359] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.621481 22043 raft_consensus.cc:385] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.621755 22043 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.622372 22043 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.624496 22043 ts_tablet_manager.cc:1434] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:18.625517 22043 tablet_bootstrap.cc:492] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:18.628432 22044 tablet_bootstrap.cc:492] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.629051 22044 ts_tablet_manager.cc:1403] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 12:09:18.633057 22043 tablet_bootstrap.cc:654] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.633026 22044 raft_consensus.cc:359] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.634085 22044 raft_consensus.cc:385] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.634460 22044 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.635354 22044 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.638829 22044 ts_tablet_manager.cc:1434] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:09:18.639708 22044 tablet_bootstrap.cc:492] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.638615 22042 tablet_bootstrap.cc:492] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.642988 22042 ts_tablet_manager.cc:1403] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.024s
I20260709 12:09:18.643923 22135 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.644423 22135 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.645555 22044 tablet_bootstrap.cc:654] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.645540 22042 raft_consensus.cc:359] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.646332 22042 raft_consensus.cc:385] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.646634 22042 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.647820 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:18.647470 22042 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.648458 21927 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:18.649727 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:18.651522 22050 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.651942 22050 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.652328 22050 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.654687 22042 ts_tablet_manager.cc:1434] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:18.655675 22042 tablet_bootstrap.cc:492] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.646633 22135 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:18.656134 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.657743 22044 tablet_bootstrap.cc:492] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
W20260709 12:09:18.658171 21966 leader_election.cc:343] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.658209 22044 ts_tablet_manager.cc:1403] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:09:18.661341 22042 tablet_bootstrap.cc:654] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.661048 22044 raft_consensus.cc:359] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.661757 22044 raft_consensus.cc:385] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.662040 22044 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.662767 22044 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.665014 22044 ts_tablet_manager.cc:1434] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:18.665227 22050 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.665804 22044 tablet_bootstrap.cc:492] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.668454 22043 tablet_bootstrap.cc:492] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:18.668953 22043 ts_tablet_manager.cc:1403] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.013s
I20260709 12:09:18.670943 22042 tablet_bootstrap.cc:492] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.671372 22042 ts_tablet_manager.cc:1403] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.002s
I20260709 12:09:18.672472 22044 tablet_bootstrap.cc:654] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.672269 22043 raft_consensus.cc:359] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.673183 22043 raft_consensus.cc:385] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.673941 22042 raft_consensus.cc:359] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.677731 22042 raft_consensus.cc:385] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.678176 22042 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.678865 22042 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.679584 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:18.680809 22042 ts_tablet_manager.cc:1434] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:18.682305 22042 tablet_bootstrap.cc:492] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
W20260709 12:09:18.680909 21966 leader_election.cc:343] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.687985 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:18.688573 21927 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.677699 22043 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.696045 22043 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.708496 22042 tablet_bootstrap.cc:654] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.710896 22043 ts_tablet_manager.cc:1434] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 12:09:18.712170 22043 tablet_bootstrap.cc:492] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:18.712280 22123 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.717376 22079 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.719017 22044 tablet_bootstrap.cc:492] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.719521 22044 ts_tablet_manager.cc:1403] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.023s
I20260709 12:09:18.723023 22043 tablet_bootstrap.cc:654] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.722774 22044 raft_consensus.cc:359] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.723446 22044 raft_consensus.cc:385] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.723735 22044 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.724763 22044 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.726254 21927 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:18.727661 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:18.728438 22044 ts_tablet_manager.cc:1434] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:18.729197 22042 tablet_bootstrap.cc:492] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.729338 22044 tablet_bootstrap.cc:492] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.729619 22042 ts_tablet_manager.cc:1403] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.008s
I20260709 12:09:18.729411 22070 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.730985 22070 raft_consensus.cc:697] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:18.731894 22070 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.732398 22042 raft_consensus.cc:359] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.733036 22042 raft_consensus.cc:385] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.733271 22042 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.733879 22042 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.734838 22095 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.735421 22042 ts_tablet_manager.cc:1434] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:09:18.736388 22042 tablet_bootstrap.cc:492] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.738719 22044 tablet_bootstrap.cc:654] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.745935 22050 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:18.750118 22043 tablet_bootstrap.cc:492] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:18.750631 22043 ts_tablet_manager.cc:1403] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.006s
I20260709 12:09:18.767143 22043 raft_consensus.cc:359] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.767836 22043 raft_consensus.cc:385] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.768103 22042 tablet_bootstrap.cc:654] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.768137 22043 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.797950 22043 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.799836 22044 tablet_bootstrap.cc:492] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.800309 22044 ts_tablet_manager.cc:1403] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.012s
I20260709 12:09:18.800386 22095 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.801123 22043 ts_tablet_manager.cc:1434] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.050s	user 0.019s	sys 0.016s
I20260709 12:09:18.802366 22043 tablet_bootstrap.cc:492] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:18.802935 22044 raft_consensus.cc:359] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.803575 22044 raft_consensus.cc:385] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.803836 22044 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.804623 22044 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.807735 22044 ts_tablet_manager.cc:1434] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:18.809129 22044 tablet_bootstrap.cc:492] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.811393 22043 tablet_bootstrap.cc:654] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.815483 22044 tablet_bootstrap.cc:654] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.820785 22048 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.821444 22048 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.823994 22050 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.824452 22050 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.824951 22044 tablet_bootstrap.cc:492] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.824800 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.825448 22044 ts_tablet_manager.cc:1403] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
W20260709 12:09:18.826815 21892 leader_election.cc:343] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.826946 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.828369 22048 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.828186 22044 raft_consensus.cc:359] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.828842 22044 raft_consensus.cc:385] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:18.829010 21892 leader_election.cc:343] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.829114 22044 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.829481 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:18.829823 22044 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.831835 22043 tablet_bootstrap.cc:492] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:18.832448 22043 ts_tablet_manager.cc:1403] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.012s
I20260709 12:09:18.832665 22044 ts_tablet_manager.cc:1434] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:18.832679 22050 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:18.833916 22044 tablet_bootstrap.cc:492] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.834182 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.834805 21852 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:18.836066 21966 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:18.835911 22043 raft_consensus.cc:359] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.836933 22050 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.836978 22043 raft_consensus.cc:385] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.837276 22048 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.837393 22050 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.837560 22043 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.837886 22050 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.838773 22043 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.841812 22043 ts_tablet_manager.cc:1434] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:09:18.842972 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:18.843873 21924 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:18.842973 22043 tablet_bootstrap.cc:492] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:18.845286 22050 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.844086 21750 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.852891 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:18.853029 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:18.853459 21924 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.853524 21852 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.860543 21924 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:18.860829 22050 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:18.850200 22044 tablet_bootstrap.cc:654] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.860543 21852 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:18.863632 22042 tablet_bootstrap.cc:492] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.864099 22042 ts_tablet_manager.cc:1403] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.128s	user 0.041s	sys 0.060s
I20260709 12:09:18.864480 22043 tablet_bootstrap.cc:654] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.866972 22042 raft_consensus.cc:359] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.867761 22042 raft_consensus.cc:385] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.868036 22042 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.868809 22042 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.868938 21966 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:18.870508 22050 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.871124 22050 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:18.872236 22050 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.873337 22042 ts_tablet_manager.cc:1434] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:18.879997 22042 tablet_bootstrap.cc:492] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.883422 22095 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.884663 22043 tablet_bootstrap.cc:492] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:18.884104 22095 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.886572 22095 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.887588 22042 tablet_bootstrap.cc:654] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.888484 22043 ts_tablet_manager.cc:1403] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.004s
I20260709 12:09:18.889067 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.891155 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:09:18.891567 21817 leader_election.cc:343] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.891853 21924 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:18.893103 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:18.894387 22095 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.894951 22095 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.895377 22095 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.899012 22123 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.899515 22123 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.901225 22042 tablet_bootstrap.cc:492] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.901881 22123 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.902181 22042 ts_tablet_manager.cc:1403] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.004s
I20260709 12:09:18.906347 22049 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.906330 22095 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.906962 22049 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.907725 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.908142 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.908463 21852 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:18.909030 22049 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.909327 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:18.909888 21927 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.910030 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:18.910152 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.910554 22043 raft_consensus.cc:359] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.911233 22043 raft_consensus.cc:385] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.911499 22043 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
W20260709 12:09:18.911561 21815 leader_election.cc:343] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.912235 21817 leader_election.cc:343] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.912187 22043 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.912712 21817 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:18.913724 22049 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.914283 22043 ts_tablet_manager.cc:1434] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.000s
I20260709 12:09:18.915208 22043 tablet_bootstrap.cc:492] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:18.915104 22042 raft_consensus.cc:359] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.915764 22042 raft_consensus.cc:385] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.916011 22042 raft_consensus.cc:740] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.916821 22042 consensus_queue.cc:260] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.918895 22042 ts_tablet_manager.cc:1434] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:18.918861 22050 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.919569 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:18.919936 22042 tablet_bootstrap.cc:492] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.919510 22050 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:18.920938 21817 leader_election.cc:343] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.921449 22095 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.921661 22050 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:18.922775 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:18.923386 21924 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
W20260709 12:09:18.923632 21892 leader_election.cc:343] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.924336 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:18.924613 21964 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:18.925171 22123 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.925390 22050 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.925550 22123 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.925869 22050 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.925992 22123 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.926278 22050 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.927335 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.928002 21852 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:18.928686 22042 tablet_bootstrap.cc:654] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.932487 22044 tablet_bootstrap.cc:492] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:18.932986 22044 ts_tablet_manager.cc:1403] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.029s
I20260709 12:09:18.932941 22050 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.935951 22044 raft_consensus.cc:359] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.936681 22044 raft_consensus.cc:385] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.937008 22044 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.937841 22044 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.939953 22044 ts_tablet_manager.cc:1434] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:18.940855 22044 tablet_bootstrap.cc:492] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:18.941128 21927 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:18.942258 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:18.943351 22095 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.943583 22042 tablet_bootstrap.cc:492] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:18.943902 22095 raft_consensus.cc:697] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:18.944862 22095 consensus_queue.cc:237] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.945529 22043 tablet_bootstrap.cc:654] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.944252 22042 ts_tablet_manager.cc:1403] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:09:18.947145 22044 tablet_bootstrap.cc:654] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.948499 22042 raft_consensus.cc:359] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.949863 22042 raft_consensus.cc:385] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.950210 22042 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.951241 22042 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.951661 21750 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.954185 22042 ts_tablet_manager.cc:1434] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:09:18.955075 22042 tablet_bootstrap.cc:492] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:18.957499 22103 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.959221 22079 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.959846 22079 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.962481 22079 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.964888 22043 tablet_bootstrap.cc:492] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:18.964834 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:18.965401 22043 ts_tablet_manager.cc:1403] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.010s
W20260709 12:09:18.966395 21892 leader_election.cc:343] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.967609 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:18.968093 22043 raft_consensus.cc:359] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.968736 22043 raft_consensus.cc:385] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:18.968937 21892 leader_election.cc:343] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.969025 22043 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.969432 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:18.969918 22043 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.970484 22079 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.973366 22042 tablet_bootstrap.cc:654] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.972149 22043 ts_tablet_manager.cc:1434] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:18.975306 22043 tablet_bootstrap.cc:492] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:18.942277 22123 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:18.984817 22123 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:18.984606 21749 catalog_manager.cc:5697] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.986768 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:18.987046 22050 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:18.987375 21848 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.993543 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:18.994129 21849 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.999480 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:19.000088 21924 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.997189 22111 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.004684 22111 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.006755 22111 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:19.017884 22050 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.020848 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:19.020704 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.022996 21927 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:09:19.024799 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.027346 22044 tablet_bootstrap.cc:492] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:19.027899 22044 ts_tablet_manager.cc:1403] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.025s
I20260709 12:09:19.032083 22042 tablet_bootstrap.cc:492] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:19.032549 22042 ts_tablet_manager.cc:1403] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.016s
I20260709 12:09:19.032653 21849 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:19.033195 22123 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.033679 22123 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.036208 22123 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.037137 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:19.037900 22103 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.040514 22043 tablet_bootstrap.cc:654] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.034197 21892 leader_election.cc:343] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.043434 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:19.045022 22123 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.087128 22050 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.086650 22049 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:09:19.095937 22050 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.097134 22082 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.055110 22095 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.097594 22082 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.098356 22095 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.099385 22079 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.099871 22079 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.100651 22135 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.101433 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.101492 22135 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.102175 21927 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:19.103612 22135 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:19.101426 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.103825 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.105093 22050 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:19.100682 22095 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.105436 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:19.068188 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.094928 22044 raft_consensus.cc:359] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.108942 22044 raft_consensus.cc:385] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.109315 22044 raft_consensus.cc:740] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.109390 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:19.109539 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.110034 22044 consensus_queue.cc:260] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.060935 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:19.066236 22103 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.099831 22082 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:09:19.111277 21817 leader_election.cc:343] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.112644 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:19.113062 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.114089 21925 raft_consensus.cc:2393] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 1: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:09:19.114382 22079 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:09:19.116302 21964 leader_election.cc:343] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.116248 21966 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:19.116796 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.117177 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.118233 21852 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:19.120836 22042 raft_consensus.cc:359] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.121733 22042 raft_consensus.cc:385] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.122119 22042 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.123106 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:19.124109 22135 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.123173 22042 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.124481 22135 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.124902 22135 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.126641 22042 ts_tablet_manager.cc:1434] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.094s	user 0.010s	sys 0.000s
I20260709 12:09:19.127923 22042 tablet_bootstrap.cc:492] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:19.045053 21924 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:19.052166 21848 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:19.143131 22044 ts_tablet_manager.cc:1434] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.115s	user 0.019s	sys 0.035s
I20260709 12:09:19.110534 22123 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:19.144116 22044 tablet_bootstrap.cc:492] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:19.130769 22103 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.134518 22082 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.120141 21849 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:19.153688 21964 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:19.154950 22050 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.155375 22050 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:19.156067 22050 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.145179 21815 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:19.159449 22095 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.159837 22135 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.160149 22111 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.152529 22082 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.168171 22082 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.169978 21892 leader_election.cc:343] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.173506 22049 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:19.178660 22095 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.179119 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:19.180490 21926 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.182487 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:19.183650 22043 tablet_bootstrap.cc:492] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:19.184360 22043 ts_tablet_manager.cc:1403] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.209s	user 0.028s	sys 0.022s
I20260709 12:09:19.197602 22042 tablet_bootstrap.cc:654] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.175082 22123 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:19.188550 21892 leader_election.cc:343] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.189750 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:19.204164 21848 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.240702 22082 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:19.247016 21892 leader_election.cc:343] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.247531 22082 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.245708 22044 tablet_bootstrap.cc:654] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.247490 21892 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:19.243429 22135 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:19.261929 22043 raft_consensus.cc:359] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.262914 22043 raft_consensus.cc:385] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.263296 22043 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.266688 22043 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.268816 22043 ts_tablet_manager.cc:1434] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.084s	user 0.003s	sys 0.006s
I20260709 12:09:19.270037 22043 tablet_bootstrap.cc:492] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:19.273298 21998 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.257041 22074 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.274974 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:19.276875 21817 leader_election.cc:343] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.284180 21892 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:19.286067 22074 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.286500 22074 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.286821 22074 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.284718 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49835.3us
I20260709 12:09:19.299424 22074 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.299870 21749 catalog_manager.cc:5697] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.301585 22074 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.314551 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:19.315213 21923 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.318109 21848 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:19.320996 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:19.321559 21848 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.324880 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:19.312949 21926 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:19.326862 22070 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.327512 21964 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:09:19.327855 21892 leader_election.cc:343] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.328341 22070 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.328827 22070 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:19.332340 22042 tablet_bootstrap.cc:492] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:19.332811 22042 ts_tablet_manager.cc:1403] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.205s	user 0.010s	sys 0.006s
I20260709 12:09:19.329880 22070 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.344944 21749 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.355317 22042 raft_consensus.cc:359] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.356304 22042 raft_consensus.cc:385] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.356664 22042 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.357637 22042 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.362078 22044 tablet_bootstrap.cc:492] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:19.362728 22044 ts_tablet_manager.cc:1403] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.219s	user 0.040s	sys 0.018s
I20260709 12:09:19.363700 22042 ts_tablet_manager.cc:1434] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 12:09:19.364444 22042 tablet_bootstrap.cc:492] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:19.372072 21923 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:19.373238 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:19.374859 22174 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.375334 22174 raft_consensus.cc:697] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:19.376183 22174 consensus_queue.cc:237] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.378427 22043 tablet_bootstrap.cc:654] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.380038 21848 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:19.384163 22175 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.384415 21892 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:19.387132 22175 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.388641 22123 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.389298 22123 raft_consensus.cc:697] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:19.391547 22123 consensus_queue.cc:237] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.393285 22175 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:19.394071 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:09:19.397892 21966 leader_election.cc:343] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.401899 21749 catalog_manager.cc:5697] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.402082 21748 catalog_manager.cc:5697] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.403818 22042 tablet_bootstrap.cc:654] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.406141 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.406937 21923 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:19.408245 22044 raft_consensus.cc:359] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.411536 22044 raft_consensus.cc:385] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.411923 22043 tablet_bootstrap.cc:492] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:19.411891 22044 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.412657 21964 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:19.412956 22044 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.413957 22043 ts_tablet_manager.cc:1403] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.144s	user 0.015s	sys 0.000s
I20260709 12:09:19.414019 22175 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.414572 22175 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.415406 22175 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.417475 22044 ts_tablet_manager.cc:1434] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.054s	user 0.002s	sys 0.004s
I20260709 12:09:19.418964 22043 raft_consensus.cc:359] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.419638 22043 raft_consensus.cc:385] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.419925 22043 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.420838 22044 tablet_bootstrap.cc:492] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:19.427366 22043 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.429785 22043 ts_tablet_manager.cc:1434] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:09:19.440446 22043 tablet_bootstrap.cc:492] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:19.442513 22174 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.443113 22044 tablet_bootstrap.cc:654] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.450806 22043 tablet_bootstrap.cc:654] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.452711 22049 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.451956 21748 catalog_manager.cc:5697] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.457321 22042 tablet_bootstrap.cc:492] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:19.458608 22042 ts_tablet_manager.cc:1403] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.093s	user 0.031s	sys 0.011s
I20260709 12:09:19.461223 22042 raft_consensus.cc:359] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.463641 22044 tablet_bootstrap.cc:492] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:19.464592 22044 ts_tablet_manager.cc:1403] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 12:09:19.461997 22042 raft_consensus.cc:385] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.467269 22044 raft_consensus.cc:359] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.468515 22044 raft_consensus.cc:385] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.468839 22044 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.469571 22044 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.433065 22175 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.472559 22175 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:19.467140 22042 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.473692 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:19.473461 22042 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.474258 21923 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.477696 22175 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.479733 22042 ts_tablet_manager.cc:1434] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 12:09:19.474953 22044 ts_tablet_manager.cc:1434] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:09:19.475863 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:19.480624 22042 tablet_bootstrap.cc:492] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
W20260709 12:09:19.483398 21966 leader_election.cc:343] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.483938 22044 tablet_bootstrap.cc:492] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:19.485174 21923 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:19.486502 21964 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:19.487679 22070 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.488184 22070 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:19.489018 22070 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.482007 22043 tablet_bootstrap.cc:492] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:19.492877 22043 ts_tablet_manager.cc:1403] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.000s
I20260709 12:09:19.497901 22044 tablet_bootstrap.cc:654] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.489573 22042 tablet_bootstrap.cc:654] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.504285 22043 raft_consensus.cc:359] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.505221 22043 raft_consensus.cc:385] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.505566 22043 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.511356 22043 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.516660 22044 tablet_bootstrap.cc:492] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:19.517307 22044 ts_tablet_manager.cc:1403] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.007s
I20260709 12:09:19.517351 21748 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.520282 22044 raft_consensus.cc:359] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.520831 22044 raft_consensus.cc:385] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.521106 22044 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.521855 22044 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.523065 22043 ts_tablet_manager.cc:1434] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:09:19.524034 22043 tablet_bootstrap.cc:492] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:19.524210 22044 ts_tablet_manager.cc:1434] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:19.525120 22044 tablet_bootstrap.cc:492] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:19.525599 22175 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.531000 22042 tablet_bootstrap.cc:492] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:19.534070 22177 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.534212 22042 ts_tablet_manager.cc:1403] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.013s
I20260709 12:09:19.534782 22177 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.531631 22044 tablet_bootstrap.cc:654] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.538297 22177 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.539281 22042 raft_consensus.cc:359] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.540001 22042 raft_consensus.cc:385] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.540303 22042 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.540323 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.541023 22042 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.543144 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:19.556629 21925 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
W20260709 12:09:19.559254 21817 leader_election.cc:343] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.559758 22042 ts_tablet_manager.cc:1434] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.001s
I20260709 12:09:19.559871 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:19.560750 22042 tablet_bootstrap.cc:492] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:19.560937 22177 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.561278 22177 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.561597 22177 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.566676 22042 tablet_bootstrap.cc:654] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.568717 22177 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.536441 22043 tablet_bootstrap.cc:654] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.571561 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:19.549651 22044 tablet_bootstrap.cc:492] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
W20260709 12:09:19.572978 21817 leader_election.cc:343] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.573593 22177 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.573812 22044 ts_tablet_manager.cc:1403] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.004s
I20260709 12:09:19.575979 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:19.576772 21925 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.577584 22044 raft_consensus.cc:359] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.579785 22044 raft_consensus.cc:385] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.580224 22044 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.581087 22044 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.583089 22044 ts_tablet_manager.cc:1434] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:09:19.583981 22044 tablet_bootstrap.cc:492] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:19.586247 22175 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.597973 21925 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:19.599663 22044 tablet_bootstrap.cc:654] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.599504 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:19.601171 22177 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.602077 22177 raft_consensus.cc:697] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:19.603276 22177 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.613418 22043 tablet_bootstrap.cc:492] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:19.613473 22042 tablet_bootstrap.cc:492] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:19.613976 22043 ts_tablet_manager.cc:1403] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.009s
I20260709 12:09:19.614046 22042 ts_tablet_manager.cc:1403] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.019s
I20260709 12:09:19.616653 22043 raft_consensus.cc:359] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.616940 22042 raft_consensus.cc:359] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.617329 22043 raft_consensus.cc:385] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.617533 22042 raft_consensus.cc:385] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.617592 22043 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.617859 22042 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.618654 22042 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.621393 22042 ts_tablet_manager.cc:1434] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:09:19.622555 21798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.618302 22043 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.624380 22042 tablet_bootstrap.cc:492] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:19.624914 22043 ts_tablet_manager.cc:1434] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:09:19.625800 22043 tablet_bootstrap.cc:492] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:19.631763 22043 tablet_bootstrap.cc:654] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.635340 22042 tablet_bootstrap.cc:654] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.637845 22174 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.638329 22174 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.640519 22174 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.643129 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:19.647642 22043 tablet_bootstrap.cc:492] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:19.648123 22043 ts_tablet_manager.cc:1403] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.023s	user 0.001s	sys 0.017s
I20260709 12:09:19.650552 22070 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.651818 22043 raft_consensus.cc:359] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.652554 22043 raft_consensus.cc:385] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.652902 22043 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.653265 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.653993 21923 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 1: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:09:19.654774 22070 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.655346 22070 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.658949 22070 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:19.659657 21815 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:19.662508 22174 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.664350 22043 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.669196 22043 ts_tablet_manager.cc:1434] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:09:19.661417 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.658811 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.672382 21849 raft_consensus.cc:2393] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:09:19.670328 22043 tablet_bootstrap.cc:492] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:19.673672 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:19.674750 22070 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.679108 22174 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.678622 21749 catalog_manager.cc:5697] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.681778 22070 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.692185 22042 tablet_bootstrap.cc:492] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:19.692675 22042 ts_tablet_manager.cc:1403] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.030s
I20260709 12:09:19.695875 22042 raft_consensus.cc:359] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.696614 22042 raft_consensus.cc:385] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.696688 22044 tablet_bootstrap.cc:492] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:19.697006 22042 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.697199 22044 ts_tablet_manager.cc:1403] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.113s	user 0.023s	sys 0.025s
I20260709 12:09:19.697866 22043 tablet_bootstrap.cc:654] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.697803 22042 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.699808 22044 raft_consensus.cc:359] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.700467 22044 raft_consensus.cc:385] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.700723 22044 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.701359 22044 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.703550 22044 ts_tablet_manager.cc:1434] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:19.703912 22042 ts_tablet_manager.cc:1434] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:19.704432 22044 tablet_bootstrap.cc:492] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:19.704289 22074 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.705379 22042 tablet_bootstrap.cc:492] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:19.712507 22042 tablet_bootstrap.cc:654] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.714128 22070 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.714635 22070 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.719671 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.720551 21926 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:19.722368 21964 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:19.723235 22175 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.723762 22175 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.724191 22175 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.725128 22044 tablet_bootstrap.cc:654] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.725080 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.723232 22070 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:09:19.727159 21966 leader_election.cc:343] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.728441 22174 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.728909 22174 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.730990 22174 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.732849 22175 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.733340 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:19.734719 21817 leader_election.cc:343] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.734869 22175 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:19.736645 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:09:19.737824 21815 leader_election.cc:343] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.738248 21815 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:19.738462 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:19.738979 21926 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.739393 22174 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.740762 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:19.743347 22042 tablet_bootstrap.cc:492] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:19.743948 22042 ts_tablet_manager.cc:1403] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.017s
I20260709 12:09:19.745946 22074 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.746356 22074 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.746551 22042 raft_consensus.cc:359] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.747256 22042 raft_consensus.cc:385] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.747562 22042 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.748215 22042 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.749207 22123 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.749666 22123 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.750485 22042 ts_tablet_manager.cc:1434] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:09:19.751343 22042 tablet_bootstrap.cc:492] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:19.751658 22123 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.755450 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.756098 21852 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:19.755573 22074 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.760766 22044 tablet_bootstrap.cc:492] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:19.761181 22044 ts_tablet_manager.cc:1403] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.009s
I20260709 12:09:19.762028 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:19.758863 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:19.758894 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.762794 22074 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:19.759506 21966 leader_election.cc:343] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.776889 22074 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.763155 21998 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:19.777606 21926 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:19.776934 21849 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:19.764565 22070 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.777626 22074 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.779165 22070 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.779428 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:19.780150 22001 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.781105 22044 raft_consensus.cc:359] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.781486 22048 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.782827 22175 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.782902 22044 raft_consensus.cc:385] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.783639 22044 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.784310 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:19.784377 22044 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.787129 22044 ts_tablet_manager.cc:1434] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 12:09:19.788086 22044 tablet_bootstrap.cc:492] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:19.788383 22048 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.788782 22048 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.788959 22042 tablet_bootstrap.cc:654] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.791931 21892 leader_election.cc:343] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.793540 22074 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.787865 21964 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:19.795007 22044 tablet_bootstrap.cc:654] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.795255 22175 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.795925 22175 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:19.797029 22175 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.802695 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:19.803347 21849 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.810087 22174 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.813820 22048 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.822719 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.824800 22070 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:19.826928 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:19.827771 21850 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.828931 22048 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.830036 22043 tablet_bootstrap.cc:492] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:19.830513 22043 ts_tablet_manager.cc:1403] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.160s	user 0.008s	sys 0.015s
I20260709 12:09:19.832064 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:19.835574 21892 consensus_peers.cc:597] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:19.844985 21849 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:19.846011 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:19.853062 22074 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.853642 22074 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.854907 22074 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.855337 22074 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:19.856151 22074 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.861014 21850 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:19.867396 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:19.868834 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:19.869452 22000 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.870297 22123 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.870858 22123 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:19.871735 22123 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.878178 22000 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:19.888499 21748 catalog_manager.cc:5697] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.889681 22043 raft_consensus.cc:359] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:19.892190 21892 leader_election.cc:343] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.902516 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:19.903357 21925 raft_consensus.cc:2393] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:09:19.904412 22095 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.904757 21964 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:19.906127 22070 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.906855 22042 tablet_bootstrap.cc:492] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:19.907317 22042 ts_tablet_manager.cc:1403] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.026s
I20260709 12:09:19.909930 22042 raft_consensus.cc:359] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.910962 22042 raft_consensus.cc:385] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.911271 22042 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.911233 22070 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.912132 22042 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.914209 22042 ts_tablet_manager.cc:1434] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:09:19.890336 22043 raft_consensus.cc:385] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.914897 22043 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.915068 22042 tablet_bootstrap.cc:492] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:19.916306 22210 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.916244 21749 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.925800 22042 tablet_bootstrap.cc:654] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.915555 22043 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.972487 22043 ts_tablet_manager.cc:1434] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.142s	user 0.006s	sys 0.000s
I20260709 12:09:19.973709 22043 tablet_bootstrap.cc:492] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:19.974674 22095 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.975252 22095 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.978319 22095 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.980031 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:19.980589 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:09:19.981472 21817 leader_election.cc:343] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.981427 21925 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:19.982889 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:19.983686 22095 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.984278 22095 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.984704 22095 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.987174 22042 tablet_bootstrap.cc:492] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:19.987622 22042 ts_tablet_manager.cc:1403] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.010s
I20260709 12:09:19.990731 22217 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.991241 22217 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.992157 22042 raft_consensus.cc:359] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.992914 22042 raft_consensus.cc:385] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.993228 22042 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.993317 22217 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:19.993671 21748 catalog_manager.cc:5697] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.993996 22042 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:19.995231 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:19.995859 21848 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:19.996575 22042 ts_tablet_manager.cc:1434] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:19.997032 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:19.997531 22042 tablet_bootstrap.cc:492] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:19.998104 22213 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.998503 22213 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.998835 22213 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.000910 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:20.002241 21892 leader_election.cc:343] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.003760 22095 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.004302 22042 tablet_bootstrap.cc:654] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.005765 22095 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.006963 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:20.008486 21817 leader_election.cc:343] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.009366 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:20.009258 22213 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.010066 21925 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.011637 22213 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.012814 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:20.013408 21848 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.013610 22043 tablet_bootstrap.cc:654] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.018985 21925 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:20.022436 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:20.023670 22095 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.024132 22095 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:20.023542 21848 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:20.024755 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:20.024940 22095 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.025949 22044 tablet_bootstrap.cc:492] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:20.026398 22044 ts_tablet_manager.cc:1403] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.239s	user 0.051s	sys 0.116s
I20260709 12:09:20.026204 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:20.027208 22213 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:20.028012 21892 leader_election.cc:343] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.029101 22044 raft_consensus.cc:359] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.030071 22044 raft_consensus.cc:385] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.030370 22044 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.031044 22044 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.035480 22044 ts_tablet_manager.cc:1434] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:20.036720 22044 tablet_bootstrap.cc:492] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:20.030231 22213 raft_consensus.cc:697] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:20.037863 22213 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.043013 22044 tablet_bootstrap.cc:654] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.047979 22043 tablet_bootstrap.cc:492] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:20.048460 22043 ts_tablet_manager.cc:1403] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.002s
I20260709 12:09:20.049701 22042 tablet_bootstrap.cc:492] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:20.050122 22042 ts_tablet_manager.cc:1403] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.006s
I20260709 12:09:20.051134 22043 raft_consensus.cc:359] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.051826 22043 raft_consensus.cc:385] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.052096 22043 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.052735 22043 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.052902 22042 raft_consensus.cc:359] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.053499 22042 raft_consensus.cc:385] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.053782 22042 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.054534 22042 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.056993 22042 ts_tablet_manager.cc:1434] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:20.057245 22043 ts_tablet_manager.cc:1434] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:09:20.057861 22042 tablet_bootstrap.cc:492] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:20.058045 22043 tablet_bootstrap.cc:492] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:20.059772 21750 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.064216 22042 tablet_bootstrap.cc:654] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.069406 21748 catalog_manager.cc:5697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.072419 22177 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.064209 22043 tablet_bootstrap.cc:654] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.075742 22000 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.076084 22175 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.082947 22044 tablet_bootstrap.cc:492] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:20.083423 22044 ts_tablet_manager.cc:1403] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.001s
I20260709 12:09:20.087193 22095 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.090356 22044 raft_consensus.cc:359] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.092334 22044 raft_consensus.cc:385] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.092687 22044 raft_consensus.cc:740] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.093525 22044 consensus_queue.cc:260] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.096340 22044 ts_tablet_manager.cc:1434] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:09:20.099267 22044 tablet_bootstrap.cc:492] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:20.102596 22175 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.108629 22042 tablet_bootstrap.cc:492] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:20.109265 22042 ts_tablet_manager.cc:1403] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.006s
I20260709 12:09:20.110925 22175 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.111402 22175 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.114084 22175 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:20.113840 22042 raft_consensus.cc:359] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.114764 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:20.115139 22042 raft_consensus.cc:385] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.115523 22042 raft_consensus.cc:740] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.116475 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.117286 22044 tablet_bootstrap.cc:654] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.117996 21850 raft_consensus.cc:2393] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:09:20.119400 22042 consensus_queue.cc:260] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.121706 22042 ts_tablet_manager.cc:1434] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:09:20.122614 22042 tablet_bootstrap.cc:492] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:20.124346 21966 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:20.127677 22175 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.125214 22043 tablet_bootstrap.cc:492] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:20.132038 22043 ts_tablet_manager.cc:1403] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.003s
I20260709 12:09:20.142561 22213 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.147221 22213 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.176371 22044 tablet_bootstrap.cc:492] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:20.177135 22044 ts_tablet_manager.cc:1403] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.079s	user 0.008s	sys 0.009s
I20260709 12:09:20.203019 22042 tablet_bootstrap.cc:654] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.218505 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.219193 21848 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:20.220544 22048 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.221199 22048 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.223809 22048 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.226179 22217 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.226816 22217 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.229427 22217 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.232329 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.243105 22213 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.244969 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:20.247572 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.249655 22048 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.250202 22048 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.254213 22048 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.266723 22043 raft_consensus.cc:359] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.270809 22043 raft_consensus.cc:385] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.271915 22043 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.273101 22043 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:20.274462 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 103678us
I20260709 12:09:20.280897 22044 raft_consensus.cc:359] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.281890 22044 raft_consensus.cc:385] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.282249 22044 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.283128 22044 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.286211 22044 ts_tablet_manager.cc:1434] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.000s
I20260709 12:09:20.290652 22044 tablet_bootstrap.cc:492] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:20.291169 22043 ts_tablet_manager.cc:1434] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.159s	user 0.006s	sys 0.003s
I20260709 12:09:20.292673 22043 tablet_bootstrap.cc:492] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:20.290488 22074 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.324622 22074 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.344494 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:20.345944 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:20.296053 21892 leader_election.cc:343] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.411532 22172 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.415297 22042 tablet_bootstrap.cc:492] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:20.416144 22042 ts_tablet_manager.cc:1403] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.294s	user 0.012s	sys 0.016s
I20260709 12:09:20.399536 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:20.401762 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 106306us
I20260709 12:09:20.436574 22042 raft_consensus.cc:359] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.437563 22042 raft_consensus.cc:385] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.437919 22042 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
W20260709 12:09:20.434037 21892 leader_election.cc:343] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.438757 22042 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.441514 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.442176 21848 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:20.453514 22175 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.457659 22213 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.458997 22213 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.461622 22044 tablet_bootstrap.cc:654] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.461661 22213 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:09:20.495569 21892 leader_election.cc:343] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.495553 22042 ts_tablet_manager.cc:1434] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.079s	user 0.018s	sys 0.033s
I20260709 12:09:20.496177 21892 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:20.497103 22042 tablet_bootstrap.cc:492] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:20.499058 22074 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.499380 22174 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.501610 22213 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.503046 21892 leader_election.cc:343] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.503482 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:20.504367 22210 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.504529 21892 leader_election.cc:343] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.511265 22048 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.509819 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:20.512703 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.513387 21850 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:20.515166 22074 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.515686 22074 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:20.515216 21966 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.517375 22237 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.517830 22237 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.516112 22074 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.520553 22217 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.521553 22237 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:20.524394 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:20.523698 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:20.529486 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.530712 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:20.535899 22042 tablet_bootstrap.cc:654] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.544596 22048 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.548009 22043 tablet_bootstrap.cc:654] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.549103 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:09:20.560628 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47638.6us
I20260709 12:09:20.561836 21892 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:20.555428 22237 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.570124 21892 leader_election.cc:343] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.573678 21892 leader_election.cc:343] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.569229 22177 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.569303 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:20.579073 21892 leader_election.cc:343] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.579922 22249 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.579731 22246 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:09:20.577565 22244 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:09:20.586557 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:20.593163 21850 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.595006 22042 tablet_bootstrap.cc:492] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:20.595745 22042 ts_tablet_manager.cc:1403] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.099s	user 0.024s	sys 0.006s
I20260709 12:09:20.578128 22177 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.584182 22210 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:20.601007 22177 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.602845 22001 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.586231 22249 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.607489 22249 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.616720 22044 tablet_bootstrap.cc:492] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:20.618175 22044 ts_tablet_manager.cc:1403] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.328s	user 0.019s	sys 0.013s
I20260709 12:09:20.615674 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:20.620262 21817 leader_election.cc:343] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.621199 22044 raft_consensus.cc:359] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.621933 22044 raft_consensus.cc:385] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.622174 22044 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.622777 22044 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.596520 22074 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.628756 22044 ts_tablet_manager.cc:1434] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:20.629555 22044 tablet_bootstrap.cc:492] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:20.630532 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:20.649649 22174 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:20.644068 22048 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 12:09:20.662940 21815 leader_election.cc:343] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.663378 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:20.664521 22049 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.672717 22074 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.674576 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:20.675196 21849 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.679219 22043 tablet_bootstrap.cc:492] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
W20260709 12:09:20.679801 21892 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.685102 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:20.689186 21892 leader_election.cc:343] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.708850 22043 ts_tablet_manager.cc:1403] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.416s	user 0.027s	sys 0.029s
I20260709 12:09:20.711319 22042 raft_consensus.cc:359] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.711987 22042 raft_consensus.cc:385] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.712204 22042 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.714084 22042 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.716599 22042 ts_tablet_manager.cc:1434] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.121s	user 0.004s	sys 0.003s
I20260709 12:09:20.717764 22042 tablet_bootstrap.cc:492] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:20.716496 21850 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:20.719374 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:20.720640 22048 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.724103 22048 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:20.724915 21849 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:20.725011 22048 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.726361 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:20.727286 22249 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.727608 22246 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.728266 22246 raft_consensus.cc:697] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:20.733592 22246 consensus_queue.cc:237] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.741629 22043 raft_consensus.cc:359] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.742590 22043 raft_consensus.cc:385] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.753743 22043 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
W20260709 12:09:20.754804 22253 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:09:20.757004 22043 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.760584 22249 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.766286 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:20.770152 21851 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.770856 22044 tablet_bootstrap.cc:654] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.771265 22042 tablet_bootstrap.cc:654] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.772574 22043 ts_tablet_manager.cc:1434] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.063s	user 0.003s	sys 0.005s
I20260709 12:09:20.790450 22043 tablet_bootstrap.cc:492] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:20.844619 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:20.853515 21851 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:20.856670 22001 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.857240 21892 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:20.858100 22249 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.858983 22249 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:20.860046 22249 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:20.862689 21798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:20.864135 22043 tablet_bootstrap.cc:654] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.872826 22246 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.875304 22044 tablet_bootstrap.cc:492] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:20.875831 22044 ts_tablet_manager.cc:1403] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.246s	user 0.032s	sys 0.013s
I20260709 12:09:20.877398 22048 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.871814 21748 catalog_manager.cc:5697] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.879977 21748 catalog_manager.cc:5697] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.882153 22043 tablet_bootstrap.cc:492] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:20.873361 22246 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.882761 22043 ts_tablet_manager.cc:1403] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.002s
I20260709 12:09:20.877856 22048 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.884443 22001 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:20.885409 22048 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.886605 22042 tablet_bootstrap.cc:492] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:20.887043 22042 ts_tablet_manager.cc:1403] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.169s	user 0.015s	sys 0.005s
I20260709 12:09:20.887777 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:20.890370 21892 leader_election.cc:343] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.890756 22043 raft_consensus.cc:359] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.891431 22043 raft_consensus.cc:385] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.891697 22043 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.894510 22246 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.893304 22044 raft_consensus.cc:359] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.895423 22044 raft_consensus.cc:385] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.895625 22044 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.894953 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.896802 22044 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.896225 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.898034 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:20.898447 21851 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:20.896525 22043 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:20.898974 21892 leader_election.cc:343] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.899650 21892 leader_election.cc:343] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.900043 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:20.900549 22043 ts_tablet_manager.cc:1434] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:09:20.901413 22043 tablet_bootstrap.cc:492] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:20.906797 22177 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.907199 22042 raft_consensus.cc:359] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.907269 22177 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.908044 22042 raft_consensus.cc:385] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.908360 22042 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.909030 22042 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.909914 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:20.911995 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:20.912955 22043 tablet_bootstrap.cc:654] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.915069 22210 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.915453 22210 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.904762 22044 ts_tablet_manager.cc:1434] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 12:09:20.915906 22210 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.917811 22044 tablet_bootstrap.cc:492] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:20.901490 22246 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.924263 22042 ts_tablet_manager.cc:1434] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:09:20.925582 22042 tablet_bootstrap.cc:492] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:20.935933 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:20.936990 22044 tablet_bootstrap.cc:654] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.939314 22043 tablet_bootstrap.cc:492] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:20.938313 22177 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.939795 22043 ts_tablet_manager.cc:1403] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.006s
I20260709 12:09:20.940454 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:20.940259 22210 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.943955 22043 raft_consensus.cc:359] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.944638 22043 raft_consensus.cc:385] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.944938 22043 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.945693 22210 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:20.946285 22043 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.941680 22177 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.948017 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:20.950024 22050 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:20.950594 21892 leader_election.cc:343] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.950475 22050 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.951375 22043 ts_tablet_manager.cc:1434] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:20.952283 22043 tablet_bootstrap.cc:492] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:20.952775 22050 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:20.950052 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:20.954068 21852 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.953967 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:20.954746 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:20.956183 22042 tablet_bootstrap.cc:654] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.956801 21964 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:20.958125 22050 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.967113 21852 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:20.969090 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:20.969753 22043 tablet_bootstrap.cc:654] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.969894 22210 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.970531 22210 raft_consensus.cc:697] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:20.971491 22210 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.980578 22043 tablet_bootstrap.cc:492] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:20.981065 22043 ts_tablet_manager.cc:1403] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 12:09:20.981841 22044 tablet_bootstrap.cc:492] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:20.982295 22044 ts_tablet_manager.cc:1403] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.011s
I20260709 12:09:20.984253 22042 tablet_bootstrap.cc:492] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:20.984735 22042 ts_tablet_manager.cc:1403] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.002s
I20260709 12:09:20.987648 22042 raft_consensus.cc:359] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.988345 22042 raft_consensus.cc:385] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.986039 22044 raft_consensus.cc:359] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.988942 22044 raft_consensus.cc:385] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.989248 22044 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.990141 22043 raft_consensus.cc:359] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.988611 22042 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.990823 22043 raft_consensus.cc:385] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.991459 22043 raft_consensus.cc:740] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.990793 22044 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.992214 22043 consensus_queue.cc:260] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.993274 22042 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:20.994429 22044 ts_tablet_manager.cc:1434] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:09:20.995658 22044 tablet_bootstrap.cc:492] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:21.003396 22042 ts_tablet_manager.cc:1434] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:09:21.004406 22042 tablet_bootstrap.cc:492] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:21.010224 22042 tablet_bootstrap.cc:654] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.011570 22043 ts_tablet_manager.cc:1434] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:09:21.012395 22044 tablet_bootstrap.cc:654] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.012916 22043 tablet_bootstrap.cc:492] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:21.020440 22043 tablet_bootstrap.cc:654] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.037236 22044 tablet_bootstrap.cc:492] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:21.037793 22044 ts_tablet_manager.cc:1403] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.003s
I20260709 12:09:21.037238 22043 tablet_bootstrap.cc:492] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:21.040432 22044 raft_consensus.cc:359] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.041031 22042 tablet_bootstrap.cc:492] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:21.041203 22044 raft_consensus.cc:385] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.041525 22042 ts_tablet_manager.cc:1403] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.004s
I20260709 12:09:21.041540 22044 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.038949 22043 ts_tablet_manager.cc:1403] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
I20260709 12:09:21.042454 22044 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.044539 22044 ts_tablet_manager.cc:1434] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:21.045176 22001 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.045418 22044 tablet_bootstrap.cc:492] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:21.047731 22042 raft_consensus.cc:359] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.048424 22042 raft_consensus.cc:385] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.048682 22042 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.049330 22042 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.045367 22043 raft_consensus.cc:359] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.050302 22043 raft_consensus.cc:385] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.050616 22043 raft_consensus.cc:740] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.051469 22042 ts_tablet_manager.cc:1434] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:21.052088 22044 tablet_bootstrap.cc:654] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.052417 22042 tablet_bootstrap.cc:492] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:21.054661 22043 consensus_queue.cc:260] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.057103 22043 ts_tablet_manager.cc:1434] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:09:21.057998 22043 tablet_bootstrap.cc:492] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:21.062148 22042 tablet_bootstrap.cc:654] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.065171 22044 tablet_bootstrap.cc:492] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:21.065619 22044 ts_tablet_manager.cc:1403] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 12:09:21.066002 22043 tablet_bootstrap.cc:654] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.068368 22044 raft_consensus.cc:359] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.071193 22043 tablet_bootstrap.cc:492] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:21.070278 21749 catalog_manager.cc:5697] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.071638 22043 ts_tablet_manager.cc:1403] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:09:21.069072 22044 raft_consensus.cc:385] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.073997 22044 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.074376 22043 raft_consensus.cc:359] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.074672 22044 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.075192 22043 raft_consensus.cc:385] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.075736 22043 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.076383 22043 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.078383 22043 ts_tablet_manager.cc:1434] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:21.079259 22043 tablet_bootstrap.cc:492] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:21.081139 22044 ts_tablet_manager.cc:1434] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:09:21.082463 22044 tablet_bootstrap.cc:492] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:21.085050 22043 tablet_bootstrap.cc:654] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.088406 22044 tablet_bootstrap.cc:654] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.089942 21749 catalog_manager.cc:5697] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.099992 22043 tablet_bootstrap.cc:492] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:21.100476 22043 ts_tablet_manager.cc:1403] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:09:21.102241 22044 tablet_bootstrap.cc:492] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:21.102739 22044 ts_tablet_manager.cc:1403] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:09:21.103602 22043 raft_consensus.cc:359] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.104296 22043 raft_consensus.cc:385] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.104544 22043 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.105211 22043 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.105553 22044 raft_consensus.cc:359] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.106621 22044 raft_consensus.cc:385] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.106909 22044 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.107327 22043 ts_tablet_manager.cc:1434] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:21.108242 22043 tablet_bootstrap.cc:492] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:21.112962 22044 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.114825 22043 tablet_bootstrap.cc:654] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.115507 22049 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.115988 22049 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.118079 22049 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.119617 22042 tablet_bootstrap.cc:492] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:21.120220 22042 ts_tablet_manager.cc:1403] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.068s	user 0.028s	sys 0.016s
I20260709 12:09:21.120858 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.121495 21922 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:21.122546 22246 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.122939 21815 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:21.123807 22049 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.124487 22049 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.125978 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:21.127504 21817 leader_election.cc:343] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.125488 22049 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.135133 22044 ts_tablet_manager.cc:1434] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:09:21.136817 22042 raft_consensus.cc:359] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.137552 22042 raft_consensus.cc:385] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.137768 22044 tablet_bootstrap.cc:492] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:21.137917 22042 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.139875 22042 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.140172 22246 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.140956 22043 tablet_bootstrap.cc:492] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:21.140551 22049 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.141408 22043 ts_tablet_manager.cc:1403] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.004s
I20260709 12:09:21.142238 22042 ts_tablet_manager.cc:1434] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 12:09:21.143154 22042 tablet_bootstrap.cc:492] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:21.144078 22043 raft_consensus.cc:359] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.144410 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:21.144739 22043 raft_consensus.cc:385] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.144995 21922 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.144908 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:21.146654 21817 leader_election.cc:343] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.145051 22043 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.149837 22049 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.149974 22042 tablet_bootstrap.cc:654] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.150465 22043 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.151832 22044 tablet_bootstrap.cc:654] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.152710 22043 ts_tablet_manager.cc:1434] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:21.153832 22043 tablet_bootstrap.cc:492] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
W20260709 12:09:21.156724 21892 consensus_peers.cc:597] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.162459 22043 tablet_bootstrap.cc:654] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.162554 22246 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.163220 22246 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.163997 22172 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.164480 22172 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.165362 22246 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.169387 21922 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:21.170660 21815 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:21.171222 22172 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:21.172659 22049 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.173007 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.173398 22049 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:21.174065 21923 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:21.174453 22049 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.175487 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:21.176647 22172 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.177019 22172 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.177474 22172 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.181527 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:21.182176 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.182832 21851 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
W20260709 12:09:21.182986 21892 leader_election.cc:343] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.185222 22172 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.189785 22043 tablet_bootstrap.cc:492] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:21.190429 22043 ts_tablet_manager.cc:1403] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.003s
I20260709 12:09:21.190935 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.191555 21851 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:21.194141 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:21.194926 22050 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.195324 22050 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.197031 22050 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:21.196949 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:21.197894 21848 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.198684 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.203553 22246 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.204777 22246 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.204870 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.205251 22246 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.206277 21848 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:21.207181 21966 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:21.208416 21966 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:21.193903 22043 raft_consensus.cc:359] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.209251 22050 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.209594 22043 raft_consensus.cc:385] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.209877 22050 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.210314 22050 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:21.209878 22043 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.211179 22050 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.212370 22043 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.227805 22044 tablet_bootstrap.cc:492] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:21.228488 22044 ts_tablet_manager.cc:1403] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.000s
I20260709 12:09:21.227792 22042 tablet_bootstrap.cc:492] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:21.240967 22042 ts_tablet_manager.cc:1403] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.098s	user 0.035s	sys 0.020s
I20260709 12:09:21.241348 22043 ts_tablet_manager.cc:1434] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.051s	user 0.018s	sys 0.015s
I20260709 12:09:21.242352 22043 tablet_bootstrap.cc:492] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:21.243059 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:21.243323 22172 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:21.243700 21922 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.243567 22042 raft_consensus.cc:359] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.244347 22042 raft_consensus.cc:385] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.244637 22042 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.245468 22042 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.247655 22042 ts_tablet_manager.cc:1434] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:21.248538 22042 tablet_bootstrap.cc:492] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:21.249118 22043 tablet_bootstrap.cc:654] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.240389 22044 raft_consensus.cc:359] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.251215 22044 raft_consensus.cc:385] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.251493 22044 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.252243 22044 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.248459 21749 catalog_manager.cc:5697] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.261200 22042 tablet_bootstrap.cc:654] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.261447 22043 tablet_bootstrap.cc:492] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:21.261886 22043 ts_tablet_manager.cc:1403] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.010s
I20260709 12:09:21.255065 22044 ts_tablet_manager.cc:1434] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 12:09:21.264472 22044 tablet_bootstrap.cc:492] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:21.264675 22043 raft_consensus.cc:359] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.265340 22043 raft_consensus.cc:385] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.265604 22043 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.266228 22043 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.268755 22043 ts_tablet_manager.cc:1434] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:09:21.269629 22043 tablet_bootstrap.cc:492] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:21.271025 22044 tablet_bootstrap.cc:654] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.272533 21922 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:21.275960 22042 tablet_bootstrap.cc:492] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:21.276396 22042 ts_tablet_manager.cc:1403] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 12:09:21.276564 22043 tablet_bootstrap.cc:654] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.277143 22246 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.279006 22042 raft_consensus.cc:359] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.279712 22042 raft_consensus.cc:385] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.280066 22042 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
W20260709 12:09:21.280224 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 71852.6us
I20260709 12:09:21.280973 22042 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.282018 21852 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.287845 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:21.288177 22042 ts_tablet_manager.cc:1434] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:09:21.288473 21848 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.289463 22042 tablet_bootstrap.cc:492] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:21.294935 22044 tablet_bootstrap.cc:492] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:21.295571 22044 ts_tablet_manager.cc:1403] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.007s
I20260709 12:09:21.298535 22210 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.299041 22044 raft_consensus.cc:359] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.300029 22044 raft_consensus.cc:385] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.300318 22044 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.300952 22044 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.306634 21848 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:21.307293 22042 tablet_bootstrap.cc:654] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.307848 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:21.307982 22001 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.308579 22048 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.309063 22048 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:21.309911 22048 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.299062 22210 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.316088 22210 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.318117 22044 ts_tablet_manager.cc:1434] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:09:21.318917 22172 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.319296 22044 tablet_bootstrap.cc:492] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:21.319416 22172 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.319701 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.320485 21851 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:21.321372 22172 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:21.322425 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.326313 22044 tablet_bootstrap.cc:654] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.327630 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:21.328492 22249 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.328959 22249 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.329370 22249 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.331089 22042 tablet_bootstrap.cc:492] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:21.331728 22042 ts_tablet_manager.cc:1403] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.011s
I20260709 12:09:21.333519 22043 tablet_bootstrap.cc:492] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:21.334021 22043 ts_tablet_manager.cc:1403] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.065s	user 0.025s	sys 0.011s
I20260709 12:09:21.334524 22074 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.335078 22074 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.335738 22042 raft_consensus.cc:359] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.336639 22042 raft_consensus.cc:385] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.336982 22042 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.337267 22074 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.337868 22042 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.340763 22042 ts_tablet_manager.cc:1434] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:09:21.341990 22042 tablet_bootstrap.cc:492] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:21.343545 22074 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.340866 22043 raft_consensus.cc:359] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.344154 22074 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.345798 22043 raft_consensus.cc:385] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.347014 22043 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.348559 22074 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.347245 22172 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.349419 22172 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.348488 22043 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.352159 22172 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:21.353099 22074 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.353327 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.353762 22074 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.355521 22043 ts_tablet_manager.cc:1434] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:09:21.356297 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.358513 22177 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.359069 22177 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.360052 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.358786 22043 tablet_bootstrap.cc:492] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:21.360806 21851 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:21.361095 22177 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.356547 22074 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.360803 22042 tablet_bootstrap.cc:654] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.361483 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.362843 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:21.363201 21892 leader_election.cc:343] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.363461 22001 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:21.364784 21817 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:21.366120 22177 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.366564 22177 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.366945 22177 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.369009 22289 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.372308 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:21.376574 22074 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.369676 22289 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:21.386972 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 62403.5us
I20260709 12:09:21.386531 22074 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.378719 22249 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.429805 22050 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.411988 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.426993 22074 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.432271 22050 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.447154 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:21.447989 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.449438 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:21.450301 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.451124 21847 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:09:21.441943 21923 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:21.447190 22249 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.453409 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:21.487226 21966 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:09:21.502346 21892 leader_election.cc:343] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.514878 22292 log.cc:927] Time spent T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:09:21.529953 22246 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.530840 22044 tablet_bootstrap.cc:492] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:21.489663 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:21.511281 22048 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.508062 22172 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:21.539613 21750 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.543228 22300 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:21.544394 21892 leader_election.cc:343] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.546558 22050 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:09:21.557189 21892 leader_election.cc:343] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.545740 22246 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:09:21.548460 22048 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.582221 22044 ts_tablet_manager.cc:1403] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.263s	user 0.045s	sys 0.064s
W20260709 12:09:21.582026 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 94913.9us
W20260709 12:09:21.600966 21892 leader_election.cc:343] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.601631 21892 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:21.555841 21749 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.602428 21966 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:21.603659 22048 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.604373 22050 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.586199 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 125035us
W20260709 12:09:21.608170 21892 leader_election.cc:343] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.611173 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:21.606390 22048 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.610356 22304 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.614836 22246 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.620908 22289 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:21.649438 22050 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.650978 22050 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.651221 22042 tablet_bootstrap.cc:492] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:21.652261 22042 ts_tablet_manager.cc:1403] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.311s	user 0.030s	sys 0.020s
I20260709 12:09:21.654515 22050 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.636066 22304 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.660037 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.660566 22050 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:21.661871 22304 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.667536 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:21.667726 22074 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.668201 22000 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:21.668794 22044 raft_consensus.cc:359] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.669458 22044 raft_consensus.cc:385] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.652493 22177 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.672348 22044 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.670316 22042 raft_consensus.cc:359] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.673085 22042 raft_consensus.cc:385] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.669512 21817 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:21.673390 22042 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.673288 22044 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.669816 22074 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.674052 22306 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.674034 22042 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.674592 22306 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.672083 22043 tablet_bootstrap.cc:654] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.675382 22044 ts_tablet_manager.cc:1434] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.093s	user 0.012s	sys 0.006s
I20260709 12:09:21.676280 22044 tablet_bootstrap.cc:492] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:21.676051 22306 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.677898 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.678454 21923 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:21.679309 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.680568 22297 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.681000 21922 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:09:21.683911 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:21.684381 21997 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.687368 22177 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.692760 21964 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:21.695326 22237 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.695529 22042 ts_tablet_manager.cc:1434] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:09:21.695515 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:21.696229 22237 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.681089 22297 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.696233 22000 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.696878 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.696611 22237 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.699023 22042 tablet_bootstrap.cc:492] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:21.700516 21849 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:09:21.701094 22001 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.703202 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:21.704136 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.710716 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:21.711289 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:21.713416 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.713542 22297 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:21.710513 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:21.714524 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:21.723063 21848 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.730723 21927 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:21.742133 21926 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.723994 21998 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.751405 22048 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.755014 22048 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:21.797830 21892 leader_election.cc:343] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.809216 22305 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:21.816030 21892 leader_election.cc:343] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.819861 21966 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:21.809742 22305 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.831132 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.804420 22246 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:09:21.808180 22300 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:09:21.836625 22044 tablet_bootstrap.cc:654] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.815603 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.841653 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:21.841961 21994 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.836063 22048 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.842260 21849 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.853276 22043 tablet_bootstrap.cc:492] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:21.853889 22043 ts_tablet_manager.cc:1403] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.495s	user 0.020s	sys 0.009s
I20260709 12:09:21.856479 22305 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.869010 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.870307 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.869244 21998 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:21.872015 21817 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:21.872781 22049 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.872972 21926 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:21.873265 22049 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:21.874966 22000 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:21.874110 22049 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.875748 22050 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.876156 22177 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.876449 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:21.889619 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:21.894647 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:09:21.902951 21817 leader_election.cc:343] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.903290 22043 raft_consensus.cc:359] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.904181 22043 raft_consensus.cc:385] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.902868 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:21.903134 22172 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.904510 22043 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.886042 22246 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:09:21.909582 22043 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.923014 22042 tablet_bootstrap.cc:654] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.921749 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:21.927539 21927 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:21.926563 22237 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:21.940094 21892 leader_election.cc:343] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.943284 21892 leader_election.cc:343] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.943715 21892 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:21.944700 22301 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.925905 22306 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.961963 22043 ts_tablet_manager.cc:1434] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.001s
I20260709 12:09:21.963795 22043 tablet_bootstrap.cc:492] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:21.937410 22237 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:21.961301 21848 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:21.974900 21852 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:09:21.967655 21996 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 1: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:09:21.980460 22306 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:21.961234 21849 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:21.981699 21966 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:21.986943 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:21.987702 22074 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.982102 22237 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.992828 22049 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:21.988157 22074 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:21.997213 22074 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:21.995996 21815 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:21.998800 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:21.988451 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:22.004654 22044 tablet_bootstrap.cc:492] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:22.007267 22306 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.007663 22306 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.008025 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:22.006382 22044 ts_tablet_manager.cc:1403] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.330s	user 0.016s	sys 0.024s
I20260709 12:09:22.011545 22315 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:09:22.007992 22306 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.008939 22300 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.992588 22237 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.018503 22307 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:22.015750 22246 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:09:22.115505 22237 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:22.115746 22042 tablet_bootstrap.cc:492] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:22.116406 22042 ts_tablet_manager.cc:1403] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.418s	user 0.026s	sys 0.021s
I20260709 12:09:22.119004 22306 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.120570 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:22.122642 21923 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.122581 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:22.125197 22042 raft_consensus.cc:359] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.126454 22042 raft_consensus.cc:385] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.126715 22042 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.135804 22044 raft_consensus.cc:359] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.136618 22044 raft_consensus.cc:385] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.136941 22044 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.137673 22044 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.146726 22044 ts_tablet_manager.cc:1434] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.137s	user 0.004s	sys 0.003s
I20260709 12:09:22.147678 22042 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.157146 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:22.157789 21927 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.159399 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:22.161399 22049 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.167351 21927 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:22.167546 22042 ts_tablet_manager.cc:1434] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:09:22.175643 22042 tablet_bootstrap.cc:492] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:22.181852 22300 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:22.194204 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:22.199414 21817 leader_election.cc:343] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.209324 22044 tablet_bootstrap.cc:492] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
W20260709 12:09:22.211794 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 174888us
I20260709 12:09:22.224087 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:22.192956 22300 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.222636 21815 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:22.258687 22043 tablet_bootstrap.cc:654] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.226440 22074 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
W20260709 12:09:22.239475 22319 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:09:22.241436 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:22.282693 21852 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:09:22.274856 22305 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.283447 22305 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:22.284356 22305 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.287575 22042 tablet_bootstrap.cc:654] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.255873 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:09:22.268366 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56814.7us
I20260709 12:09:22.298738 22050 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.306864 21964 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:22.308746 22307 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.320777 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 54435.3us
I20260709 12:09:22.327145 22306 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.321836 21923 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:22.349865 22303 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.371348 22334 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.371876 22334 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.373819 22307 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.374639 22334 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.372498 21964 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:22.378432 22050 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.378881 22050 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:22.379565 22050 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.381851 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:22.387492 21892 leader_election.cc:343] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.387724 22044 tablet_bootstrap.cc:654] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.392802 22043 tablet_bootstrap.cc:492] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:22.393234 22043 ts_tablet_manager.cc:1403] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.430s	user 0.008s	sys 0.028s
W20260709 12:09:22.395386 21798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.398244 22043 raft_consensus.cc:359] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.399233 22043 raft_consensus.cc:385] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.399730 22043 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.400357 22043 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.399420 21750 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.409303 22043 ts_tablet_manager.cc:1434] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:09:22.411895 22174 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.414881 22043 tablet_bootstrap.cc:492] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:22.415868 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:22.417752 22174 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.421298 22174 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.422435 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:22.433410 21748 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:22.432487 21817 leader_election.cc:343] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.430557 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:22.439064 21926 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:22.441646 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:22.444422 22305 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.444831 22305 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.445163 22305 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.443101 21892 leader_election.cc:343] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.447929 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:22.460297 22044 tablet_bootstrap.cc:492] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:22.460731 22044 ts_tablet_manager.cc:1403] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.252s	user 0.026s	sys 0.019s
I20260709 12:09:22.450824 22334 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.469046 22174 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.470748 22305 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.473191 22043 tablet_bootstrap.cc:654] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.477655 22044 raft_consensus.cc:359] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.478456 22044 raft_consensus.cc:385] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.478775 22044 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.479460 22044 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.483111 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:22.483691 21920 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.484071 22044 ts_tablet_manager.cc:1434] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:09:22.484191 22042 tablet_bootstrap.cc:492] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:22.484681 22042 ts_tablet_manager.cc:1403] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.309s	user 0.012s	sys 0.010s
I20260709 12:09:22.484860 22044 tablet_bootstrap.cc:492] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:22.490554 22305 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.493793 22042 raft_consensus.cc:359] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.494083 22306 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.494592 22042 raft_consensus.cc:385] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.494931 22042 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.497238 22042 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.497233 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:22.500242 21817 leader_election.cc:343] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.501121 22042 ts_tablet_manager.cc:1434] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:09:22.501362 22044 tablet_bootstrap.cc:654] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.502049 22042 tablet_bootstrap.cc:492] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:22.510397 22043 tablet_bootstrap.cc:492] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:22.510883 22043 ts_tablet_manager.cc:1403] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.005s
I20260709 12:09:22.511763 22042 tablet_bootstrap.cc:654] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.512485 21920 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:22.513437 22043 raft_consensus.cc:359] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.513608 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:22.514158 22043 raft_consensus.cc:385] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.514472 22043 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.514577 22306 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.515183 22306 raft_consensus.cc:697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:22.515306 22043 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.516355 22306 consensus_queue.cc:237] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.519034 22044 tablet_bootstrap.cc:492] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:22.519503 22044 ts_tablet_manager.cc:1403] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.005s
I20260709 12:09:22.522802 22044 raft_consensus.cc:359] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.523644 22044 raft_consensus.cc:385] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.523996 22044 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.525348 22043 ts_tablet_manager.cc:1434] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:22.526683 22043 tablet_bootstrap.cc:492] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:22.528892 22044 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.537153 22044 ts_tablet_manager.cc:1434] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:09:22.550102 22043 tablet_bootstrap.cc:654] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.562716 22042 tablet_bootstrap.cc:492] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:22.560120 22044 tablet_bootstrap.cc:492] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:22.563198 22042 ts_tablet_manager.cc:1403] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.061s	user 0.027s	sys 0.023s
I20260709 12:09:22.565687 22042 raft_consensus.cc:359] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.566351 22042 raft_consensus.cc:385] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.566634 22042 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.567355 22042 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.568120 22050 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.568548 22050 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.569630 22042 ts_tablet_manager.cc:1434] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:22.570456 22050 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:22.570984 22042 tablet_bootstrap.cc:492] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:22.572775 22044 tablet_bootstrap.cc:654] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.572957 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:22.573894 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:22.574759 21920 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:09:22.577076 22042 tablet_bootstrap.cc:654] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.579001 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:22.580022 22311 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.588204 22042 tablet_bootstrap.cc:492] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:22.588660 22042 ts_tablet_manager.cc:1403] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:09:22.557687 21749 catalog_manager.cc:5697] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.591187 22042 raft_consensus.cc:359] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.591778 22042 raft_consensus.cc:385] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.592027 22042 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.592630 22042 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.595362 22042 ts_tablet_manager.cc:1434] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:09:22.596239 22042 tablet_bootstrap.cc:492] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:22.597497 22311 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.600450 22043 tablet_bootstrap.cc:492] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:22.601091 22044 tablet_bootstrap.cc:492] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:22.604244 22043 ts_tablet_manager.cc:1403] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.008s
I20260709 12:09:22.604444 22044 ts_tablet_manager.cc:1403] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.011s
I20260709 12:09:22.606964 22043 raft_consensus.cc:359] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.607702 22043 raft_consensus.cc:385] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.607724 22044 raft_consensus.cc:359] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.602139 22042 tablet_bootstrap.cc:654] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.608429 22044 raft_consensus.cc:385] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.608815 22044 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.608827 21748 catalog_manager.cc:5697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.609637 22044 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.611413 21748 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.612360 22044 ts_tablet_manager.cc:1434] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:22.613268 22044 tablet_bootstrap.cc:492] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:22.608084 22043 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.616163 22043 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.616449 22249 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.622061 22042 tablet_bootstrap.cc:492] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:22.622970 22042 ts_tablet_manager.cc:1403] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.001s
I20260709 12:09:22.623580 22044 tablet_bootstrap.cc:654] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.626344 22043 ts_tablet_manager.cc:1434] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:09:22.627382 22043 tablet_bootstrap.cc:492] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:22.630447 21750 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.631414 21997 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.632928 22043 tablet_bootstrap.cc:654] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.646183 22311 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.646718 22311 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.651561 22044 tablet_bootstrap.cc:492] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:22.652035 22044 ts_tablet_manager.cc:1403] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 12:09:22.652244 22334 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.654592 22044 raft_consensus.cc:359] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.655267 22044 raft_consensus.cc:385] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.655534 22044 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.656842 22311 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:22.657938 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:22.658865 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:22.660535 21966 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:22.660614 22044 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.661886 22050 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:22.662456 22044 ts_tablet_manager.cc:1434] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:22.662906 22042 raft_consensus.cc:359] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.663352 22044 tablet_bootstrap.cc:492] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:22.663563 22042 raft_consensus.cc:385] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.663822 22042 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.664434 22042 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.669046 22042 ts_tablet_manager.cc:1434] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.002s
I20260709 12:09:22.669766 22044 tablet_bootstrap.cc:654] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.669955 22042 tablet_bootstrap.cc:492] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:22.675403 22249 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.676040 22249 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.678565 22249 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.681042 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:22.682343 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:09:22.684122 21892 leader_election.cc:343] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.686844 21892 leader_election.cc:343] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.687341 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:22.688510 22249 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.692744 22042 tablet_bootstrap.cc:654] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.696954 22043 tablet_bootstrap.cc:492] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:22.697374 22043 ts_tablet_manager.cc:1403] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.039s
I20260709 12:09:22.700229 22044 tablet_bootstrap.cc:492] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:22.699939 22043 raft_consensus.cc:359] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.700572 22044 ts_tablet_manager.cc:1403] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.005s
I20260709 12:09:22.700598 22043 raft_consensus.cc:385] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.700958 22043 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.701619 22043 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.702311 22044 raft_consensus.cc:359] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.703281 22044 raft_consensus.cc:385] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.703540 22044 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.704149 22044 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.706568 22044 ts_tablet_manager.cc:1434] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:22.707396 22044 tablet_bootstrap.cc:492] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:22.717427 22043 ts_tablet_manager.cc:1434] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:09:22.718221 22043 tablet_bootstrap.cc:492] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:22.719079 22042 tablet_bootstrap.cc:492] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:22.719982 22042 ts_tablet_manager.cc:1403] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.004s
I20260709 12:09:22.721779 22303 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.722671 22044 tablet_bootstrap.cc:654] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.722566 22174 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.724251 22043 tablet_bootstrap.cc:654] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.736769 22043 tablet_bootstrap.cc:492] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:22.737226 22043 ts_tablet_manager.cc:1403] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:09:22.740912 22043 raft_consensus.cc:359] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.741784 22043 raft_consensus.cc:385] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.742143 22043 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.743161 22043 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.745898 22043 ts_tablet_manager.cc:1434] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:22.753183 22043 tablet_bootstrap.cc:492] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:22.757575 21994 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.761646 22307 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.762131 22307 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.766294 22307 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:22.771422 22042 raft_consensus.cc:359] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.772158 22042 raft_consensus.cc:385] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.772476 22042 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.773152 22042 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.775831 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:22.775626 22174 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.776484 21926 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:22.778354 22042 ts_tablet_manager.cc:1434] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.001s
I20260709 12:09:22.778892 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:22.781044 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:22.782014 21844 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:22.783120 22050 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.783615 22050 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.783985 22050 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.787073 22311 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.787564 22311 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.787282 22043 tablet_bootstrap.cc:654] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.789029 22042 tablet_bootstrap.cc:492] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:22.790927 22311 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:22.797513 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:22.798713 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:22.800047 21964 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:22.805687 22050 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.808686 22050 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:22.811419 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:22.812014 21926 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.813795 22044 tablet_bootstrap.cc:492] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:22.810843 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:22.815594 21844 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.815639 22044 ts_tablet_manager.cc:1403] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.108s	user 0.022s	sys 0.045s
I20260709 12:09:22.819700 22044 raft_consensus.cc:359] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.820402 22044 raft_consensus.cc:385] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.820665 22044 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.821399 22044 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.823482 22044 ts_tablet_manager.cc:1434] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:22.827880 22042 tablet_bootstrap.cc:654] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.828403 22044 tablet_bootstrap.cc:492] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:22.834578 22334 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.838356 22044 tablet_bootstrap.cc:654] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.847466 22043 tablet_bootstrap.cc:492] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:22.847887 22043 ts_tablet_manager.cc:1403] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.006s
I20260709 12:09:22.847879 22304 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.848517 22304 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.848932 22311 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:22.850714 22304 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.850612 22043 raft_consensus.cc:359] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.851289 22043 raft_consensus.cc:385] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.851553 22043 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.852154 22043 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.855578 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:22.855674 21844 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:22.856256 21994 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:22.856777 21966 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:22.856930 22311 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.857344 21817 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:22.857548 22050 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.857856 21926 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:22.858376 22050 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:22.859001 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:22.859298 22311 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.859169 22050 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.859601 21926 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:22.861220 22174 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.861568 22174 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.861925 22174 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.864583 22304 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.865015 22304 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.867918 22304 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.867966 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:22.868782 21920 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:22.870462 21815 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:22.868873 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:22.871402 22304 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.871934 22304 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.872382 22304 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.878273 22174 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.881425 22044 tablet_bootstrap.cc:492] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:22.881515 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:22.882391 21920 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.882774 22044 ts_tablet_manager.cc:1403] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.001s
I20260709 12:09:22.882977 21997 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:22.885565 22044 raft_consensus.cc:359] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.886245 22044 raft_consensus.cc:385] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.886569 22044 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.887348 22044 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.889611 22044 ts_tablet_manager.cc:1434] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:22.890501 22044 tablet_bootstrap.cc:492] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:22.891191 22043 ts_tablet_manager.cc:1434] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.043s	user 0.002s	sys 0.004s
I20260709 12:09:22.892210 22043 tablet_bootstrap.cc:492] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:22.895860 21920 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:22.896711 22042 tablet_bootstrap.cc:492] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:22.897186 22042 ts_tablet_manager.cc:1403] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.108s	user 0.007s	sys 0.004s
I20260709 12:09:22.897198 21815 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:22.898149 22306 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.898639 22306 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:22.899502 22306 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.901242 22304 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.909925 22043 tablet_bootstrap.cc:654] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.913180 22044 tablet_bootstrap.cc:654] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.916854 22304 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.918026 22334 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.918717 22334 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.921353 22334 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.929039 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:22.929778 21926 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.911823 22042 raft_consensus.cc:359] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.930729 22042 raft_consensus.cc:385] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.931036 22042 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.931763 22042 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.931535 21748 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.934091 22042 ts_tablet_manager.cc:1434] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:09:22.934866 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:22.938395 21997 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.938396 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:22.935983 22174 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.942651 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:22.943222 21994 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.943440 22303 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.943920 22303 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.946307 22303 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:22.947154 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:22.947472 22042 tablet_bootstrap.cc:492] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:22.953568 22042 tablet_bootstrap.cc:654] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.954738 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:22.954948 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:22.955368 21844 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:22.951557 21994 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:22.957047 21926 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:22.958253 21815 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:22.960744 22304 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:22.962778 21892 leader_election.cc:343] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.965481 21892 leader_election.cc:343] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.969852 21892 leader_election.cc:343] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.970235 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:22.962549 22304 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:22.977061 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:22.979803 22303 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.980208 22303 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.981382 22304 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:22.984581 22303 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.975674 22334 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.986616 22043 tablet_bootstrap.cc:492] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:23.002835 22043 ts_tablet_manager.cc:1403] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.111s	user 0.017s	sys 0.000s
I20260709 12:09:22.980676 21997 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:23.007994 22306 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.008878 22044 tablet_bootstrap.cc:492] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.008535 22306 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.009344 22044 ts_tablet_manager.cc:1403] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.119s	user 0.039s	sys 0.004s
I20260709 12:09:22.992419 22303 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.015661 22246 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.016306 22306 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.016232 22246 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.018049 22044 raft_consensus.cc:359] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.018810 22044 raft_consensus.cc:385] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.019055 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.018302 22306 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.019111 22246 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.019138 22044 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.020296 22044 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.020359 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.022480 21926 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:23.023105 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:23.023748 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:23.024202 22044 ts_tablet_manager.cc:1434] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:09:23.023767 21848 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:23.025208 22044 tablet_bootstrap.cc:492] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.025290 22303 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.025104 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.027010 22306 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.023617 22043 raft_consensus.cc:359] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.027796 22043 raft_consensus.cc:385] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.028095 22043 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.027560 22306 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.029111 22043 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.029814 22306 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.030864 21997 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:23.034330 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:09:23.035655 21892 leader_election.cc:343] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.036587 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:23.034969 21848 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.038992 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:23.041321 22043 ts_tablet_manager.cc:1434] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:09:23.042695 22043 tablet_bootstrap.cc:492] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:23.043984 21848 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
W20260709 12:09:23.048359 21892 leader_election.cc:343] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.049216 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:23.053086 22303 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.053661 22303 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.054805 22246 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.054113 22303 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.059963 22303 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.060578 21750 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.062282 21750 catalog_manager.cc:5697] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.061852 22331 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.064142 22331 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.065834 22044 tablet_bootstrap.cc:654] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.061900 22246 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:23.067377 22331 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.059399 22306 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.070833 22304 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.071666 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.071743 22304 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.068667 22246 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.072971 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:23.074347 22304 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:09:23.076347 21892 leader_election.cc:343] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.076838 21892 leader_election.cc:343] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.077117 21892 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:23.077857 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.079010 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.079610 21926 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:23.079859 22306 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:09:23.081565 21817 leader_election.cc:343] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.082067 22042 tablet_bootstrap.cc:492] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:23.082624 22042 ts_tablet_manager.cc:1403] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.015s
I20260709 12:09:23.082115 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:23.088167 22331 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.088979 22177 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.089264 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:23.089511 22177 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.089890 22177 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.088938 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:23.098172 22303 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.089902 21998 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.100509 22042 raft_consensus.cc:359] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.101274 22042 raft_consensus.cc:385] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.102829 22042 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.103612 22042 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.102553 22043 tablet_bootstrap.cc:654] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.105216 21926 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.113284 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:23.114104 21844 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.118091 22042 ts_tablet_manager.cc:1434] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:09:23.119057 22042 tablet_bootstrap.cc:492] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:23.125247 21844 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:23.125455 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:23.126784 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:23.129142 21749 catalog_manager.cc:5697] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.137650 21998 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
W20260709 12:09:23.149744 21892 leader_election.cc:343] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.144071 22177 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.150902 21817 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:23.151757 22386 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.152261 22386 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:23.152462 22177 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.150651 22044 tablet_bootstrap.cc:492] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.153123 22386 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.153796 22044 ts_tablet_manager.cc:1403] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.129s	user 0.007s	sys 0.020s
I20260709 12:09:23.157531 22044 raft_consensus.cc:359] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.158638 22044 raft_consensus.cc:385] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.158978 21926 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:23.159089 22044 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.160557 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:23.162113 21817 leader_election.cc:343] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.149587 22303 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.163313 22303 raft_consensus.cc:697] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:23.163722 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:23.164311 21926 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.164160 22303 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.160454 22044 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.170940 22387 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:23.178447 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 45671.8us
I20260709 12:09:23.182880 22044 ts_tablet_manager.cc:1434] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.005s
I20260709 12:09:23.184646 22042 tablet_bootstrap.cc:654] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.190111 22044 tablet_bootstrap.cc:492] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.192628 21926 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:23.194070 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:23.193639 21750 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.197700 22387 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.198352 22387 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:23.199225 22387 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.219472 22042 tablet_bootstrap.cc:492] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:23.221051 22042 ts_tablet_manager.cc:1403] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.002s
I20260709 12:09:23.223716 22042 raft_consensus.cc:359] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.224462 22042 raft_consensus.cc:385] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.224726 22042 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.225340 22042 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.227362 22042 ts_tablet_manager.cc:1434] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:23.228209 22042 tablet_bootstrap.cc:492] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:23.237795 22042 tablet_bootstrap.cc:654] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.241065 21750 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.244449 22044 tablet_bootstrap.cc:654] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.261979 22043 tablet_bootstrap.cc:492] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:23.262449 22043 ts_tablet_manager.cc:1403] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.220s	user 0.059s	sys 0.046s
I20260709 12:09:23.265399 22043 raft_consensus.cc:359] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.266055 22043 raft_consensus.cc:385] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.266335 22043 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.266835 22044 tablet_bootstrap.cc:492] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.267321 22044 ts_tablet_manager.cc:1403] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.002s
I20260709 12:09:23.266960 22043 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.273439 22044 raft_consensus.cc:359] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.273964 22044 raft_consensus.cc:385] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.274238 22044 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.275396 22043 ts_tablet_manager.cc:1434] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:09:23.275827 22044 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.276338 22043 tablet_bootstrap.cc:492] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:23.289433 22044 ts_tablet_manager.cc:1434] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:09:23.290210 22044 tablet_bootstrap.cc:492] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.290549 22042 tablet_bootstrap.cc:492] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:23.291002 22042 ts_tablet_manager.cc:1403] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.008s
I20260709 12:09:23.281673 21749 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.295805 22044 tablet_bootstrap.cc:654] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.299877 22307 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.295457 22042 raft_consensus.cc:359] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.304934 22043 tablet_bootstrap.cc:654] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.305778 22042 raft_consensus.cc:385] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.312318 22042 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.313592 22042 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.318089 22042 ts_tablet_manager.cc:1434] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:09:23.319010 22042 tablet_bootstrap.cc:492] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:23.325227 22044 tablet_bootstrap.cc:492] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.326623 22044 ts_tablet_manager.cc:1403] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.009s
I20260709 12:09:23.329631 22044 raft_consensus.cc:359] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.330278 22044 raft_consensus.cc:385] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.330561 22044 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.331744 22044 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.334692 22043 tablet_bootstrap.cc:492] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:23.335155 22043 ts_tablet_manager.cc:1403] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.004s
I20260709 12:09:23.336374 22044 ts_tablet_manager.cc:1434] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:09:23.337643 22044 tablet_bootstrap.cc:492] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.337770 22042 tablet_bootstrap.cc:654] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.342373 22043 raft_consensus.cc:359] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.343174 22043 raft_consensus.cc:385] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.343439 22043 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.344269 22043 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.345943 22044 tablet_bootstrap.cc:654] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.350879 22044 tablet_bootstrap.cc:492] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.351300 22044 ts_tablet_manager.cc:1403] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:09:23.351432 22043 ts_tablet_manager.cc:1434] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:09:23.352348 22043 tablet_bootstrap.cc:492] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:23.353752 22044 raft_consensus.cc:359] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.363173 22050 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.365906 22042 tablet_bootstrap.cc:492] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:23.366912 22042 ts_tablet_manager.cc:1403] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.002s
I20260709 12:09:23.354405 22044 raft_consensus.cc:385] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.368136 22044 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.369210 22044 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.370246 22042 raft_consensus.cc:359] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.370947 22042 raft_consensus.cc:385] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.371210 22042 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.372090 22044 ts_tablet_manager.cc:1434] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:09:23.372937 22042 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.373593 22044 tablet_bootstrap.cc:492] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.375546 22042 ts_tablet_manager.cc:1434] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:09:23.376451 22042 tablet_bootstrap.cc:492] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:23.382232 22042 tablet_bootstrap.cc:654] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.383445 22044 tablet_bootstrap.cc:654] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.384651 22043 tablet_bootstrap.cc:654] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.393951 22043 tablet_bootstrap.cc:492] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:23.394079 22303 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.394397 22043 ts_tablet_manager.cc:1403] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.003s
I20260709 12:09:23.394951 22303 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.397182 22303 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.398726 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:23.400141 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:23.400799 21892 leader_election.cc:343] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.401566 21892 leader_election.cc:343] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.402010 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:23.403048 22331 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.405414 22044 tablet_bootstrap.cc:492] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.405885 22044 ts_tablet_manager.cc:1403] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
I20260709 12:09:23.407939 22044 raft_consensus.cc:359] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.408449 22044 raft_consensus.cc:385] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.408689 22044 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.409297 22044 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.411243 22044 ts_tablet_manager.cc:1434] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:09:23.411195 22043 raft_consensus.cc:359] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.412140 22043 raft_consensus.cc:385] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.412356 22044 tablet_bootstrap.cc:492] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.412464 22043 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.413367 22043 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.418095 22044 tablet_bootstrap.cc:654] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.432142 22043 ts_tablet_manager.cc:1434] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:09:23.433041 22043 tablet_bootstrap.cc:492] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:23.435464 22387 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.438807 22043 tablet_bootstrap.cc:654] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.443950 22387 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.446087 22044 tablet_bootstrap.cc:492] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.446568 22044 ts_tablet_manager.cc:1403] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.015s
I20260709 12:09:23.449618 22044 raft_consensus.cc:359] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.450433 22044 raft_consensus.cc:385] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.450732 22044 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.451447 22044 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.453118 22387 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.453606 22044 ts_tablet_manager.cc:1434] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:23.453564 22387 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.455654 22387 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.456720 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.457360 21994 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:23.458308 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:09:23.459712 21815 leader_election.cc:343] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.461339 21817 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:23.462711 22174 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.463064 22174 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.463387 22174 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.465808 22042 tablet_bootstrap.cc:492] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:23.466972 22044 tablet_bootstrap.cc:492] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.467980 22331 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.468437 22331 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.469990 22387 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.471889 22174 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.474023 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:23.475560 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:23.475832 21892 leader_election.cc:343] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.476130 21994 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.475848 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.474028 22174 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.477340 22331 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:09:23.478242 21892 leader_election.cc:343] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.480417 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:23.481766 22303 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.483959 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:09:23.486126 21815 leader_election.cc:343] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.487629 21994 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:23.488772 21817 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:23.489780 22306 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.490236 22306 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:23.491053 22306 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.492215 22044 tablet_bootstrap.cc:654] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.494316 22050 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.494758 22050 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.495990 22174 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.497174 22050 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:23.504925 22044 tablet_bootstrap.cc:492] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.505321 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:23.505759 22044 ts_tablet_manager.cc:1403] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.005s
I20260709 12:09:23.506125 21844 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:23.507972 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:23.509500 22050 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.509984 22050 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.510462 22050 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.508308 22044 raft_consensus.cc:359] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.512326 22044 raft_consensus.cc:385] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.512619 22044 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.513268 22044 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.514645 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.515249 21925 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:23.516850 22303 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.517318 22303 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.519222 22303 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.526257 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:09:23.527987 21798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.529109 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.531635 22042 ts_tablet_manager.cc:1403] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.000s
W20260709 12:09:23.529914 21892 leader_election.cc:343] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.537534 22043 tablet_bootstrap.cc:492] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:23.542121 22043 ts_tablet_manager.cc:1403] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.018s
I20260709 12:09:23.544948 22306 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.545410 22043 raft_consensus.cc:359] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.546178 22043 raft_consensus.cc:385] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.546530 22043 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.546711 21892 consensus_peers.cc:597] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.545457 22306 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:23.547313 21892 leader_election.cc:343] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.547714 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:23.547482 22043 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.549264 22303 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.550029 22303 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.552160 22043 ts_tablet_manager.cc:1434] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:09:23.553189 22043 tablet_bootstrap.cc:492] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:23.553454 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.554028 21926 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:23.554977 21815 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:23.480710 22387 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.555923 22387 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.556556 22177 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.556979 22177 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.557322 22177 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.558398 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.559599 22043 tablet_bootstrap.cc:654] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.559549 21815 leader_election.cc:343] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.561952 22042 raft_consensus.cc:359] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.562659 22042 raft_consensus.cc:385] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.562938 22042 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.563594 22042 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.566980 22050 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.576363 22044 ts_tablet_manager.cc:1434] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.070s	user 0.002s	sys 0.003s
I20260709 12:09:23.577334 22044 tablet_bootstrap.cc:492] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.576965 22177 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.582532 22387 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.585429 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:23.587384 21817 leader_election.cc:343] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.587940 21817 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:23.589174 22042 ts_tablet_manager.cc:1434] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 12:09:23.590081 22042 tablet_bootstrap.cc:492] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:23.590924 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:23.591511 21850 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.595196 22387 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.598930 22050 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:23.599690 21850 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:23.600840 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:23.601768 22387 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.604707 22050 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.607784 22042 tablet_bootstrap.cc:654] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.608667 22050 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:23.614149 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.620502 22334 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.622262 22044 tablet_bootstrap.cc:654] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.621814 21817 leader_election.cc:343] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.622596 22050 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.624985 22043 tablet_bootstrap.cc:492] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:23.625784 22043 ts_tablet_manager.cc:1403] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.073s	user 0.032s	sys 0.036s
I20260709 12:09:23.631438 22386 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.631934 22386 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.633958 22386 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.635869 22043 raft_consensus.cc:359] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.636611 22043 raft_consensus.cc:385] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.638933 22043 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.639804 22043 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.637533 22044 tablet_bootstrap.cc:492] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.640969 22044 ts_tablet_manager.cc:1403] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.009s
I20260709 12:09:23.643646 22044 raft_consensus.cc:359] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.644412 22044 raft_consensus.cc:385] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.644842 22044 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.647302 22044 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.646518 22043 ts_tablet_manager.cc:1434] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.005s
I20260709 12:09:23.649197 22043 tablet_bootstrap.cc:492] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:23.651073 22386 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.652037 22386 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.654325 22386 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.656191 22246 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.651472 22044 ts_tablet_manager.cc:1434] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:09:23.656857 22246 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.659807 22246 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.660342 22044 tablet_bootstrap.cc:492] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.660615 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.661209 21994 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:23.664475 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.662704 21998 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.668109 22043 tablet_bootstrap.cc:654] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.671227 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:23.670822 22044 tablet_bootstrap.cc:654] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.677232 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:09:23.678733 21892 leader_election.cc:343] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.681409 21892 leader_election.cc:343] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.681586 22306 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.681792 21892 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:23.683722 21817 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:09:23.684566 21817 leader_election.cc:343] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.685465 22043 tablet_bootstrap.cc:492] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:23.685601 21748 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.686353 22177 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.686439 22043 ts_tablet_manager.cc:1403] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.003s
I20260709 12:09:23.687906 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:23.689014 22386 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.689498 22386 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.689846 22386 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.691915 21817 leader_election.cc:343] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.694377 22249 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.696406 22043 raft_consensus.cc:359] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.697060 22043 raft_consensus.cc:385] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.697310 22043 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.698685 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.699870 22043 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.700995 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:23.701491 21926 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.729308 22044 tablet_bootstrap.cc:492] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:23.731333 22042 tablet_bootstrap.cc:492] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:23.740381 22246 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.732419 22050 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.741541 22042 ts_tablet_manager.cc:1403] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.002s
I20260709 12:09:23.741797 22050 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.741585 22246 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.743613 22246 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.743981 22050 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:23.744195 22044 ts_tablet_manager.cc:1403] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.005s
I20260709 12:09:23.733026 21926 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:23.744712 22042 raft_consensus.cc:359] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.746188 22246 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.731528 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.748170 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:23.734180 22043 ts_tablet_manager.cc:1434] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.001s
I20260709 12:09:23.751395 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.752887 21926 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 1: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:09:23.755964 22043 tablet_bootstrap.cc:492] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:23.745494 22042 raft_consensus.cc:385] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.762030 22042 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.768047 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.763969 22042 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.777508 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:23.788532 22042 ts_tablet_manager.cc:1434] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:09:23.788511 21966 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:23.799835 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:23.800554 21921 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.794227 22307 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.787459 21997 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 1: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:09:23.811901 21815 leader_election.cc:343] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.812830 21815 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:23.813423 22042 tablet_bootstrap.cc:492] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
W20260709 12:09:23.815294 21815 leader_election.cc:343] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.813583 21748 catalog_manager.cc:5697] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.816918 22387 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.817945 22044 raft_consensus.cc:359] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.821676 22044 raft_consensus.cc:385] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.821964 22044 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.799901 22386 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.815707 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:23.820910 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:23.825682 22303 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.822744 22044 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.831838 22387 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:23.833086 22423 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.846920 22174 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.847393 22177 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.849722 22387 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.849676 22174 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.863430 22386 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.866513 22174 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.867255 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:23.867861 21994 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.868647 22303 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.869782 22174 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.888566 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.889254 21920 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:23.889384 22044 ts_tablet_manager.cc:1434] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.145s	user 0.008s	sys 0.002s
I20260709 12:09:23.890853 22044 tablet_bootstrap.cc:492] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:23.891712 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.892568 22043 tablet_bootstrap.cc:654] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.883361 22172 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:09:23.892709 22307 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.892994 22172 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.883394 22174 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.909505 21815 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:23.905988 21921 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:23.923954 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:23.966980 22042 tablet_bootstrap.cc:654] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.934492 22422 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.902913 22174 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:23.979862 22174 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:23.969341 22422 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:23.986634 21817 leader_election.cc:343] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.989012 21815 leader_election.cc:343] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.967928 21994 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:23.994486 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:23.999639 21918 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:24.000735 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:23.990465 22422 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.004276 21748 catalog_manager.cc:5697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.983669 22174 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 12:09:24.020287 21817 leader_election.cc:343] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.021037 21817 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:24.026134 22306 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.023599 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:24.028003 22306 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.028476 22306 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.028833 22306 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.029102 22304 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.029651 22304 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:24.031030 22304 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.033116 22422 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.036953 22042 tablet_bootstrap.cc:492] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:24.037551 22042 ts_tablet_manager.cc:1403] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.224s	user 0.006s	sys 0.013s
I20260709 12:09:24.044241 22042 raft_consensus.cc:359] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.045140 22042 raft_consensus.cc:385] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.045477 22042 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.046334 22042 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.055542 22042 ts_tablet_manager.cc:1434] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:24.057741 22042 tablet_bootstrap.cc:492] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:24.056528 22172 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:24.057756 22044 tablet_bootstrap.cc:654] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.060830 22306 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.069880 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:24.070188 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:09:24.072414 21817 leader_election.cc:343] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.065837 22422 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.115025 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:24.120469 22423 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.120772 21925 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.122370 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:24.122936 21926 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.128870 22306 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.129227 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:24.121006 22423 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.210520 22042 tablet_bootstrap.cc:654] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.213812 22043 tablet_bootstrap.cc:492] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:24.214236 22043 ts_tablet_manager.cc:1403] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.459s	user 0.034s	sys 0.037s
I20260709 12:09:24.214191 21926 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:24.232177 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:24.226933 22438 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.236753 22438 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.248926 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:24.237924 21925 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:24.254657 22304 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.255048 22043 raft_consensus.cc:359] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.255342 22304 raft_consensus.cc:697] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:24.255792 22043 raft_consensus.cc:385] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.256094 22043 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.256552 22304 consensus_queue.cc:237] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.263527 22423 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.264267 22043 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:24.271060 21817 leader_election.cc:343] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.274392 22043 ts_tablet_manager.cc:1434] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.003s
I20260709 12:09:24.275861 22043 tablet_bootstrap.cc:492] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:24.277657 22042 tablet_bootstrap.cc:492] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:24.278095 22042 ts_tablet_manager.cc:1403] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.221s	user 0.014s	sys 0.023s
I20260709 12:09:24.293537 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:24.296613 22050 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:24.312624 22172 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.313138 22172 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.313683 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:24.314136 22044 tablet_bootstrap.cc:492] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:24.314975 22044 ts_tablet_manager.cc:1403] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.425s	user 0.055s	sys 0.037s
I20260709 12:09:24.317258 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:24.317785 22438 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.317915 21921 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:24.324059 22042 raft_consensus.cc:359] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.325054 22042 raft_consensus.cc:385] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.325405 22042 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.326256 22042 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.327281 21815 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:09:24.334075 21817 leader_election.cc:343] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.334839 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:24.338377 21997 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.340133 22044 raft_consensus.cc:359] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.341198 22044 raft_consensus.cc:385] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.341480 22044 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.342902 22172 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:24.343503 22044 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.329838 22177 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.348428 21748 catalog_manager.cc:5697] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.349901 22042 ts_tablet_manager.cc:1434] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.004s
I20260709 12:09:24.354269 22177 raft_consensus.cc:697] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:24.355437 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:24.355325 22177 consensus_queue.cc:237] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.370746 22042 tablet_bootstrap.cc:492] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
W20260709 12:09:24.373792 21817 leader_election.cc:343] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.379340 22432 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:24.392746 22044 ts_tablet_manager.cc:1434] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.001s
I20260709 12:09:24.393769 22044 tablet_bootstrap.cc:492] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
W20260709 12:09:24.418382 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 60437.5us
I20260709 12:09:24.419947 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:24.425269 22450 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:24.396507 22432 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.070s
I20260709 12:09:24.467429 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:09:24.479190 22032 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.20.56.126:35507, user_credentials={real_user=slave}} blocked reactor thread for 50687.4us
I20260709 12:09:24.483572 21918 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:24.431315 22306 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.490176 22306 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.490689 22306 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.492208 22246 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.493711 22246 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.526726 22043 tablet_bootstrap.cc:654] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.509210 22306 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.538121 22042 tablet_bootstrap.cc:654] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.598770 22306 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.599752 22442 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.602833 22442 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.612668 22442 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.614918 22044 tablet_bootstrap.cc:654] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.620002 22043 tablet_bootstrap.cc:492] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:24.623086 22044 tablet_bootstrap.cc:492] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:24.623255 22043 ts_tablet_manager.cc:1403] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.348s	user 0.009s	sys 0.019s
I20260709 12:09:24.623548 22044 ts_tablet_manager.cc:1403] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.230s	user 0.013s	sys 0.004s
I20260709 12:09:24.624130 22042 tablet_bootstrap.cc:492] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:24.628897 22042 ts_tablet_manager.cc:1403] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.258s	user 0.020s	sys 0.021s
I20260709 12:09:24.631915 22042 raft_consensus.cc:359] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.632454 22042 raft_consensus.cc:385] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.632699 22042 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.633193 22042 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.634619 22042 ts_tablet_manager.cc:1434] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:09:24.634473 22043 raft_consensus.cc:359] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.635169 22043 raft_consensus.cc:385] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.635437 22043 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.635571 22042 tablet_bootstrap.cc:492] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:24.636054 22043 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.636758 22044 raft_consensus.cc:359] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.637431 22044 raft_consensus.cc:385] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.637669 22044 raft_consensus.cc:740] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.637743 22043 ts_tablet_manager.cc:1434] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:09:24.638294 22044 consensus_queue.cc:260] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.640398 22044 ts_tablet_manager.cc:1434] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:24.641220 22044 tablet_bootstrap.cc:492] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Bootstrap starting.
I20260709 12:09:24.641966 22043 tablet_bootstrap.cc:492] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:24.643187 22042 tablet_bootstrap.cc:654] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.646080 22246 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.649091 22044 tablet_bootstrap.cc:654] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.651666 22043 tablet_bootstrap.cc:654] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.653163 22042 tablet_bootstrap.cc:492] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:24.653709 22042 ts_tablet_manager.cc:1403] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:09:24.657244 22042 raft_consensus.cc:359] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.658174 22042 raft_consensus.cc:385] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.658571 22042 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.659399 22042 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.661495 22042 ts_tablet_manager.cc:1434] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:09:24.662732 22042 tablet_bootstrap.cc:492] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a: Bootstrap starting.
I20260709 12:09:24.666484 22044 tablet_bootstrap.cc:492] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: No bootstrap required, opened a new log
I20260709 12:09:24.666999 22044 ts_tablet_manager.cc:1403] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.006s
I20260709 12:09:24.668123 22043 tablet_bootstrap.cc:492] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:24.668624 22043 ts_tablet_manager.cc:1403] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.013s
I20260709 12:09:24.668975 22042 tablet_bootstrap.cc:654] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.670488 22044 raft_consensus.cc:359] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.671195 22044 raft_consensus.cc:385] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.671466 22044 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.672262 22044 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.671890 22043 raft_consensus.cc:359] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.677459 22044 ts_tablet_manager.cc:1434] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:09:24.677569 22043 raft_consensus.cc:385] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.678169 22043 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.678920 22043 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.682358 22042 tablet_bootstrap.cc:492] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a: No bootstrap required, opened a new log
I20260709 12:09:24.682859 22042 ts_tablet_manager.cc:1403] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.010s
I20260709 12:09:24.683210 22043 ts_tablet_manager.cc:1434] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:09:24.684295 22043 tablet_bootstrap.cc:492] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:24.685562 22042 raft_consensus.cc:359] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.686250 22042 raft_consensus.cc:385] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.686558 22042 raft_consensus.cc:740] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.687238 22042 consensus_queue.cc:260] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.689076 22042 ts_tablet_manager.cc:1434] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:09:24.691955 22043 tablet_bootstrap.cc:654] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.698256 22043 tablet_bootstrap.cc:492] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:24.698992 22043 ts_tablet_manager.cc:1403] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:09:24.701606 22043 raft_consensus.cc:359] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.702735 22043 raft_consensus.cc:385] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.703033 22043 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.703655 22043 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.705883 22043 ts_tablet_manager.cc:1434] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:09:24.706729 22043 tablet_bootstrap.cc:492] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:24.713580 22043 tablet_bootstrap.cc:654] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.720793 22043 tablet_bootstrap.cc:492] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:24.721247 22043 ts_tablet_manager.cc:1403] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:09:24.723563 22043 raft_consensus.cc:359] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.724215 22043 raft_consensus.cc:385] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.724534 22043 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.725133 22043 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.727252 22043 ts_tablet_manager.cc:1434] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:09:24.728055 22043 tablet_bootstrap.cc:492] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:24.731943 22306 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.735298 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:24.735941 21924 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.736400 22043 tablet_bootstrap.cc:654] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.742472 22043 tablet_bootstrap.cc:492] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:24.743345 22043 ts_tablet_manager.cc:1403] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.015s	user 0.003s	sys 0.009s
I20260709 12:09:24.745915 22043 raft_consensus.cc:359] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.746659 22043 raft_consensus.cc:385] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.746801 21924 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:24.746964 22043 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.731994 21815 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:24.747577 22043 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.748523 22436 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.748867 22436 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.749173 22436 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.749291 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:24.749648 22043 ts_tablet_manager.cc:1434] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:24.750511 22043 tablet_bootstrap.cc:492] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:24.751520 22450 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.752012 22450 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:24.753147 21919 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.765790 22427 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.753262 22450 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.773541 22423 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.797540 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:24.798905 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:24.799567 21847 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 0.
I20260709 12:09:24.809163 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:24.809865 22331 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.810245 22331 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.810636 22331 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.816442 22471 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.827337 22471 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.818563 22331 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.827845 22471 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.830178 22331 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.836923 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:24.837093 22471 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.837584 21921 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:24.838753 21815 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:24.838982 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:24.839656 21851 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.852041 21851 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:09:24.852300 22311 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.853330 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:24.854171 22331 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.854694 22331 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:24.855535 22331 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.852985 22311 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.858431 22311 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:24.864101 22306 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.864639 22306 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.865146 22306 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.887852 22311 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.888899 22311 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.892872 22311 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:24.893450 22438 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.901077 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:24.904551 22432 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.905253 22432 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.907756 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:24.910238 21923 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:24.914839 22451 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.917945 22451 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.920696 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:24.922012 22451 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:24.894124 22438 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:24.933825 22451 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.934231 22451 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.934587 22451 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.934764 22043 tablet_bootstrap.cc:654] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.925299 22432 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:24.935959 22438 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.932602 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:24.954252 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:24.954833 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:24.954962 21922 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:24.968899 22387 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:24.979517 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:24.980307 21996 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.981665 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:24.982609 22425 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.992792 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:24.993852 22434 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.994282 22434 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.994660 22434 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.005918 22434 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.007695 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:25.011059 21923 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:25.012020 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:25.013346 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:24.766352 22427 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.018946 21997 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 1: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:09:25.020534 22427 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:25.022360 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:25.024487 22427 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.024940 22427 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.025413 22427 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.035813 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:25.008090 22434 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:25.015010 22451 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.016978 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:25.038879 21918 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.042969 22436 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.047083 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:25.047842 21921 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.050160 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:25.051107 21845 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:25.055850 21918 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:25.056861 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:25.059171 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:25.077750 21922 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.081414 21995 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.061767 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:25.082944 21844 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 0.
I20260709 12:09:25.064034 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:25.066635 22451 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:25.068652 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:25.047083 22436 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:24.974232 22306 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.095362 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:25.096153 22451 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.096753 22451 raft_consensus.cc:697] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:25.097843 22306 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:25.097553 22451 consensus_queue.cc:237] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.057283 21921 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:25.105249 21815 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:25.071684 21996 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:25.074594 22043 tablet_bootstrap.cc:492] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:25.115444 22043 ts_tablet_manager.cc:1403] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.365s	user 0.015s	sys 0.005s
I20260709 12:09:25.116500 22306 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.117237 22306 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:25.118042 22306 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.099493 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:25.118340 22043 raft_consensus.cc:359] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.213840 22043 raft_consensus.cc:385] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.214223 22043 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
W20260709 12:09:25.171051 21892 leader_election.cc:343] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.216419 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 45427.9us
I20260709 12:09:25.215169 21918 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.229200 22043 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.100791 21922 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:25.329277 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:25.331543 21997 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.332037 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:25.331876 21918 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:25.332803 22443 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.328814 22451 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.333652 22451 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.335541 22451 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:25.339684 21966 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:25.341869 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:25.345865 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:25.346529 21999 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 0.
I20260709 12:09:25.128605 22427 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:25.348671 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 124143us
W20260709 12:09:25.351609 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 123649us
W20260709 12:09:25.384006 21798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:25.386628 22043 ts_tablet_manager.cc:1434] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.271s	user 0.011s	sys 0.005s
I20260709 12:09:25.387580 22043 tablet_bootstrap.cc:492] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
W20260709 12:09:25.389891 21892 leader_election.cc:343] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.390026 21815 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:25.391873 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:25.392237 22304 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.392673 21844 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.392750 22304 raft_consensus.cc:697] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:25.393797 22304 consensus_queue.cc:237] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.405804 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:25.406567 21850 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.351903 22451 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:25.422793 21817 leader_election.cc:343] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.440269 22427 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:25.442836 22432 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.446156 21850 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:25.450438 21966 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:09:25.500285 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 54466.6us
I20260709 12:09:25.496326 22172 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.528421 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:09:25.529799 22000 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.531090 22450 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.532069 22043 tablet_bootstrap.cc:654] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.500703 22478 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:09:25.531178 22489 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.516942 22172 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:25.534216 21844 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:09:25.546197 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:25.534117 22172 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.548501 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:25.557514 21993 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.573093 22043 tablet_bootstrap.cc:492] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:25.576903 22043 ts_tablet_manager.cc:1403] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.190s	user 0.018s	sys 0.007s
I20260709 12:09:25.559217 22422 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:09:25.636225 22043 raft_consensus.cc:359] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.637166 22043 raft_consensus.cc:385] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.637523 22043 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.638762 22043 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:09:25.643146 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 100828us
I20260709 12:09:25.649446 22043 ts_tablet_manager.cc:1434] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.005s
I20260709 12:09:25.653463 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:09:25.659691 21817 leader_election.cc:343] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.670094 21993 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:25.670949 22387 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.672300 21817 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:25.673512 21817 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:25.673804 22387 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.674515 22422 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.675418 22387 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:25.677914 22478 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.676397 22387 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.694967 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:25.695613 21918 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.713138 21918 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:09:25.731616 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:25.756212 22043 tablet_bootstrap.cc:492] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:25.774219 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:25.756105 21966 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:09:25.793705 22022 debug-util.cc:398] Leaking SignalData structure 0x7b080017a940 after lost signal to thread 20708
W20260709 12:09:25.794804 22022 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1400 after lost signal to thread 21784
W20260709 12:09:25.795974 22022 debug-util.cc:398] Leaking SignalData structure 0x7b08002ceee0 after lost signal to thread 21876
W20260709 12:09:25.797060 22022 debug-util.cc:398] Leaking SignalData structure 0x7b080015f720 after lost signal to thread 21951
W20260709 12:09:25.798103 22022 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb8c0 after lost signal to thread 22025
W20260709 12:09:25.792323 21817 leader_election.cc:343] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.808758 22425 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.824890 21996 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.836227 21749 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.874028 21749 catalog_manager.cc:5697] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
W20260709 12:09:25.878482 21817 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.879772 22043 tablet_bootstrap.cc:654] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:25.909101 21817 consensus_peers.cc:597] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.937374 22043 tablet_bootstrap.cc:492] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:25.940864 22043 ts_tablet_manager.cc:1403] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.185s	user 0.014s	sys 0.001s
I20260709 12:09:25.958223 22487 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:25.959574 22043 raft_consensus.cc:359] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.962568 22043 raft_consensus.cc:385] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.962893 22043 raft_consensus.cc:740] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.963801 22043 consensus_queue.cc:260] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:25.970450 22495 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:25.970615 22386 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:25.979398 22043 ts_tablet_manager.cc:1434] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:09:25.980396 22043 tablet_bootstrap.cc:492] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Bootstrap starting.
I20260709 12:09:25.988019 22427 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:26.026961 22425 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.027511 22425 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:26.041481 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:09:26.051832 22425 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:26.054384 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:09:26.060148 21964 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:26.061198 22487 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.061074 22432 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.088824 22043 tablet_bootstrap.cc:654] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.168072 22043 tablet_bootstrap.cc:492] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: No bootstrap required, opened a new log
I20260709 12:09:26.169456 22043 ts_tablet_manager.cc:1403] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Time spent bootstrapping tablet: real 0.189s	user 0.011s	sys 0.001s
I20260709 12:09:26.185196 22495 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.199254 22423 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.218261 22043 raft_consensus.cc:359] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:26.219838 22043 raft_consensus.cc:385] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.227708 22043 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.229306 22043 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:26.231285 22043 ts_tablet_manager.cc:1434] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Time spent starting tablet: real 0.061s	user 0.012s	sys 0.000s
I20260709 12:09:26.256510 21747 catalog_manager.cc:5697] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:26.280524 22471 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.283732 21747 catalog_manager.cc:5697] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.291872 21747 catalog_manager.cc:5697] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.360702 21994 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.361913 21748 catalog_manager.cc:5697] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:26.369057 21748 catalog_manager.cc:5697] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:26.387174 21749 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:09:26.388921 21749 catalog_manager.cc:5697] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 0 to 1, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:09:26.475256 21992 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.942464 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:26.954123 22539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:26.958456 22538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:26.961468 20705 server_base.cc:1061] running on GCE node
W20260709 12:09:26.962338 22541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:26.965034 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:26.965355 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:26.965579 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783598966965562 us; error 0 us; skew 500 ppm
I20260709 12:09:26.966838 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:26.970882 20705 webserver.cc:533] Webserver started at http://127.20.56.68:38007/ using document root <none> and password file <none>
I20260709 12:09:26.971580 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:26.971844 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:26.972265 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:26.974184 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-3-root/instance:
uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
format_stamp: "Formatted at 2026-07-09 12:09:26 on dist-test-slave-2dwh"
I20260709 12:09:26.981148 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.006s
I20260709 12:09:26.986174 22546 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:26.987154 20705 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:09:26.987598 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-3-root
uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
format_stamp: "Formatted at 2026-07-09 12:09:26 on dist-test-slave-2dwh"
I20260709 12:09:26.988065 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:27.020375 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:27.022233 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:27.024104 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:27.027735 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:27.028021 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.028349 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:27.028595 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:27.168516 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.68:40043
I20260709 12:09:27.169878 22608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.68:40043 every 8 connection(s)
I20260709 12:09:27.246500 20705 auto_leader_rebalancer-test.cc:439] add a tserver: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:27.261744 22609 heartbeater.cc:344] Connected to a master server at 127.20.56.126:35507
I20260709 12:09:27.262281 22609 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:27.263339 22609 heartbeater.cc:507] Master 127.20.56.126:35507 requested a full tablet report, sending...
I20260709 12:09:27.265563 21749 ts_manager.cc:194] Registered new tserver with Master: ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:09:27.267661 21749 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42850
I20260709 12:09:27.676725 21994 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:27.684727 21848 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.685786 21927 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.686196 22050 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:27.688021 22050 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:27.713145 22050 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:09:27.729704 21967 consensus_peers.cc:597] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52d6c6b59b7b44f4b009fc6edfc800eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:27.733012 21994 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:27.737776 21749 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.749097 21927 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:27.745690 21848 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:09:27.758737 21967 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2526f3581f34316a1eb1e329b5d5af9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:27.759548 21844 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.763780 22050 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:27.764222 21918 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.767668 22495 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:27.841892 22050 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:27.854045 21922 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:27.917042 21844 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:27.937018 21922 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:27.962519 21747 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.988929 21844 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.991214 22613 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:27.993460 21994 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:27.995651 22613 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:28.008441 21893 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e7beebb504f4966b0b73ec1fd85c8d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.011564 22303 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:28.014271 21994 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:28.015466 21848 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:28.036876 21922 consensus_queue.cc:237] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:28.039458 21749 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:28.048457 21848 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:28.049016 21893 consensus_peers.cc:597] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 574068a837ce42d6a654b65aa3b4a614. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:28.050163 22613 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.050817 21994 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:28.052922 22613 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.062909 22614 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:28.073315 21848 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:28.084775 21994 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:28.098063 21749 catalog_manager.cc:5697] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.271778 22609 heartbeater.cc:499] Master 127.20.56.126:35507 was elected leader, sending a full tablet report...
I20260709 12:09:28.280090 22642 ts_tablet_manager.cc:933] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:28.299612 22642 tablet_copy_client.cc:323] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:28.331499 22645 ts_tablet_manager.cc:933] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:28.351842 22645 tablet_copy_client.cc:323] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:28.362780 22011 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet 52d6c6b59b7b44f4b009fc6edfc800eb from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:28.363423 22011 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet 52d6c6b59b7b44f4b009fc6edfc800eb from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-52d6c6b59b7b44f4b009fc6edfc800eb
I20260709 12:09:28.374523 22011 tablet_copy_source_session.cc:215] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.375627 22010 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet c2526f3581f34316a1eb1e329b5d5af9 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:28.377502 22010 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet c2526f3581f34316a1eb1e329b5d5af9 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-c2526f3581f34316a1eb1e329b5d5af9
I20260709 12:09:28.385185 22010 tablet_copy_source_session.cc:215] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.389385 22645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2526f3581f34316a1eb1e329b5d5af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.401630 22642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d6c6b59b7b44f4b009fc6edfc800eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.426957 22642 tablet_copy_client.cc:806] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.427716 22642 tablet_copy_client.cc:670] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.429767 22645 tablet_copy_client.cc:806] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.430428 22645 tablet_copy_client.cc:670] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.463161 22642 tablet_copy_client.cc:538] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.471415 22645 tablet_copy_client.cc:538] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.480726 22645 tablet_bootstrap.cc:492] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:28.482297 22642 tablet_bootstrap.cc:492] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:28.625909 22648 ts_tablet_manager.cc:933] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:28.632138 22651 ts_tablet_manager.cc:933] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:28.632838 22645 tablet_bootstrap.cc:492] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.645947 22645 tablet_bootstrap.cc:492] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:28.646529 22651 tablet_copy_client.cc:323] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:28.647061 22648 tablet_copy_client.cc:323] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:28.647894 22645 ts_tablet_manager.cc:1403] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.167s	user 0.027s	sys 0.019s
I20260709 12:09:28.657075 22645 raft_consensus.cc:359] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:28.658303 22645 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:28.659240 22645 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:28.672339 22645 ts_tablet_manager.cc:1434] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.008s
I20260709 12:09:28.676229 22583 raft_consensus.cc:1217] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:28.685192 22642 tablet_bootstrap.cc:492] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.691151 22642 tablet_bootstrap.cc:492] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:28.685076 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-c2526f3581f34316a1eb1e329b5d5af9 received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:28.694401 22642 ts_tablet_manager.cc:1403] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.212s	user 0.048s	sys 0.043s
I20260709 12:09:28.694545 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-c2526f3581f34316a1eb1e329b5d5af9 on tablet c2526f3581f34316a1eb1e329b5d5af9 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:28.699764 22642 raft_consensus.cc:359] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:28.700631 22642 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:28.701284 22642 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:28.703559 22642 ts_tablet_manager.cc:1434] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:28.705502 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-52d6c6b59b7b44f4b009fc6edfc800eb received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:28.705971 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-52d6c6b59b7b44f4b009fc6edfc800eb on tablet 52d6c6b59b7b44f4b009fc6edfc800eb with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:28.714550 21937 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 2e7beebb504f4966b0b73ec1fd85c8d1 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:28.715173 21937 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 2e7beebb504f4966b0b73ec1fd85c8d1 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-2e7beebb504f4966b0b73ec1fd85c8d1
I20260709 12:09:28.718816 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 574068a837ce42d6a654b65aa3b4a614 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:28.719429 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 574068a837ce42d6a654b65aa3b4a614 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-574068a837ce42d6a654b65aa3b4a614
I20260709 12:09:28.740299 21937 tablet_copy_source_session.cc:215] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.743876 22651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7beebb504f4966b0b73ec1fd85c8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.745201 21936 tablet_copy_source_session.cc:215] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:28.748315 22648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574068a837ce42d6a654b65aa3b4a614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:28.768376 22583 raft_consensus.cc:1217] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:28.786855 22651 tablet_copy_client.cc:806] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.790488 22651 tablet_copy_client.cc:670] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.795620 22651 tablet_copy_client.cc:538] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.799336 22648 tablet_copy_client.cc:806] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:28.799949 22648 tablet_copy_client.cc:670] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:28.806617 22648 tablet_copy_client.cc:538] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:28.810513 22651 tablet_bootstrap.cc:492] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:28.823881 22648 tablet_bootstrap.cc:492] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:28.866590 22651 tablet_bootstrap.cc:492] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.867583 22651 tablet_bootstrap.cc:492] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:28.868314 22651 ts_tablet_manager.cc:1403] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.017s
I20260709 12:09:28.879052 22651 raft_consensus.cc:359] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:28.882283 22651 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:28.883015 22651 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:28.896467 22651 ts_tablet_manager.cc:1434] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:09:28.898190 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-2e7beebb504f4966b0b73ec1fd85c8d1 received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:28.898644 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-2e7beebb504f4966b0b73ec1fd85c8d1 on tablet 2e7beebb504f4966b0b73ec1fd85c8d1 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:28.900226 22648 tablet_bootstrap.cc:492] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:28.901185 22648 tablet_bootstrap.cc:492] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:28.901881 22648 ts_tablet_manager.cc:1403] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.009s
I20260709 12:09:28.925277 22648 raft_consensus.cc:359] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:28.925945 22648 raft_consensus.cc:740] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:28.926525 22648 consensus_queue.cc:260] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:28.928750 22648 ts_tablet_manager.cc:1434] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:28.931423 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-574068a837ce42d6a654b65aa3b4a614 received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:28.931821 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-574068a837ce42d6a654b65aa3b4a614 on tablet 574068a837ce42d6a654b65aa3b4a614 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:28.975956 22583 raft_consensus.cc:1217] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.098188 22640 raft_consensus.cc:1064] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:29.102512 22640 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:29.114131 21918 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.113422 22583 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.117084 22615 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.119225 22615 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.145418 21846 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.147610 22615 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.156872 22615 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.174355 22583 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.185585 22584 raft_consensus.cc:1217] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:29.184571 21926 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.194782 21748 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.174345 21844 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.269884 22001 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:29.288174 21844 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.290485 22615 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.291934 22583 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.295061 22640 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.301819 22661 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.319712 22583 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.322705 21844 raft_consensus.cc:2955] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.330286 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2526f3581f34316a1eb1e329b5d5af9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:29.333369 21750 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.339653 22615 raft_consensus.cc:1064] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:29.342136 22615 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:29.358999 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet c2526f3581f34316a1eb1e329b5d5af9 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:29.380782 22669 tablet_replica.cc:333] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:29.382004 22669 raft_consensus.cc:2243] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:29.382853 22669 raft_consensus.cc:2272] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:29.382943 22583 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.385224 21844 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.385215 21922 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.387951 22615 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.388947 22661 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.389549 22669 ts_tablet_manager.cc:1916] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:29.392642 22640 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.422843 22669 ts_tablet_manager.cc:1929] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:29.423494 22669 log.cc:1199] T c2526f3581f34316a1eb1e329b5d5af9 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/c2526f3581f34316a1eb1e329b5d5af9
I20260709 12:09:29.425297 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet c2526f3581f34316a1eb1e329b5d5af9 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:29.425226 22050 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.431272 21844 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.448307 21750 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.448861 22583 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.452051 21922 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.527135 22674 raft_consensus.cc:1064] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:29.529723 22674 consensus_queue.cc:237] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:29.532706 22001 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:29.537801 21922 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.539078 22640 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:09:29.539889 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 58011.5us
I20260709 12:09:29.544991 22583 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.546947 22640 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.546816 22661 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.558128 21844 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.565178 22583 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.574365 22674 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.575284 22584 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.577225 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52d6c6b59b7b44f4b009fc6edfc800eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:29.580651 22001 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.585672 21749 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.581969 22659 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.589546 21922 raft_consensus.cc:2955] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.601851 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d6c6b59b7b44f4b009fc6edfc800eb with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:29.618487 22679 tablet_replica.cc:333] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:29.622248 22659 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.637895 22679 raft_consensus.cc:2243] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:29.638728 22679 raft_consensus.cc:2272] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:29.650588 22679 ts_tablet_manager.cc:1916] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:29.663787 22659 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.670126 22679 ts_tablet_manager.cc:1929] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:29.670661 22679 log.cc:1199] T 52d6c6b59b7b44f4b009fc6edfc800eb P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/52d6c6b59b7b44f4b009fc6edfc800eb
I20260709 12:09:29.672458 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 52d6c6b59b7b44f4b009fc6edfc800eb (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:29.677610 21844 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.678757 21994 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.688014 22583 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.704883 21749 catalog_manager.cc:5697] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.736562 21922 consensus_queue.cc:237] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:29.745560 22583 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.748811 22659 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.750066 21994 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.755718 22303 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.770692 22659 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.775470 22583 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.780965 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 574068a837ce42d6a654b65aa3b4a614 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:29.783897 21999 raft_consensus.cc:2955] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.795661 22613 raft_consensus.cc:1064] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:29.798142 22613 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:29.812167 21749 catalog_manager.cc:5697] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.827715 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 574068a837ce42d6a654b65aa3b4a614 with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:29.828630 22679 tablet_replica.cc:333] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:29.829686 22679 raft_consensus.cc:2243] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:29.830392 22679 raft_consensus.cc:2272] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:29.841074 22679 ts_tablet_manager.cc:1916] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:29.861737 22583 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.863746 21846 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.867244 22303 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.868863 22303 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:29.870047 21999 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:29.879195 22674 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:29.915036 22303 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.916452 21994 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.931136 21846 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.946552 22584 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.961992 21749 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:29.973042 22679 ts_tablet_manager.cc:1929] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:29.973773 22679 log.cc:1199] T 574068a837ce42d6a654b65aa3b4a614 P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/574068a837ce42d6a654b65aa3b4a614
I20260709 12:09:29.982911 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 574068a837ce42d6a654b65aa3b4a614 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:30.003211 21922 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:30.011451 21846 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.012811 22584 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:30.013386 22303 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:30.023614 22659 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:30.026535 21846 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:30.026564 22613 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:30.037212 22584 raft_consensus.cc:2955] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:30.058322 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e7beebb504f4966b0b73ec1fd85c8d1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:30.060885 21750 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:30.084110 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e7beebb504f4966b0b73ec1fd85c8d1 with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:30.095278 22686 tablet_replica.cc:333] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:30.096238 22686 raft_consensus.cc:2243] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:30.096830 22686 raft_consensus.cc:2272] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:30.099552 22686 ts_tablet_manager.cc:1916] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:30.114488 22686 ts_tablet_manager.cc:1929] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:30.114930 22686 log.cc:1199] T 2e7beebb504f4966b0b73ec1fd85c8d1 P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/2e7beebb504f4966b0b73ec1fd85c8d1
I20260709 12:09:30.116852 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 2e7beebb504f4966b0b73ec1fd85c8d1 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:31.154289 21922 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:09:31.161334 21893 consensus_peers.cc:597] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3732a691799e4f2abfe58158cddce045. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.161434 21850 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.163426 21994 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.164250 22303 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.164978 22613 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.174964 22303 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.177573 21999 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.201630 21749 catalog_manager.cc:5697] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:31.206106 21850 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.241699 21850 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:31.288309 21926 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.289470 21994 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.291743 22687 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.294114 22386 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:31.362812 22386 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.372910 21994 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.387135 21918 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:31.393081 21750 catalog_manager.cc:5697] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.418397 21926 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:09:31.439392 21893 consensus_peers.cc:597] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02f67b74a580421b99787adc89841d21. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.448972 21994 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.450659 22613 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:31.458060 21818 consensus_peers.cc:597] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e47334283cbf402c8d1c42ff7264f7e7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.458251 21844 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.462186 22613 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:31.467111 22659 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.473146 21994 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.482090 21850 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.490432 21844 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:31.504976 21749 catalog_manager.cc:5697] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:09:31.512111 21818 consensus_peers.cc:597] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 209865ca9a104769a09f3a5f4a1e8b79. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.512852 21994 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.514256 22703 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.527413 21918 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.529074 22703 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.540056 22704 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.545288 21994 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.546908 21918 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.591828 21750 catalog_manager.cc:5697] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:31.733384 22710 ts_tablet_manager.cc:933] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:31.747159 22712 ts_tablet_manager.cc:933] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:31.746892 22710 tablet_copy_client.cc:323] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:31.761529 22712 tablet_copy_client.cc:323] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:31.774741 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 3732a691799e4f2abfe58158cddce045 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:31.775303 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 3732a691799e4f2abfe58158cddce045 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-3732a691799e4f2abfe58158cddce045
I20260709 12:09:31.784601 21936 tablet_copy_source_session.cc:215] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.791886 22710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3732a691799e4f2abfe58158cddce045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.809540 22710 tablet_copy_client.cc:806] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.810096 22710 tablet_copy_client.cc:670] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.823365 22710 tablet_copy_client.cc:538] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.831791 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet e47334283cbf402c8d1c42ff7264f7e7 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:31.832432 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet e47334283cbf402c8d1c42ff7264f7e7 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-e47334283cbf402c8d1c42ff7264f7e7
I20260709 12:09:31.834446 22710 tablet_bootstrap.cc:492] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:31.840056 21862 tablet_copy_source_session.cc:215] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.843873 22712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47334283cbf402c8d1c42ff7264f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.896633 22712 tablet_copy_client.cc:806] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.897245 22712 tablet_copy_client.cc:670] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.897795 22710 tablet_bootstrap.cc:492] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.898759 22710 tablet_bootstrap.cc:492] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:31.903081 22710 ts_tablet_manager.cc:1403] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.011s
I20260709 12:09:31.909138 22712 tablet_copy_client.cc:538] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.916481 22710 raft_consensus.cc:359] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:31.917459 22710 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:31.922322 22718 ts_tablet_manager.cc:933] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:31.918208 22710 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:31.933389 22712 tablet_bootstrap.cc:492] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:31.944397 22710 ts_tablet_manager.cc:1434] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.003s
I20260709 12:09:31.947038 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3732a691799e4f2abfe58158cddce045 received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:31.947556 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3732a691799e4f2abfe58158cddce045 on tablet 3732a691799e4f2abfe58158cddce045 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:31.948431 22718 tablet_copy_client.cc:323] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:31.979456 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 02f67b74a580421b99787adc89841d21 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:31.980069 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 02f67b74a580421b99787adc89841d21 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-02f67b74a580421b99787adc89841d21
I20260709 12:09:31.987818 21936 tablet_copy_source_session.cc:215] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.993100 22718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f67b74a580421b99787adc89841d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.019286 22712 tablet_bootstrap.cc:492] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.020259 22712 tablet_bootstrap.cc:492] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:32.025967 22712 ts_tablet_manager.cc:1403] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.011s
I20260709 12:09:32.037063 22712 raft_consensus.cc:359] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:32.037958 22712 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:32.038669 22712 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:32.040344 22718 tablet_copy_client.cc:806] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.040972 22718 tablet_copy_client.cc:670] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:32.041311 22712 ts_tablet_manager.cc:1434] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:09:32.049211 22718 tablet_copy_client.cc:538] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:32.061908 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-e47334283cbf402c8d1c42ff7264f7e7 received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:32.065970 22710 ts_tablet_manager.cc:933] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:32.073741 22718 tablet_bootstrap.cc:492] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:32.080186 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-e47334283cbf402c8d1c42ff7264f7e7 on tablet e47334283cbf402c8d1c42ff7264f7e7 with peer ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:09:32.681413 22710 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.016s	sys 0.005s
W20260709 12:09:32.682020 22710 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.016s	sys 0.006s
I20260709 12:09:32.682832 22710 tablet_copy_client.cc:323] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:32.691121 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet 209865ca9a104769a09f3a5f4a1e8b79 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:32.691720 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet 209865ca9a104769a09f3a5f4a1e8b79 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-209865ca9a104769a09f3a5f4a1e8b79
W20260709 12:09:32.787212 22718 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.007s	sys 0.003s
W20260709 12:09:32.787609 22718 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.007s	sys 0.004s
I20260709 12:09:32.794426 21862 tablet_copy_source_session.cc:215] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:32.822678 22582 raft_consensus.cc:1217] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.825491 22710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 209865ca9a104769a09f3a5f4a1e8b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.884003 22584 raft_consensus.cc:1217] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.921197 22718 tablet_bootstrap.cc:492] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.963856 22718 tablet_bootstrap.cc:492] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:32.964586 22718 ts_tablet_manager.cc:1403] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.891s	user 0.020s	sys 0.017s
W20260709 12:09:32.966698 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 139299us
I20260709 12:09:32.982743 22718 raft_consensus.cc:359] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:32.983798 22718 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:32.984505 22718 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:32.991613 22710 tablet_copy_client.cc:806] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.992316 22710 tablet_copy_client.cc:670] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.006206 22718 ts_tablet_manager.cc:1434] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:09:33.016923 22584 raft_consensus.cc:1217] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:33.018054 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-02f67b74a580421b99787adc89841d21 received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:33.018559 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-02f67b74a580421b99787adc89841d21 on tablet 02f67b74a580421b99787adc89841d21 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:33.035207 22710 tablet_copy_client.cc:538] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.066363 22710 tablet_bootstrap.cc:492] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
W20260709 12:09:33.097353 21873 debug-util.cc:398] Leaking SignalData structure 0x7b08000c96e0 after lost signal to thread 20708
W20260709 12:09:33.098485 21873 debug-util.cc:398] Leaking SignalData structure 0x7b08000c81a0 after lost signal to thread 21784
W20260709 12:09:33.099675 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800302440 after lost signal to thread 21876
W20260709 12:09:33.100713 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080020f860 after lost signal to thread 21951
I20260709 12:09:33.101671 22710 tablet_bootstrap.cc:492] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:09:33.101764 21873 debug-util.cc:398] Leaking SignalData structure 0x7b08002bcb40 after lost signal to thread 22025
I20260709 12:09:33.102629 22710 tablet_bootstrap.cc:492] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
W20260709 12:09:33.103017 21873 debug-util.cc:398] Leaking SignalData structure 0x7b08002fdf20 after lost signal to thread 22608
I20260709 12:09:33.105382 22710 ts_tablet_manager.cc:1403] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.007s
I20260709 12:09:33.119939 22710 raft_consensus.cc:359] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:33.120854 22710 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:33.121559 22710 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:33.124820 22710 ts_tablet_manager.cc:1434] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 12:09:33.135624 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-209865ca9a104769a09f3a5f4a1e8b79 received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:33.136111 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-209865ca9a104769a09f3a5f4a1e8b79 on tablet 209865ca9a104769a09f3a5f4a1e8b79 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:33.212809 22584 raft_consensus.cc:1217] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:33.373497 22741 raft_consensus.cc:1064] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:33.394829 22741 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:33.460966 22737 raft_consensus.cc:1064] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:33.463987 22737 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:33.467424 22725 raft_consensus.cc:1064] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:33.470255 22725 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:33.488039 22584 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.491739 21999 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.493243 21844 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.497130 22742 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.502399 22742 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.507941 21844 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.509613 22303 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.517736 22584 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.521262 21922 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.521811 21999 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.522923 22726 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.525902 22584 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.531661 22725 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.534401 22741 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:09:33.546427 21992 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.566251 22737 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.572398 22726 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.609088 22737 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.618000 22724 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:33.626358 22725 raft_consensus.cc:1064] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:33.636528 22725 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:33.648839 21999 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:33.663641 21918 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:33.711513 22303 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:33.724884 21992 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:09:33.791633 22753 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.068s	user 0.001s	sys 0.006s
I20260709 12:09:33.795594 22582 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:09:33.799504 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46730.4us
W20260709 12:09:33.799814 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 132331us
I20260709 12:09:33.807916 22584 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.742486 21747 catalog_manager.cc:5697] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:33.818586 22734 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:33.852344 21994 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.868431 21922 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.860937 21997 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:33.874399 22758 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.881889 22725 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.923529 22758 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.943305 21846 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:33.948438 21852 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:33.995623 22584 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.003526 22583 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.056576 22728 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.072204 22582 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.087596 21846 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:34.069442 21992 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.116708 22582 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.119396 22726 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.116518 21747 catalog_manager.cc:5697] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.124397 21747 catalog_manager.cc:5697] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.131350 22758 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.132586 21997 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.136003 22582 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.157953 22728 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.171260 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e47334283cbf402c8d1c42ff7264f7e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.173185 21922 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:34.178960 21997 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.186602 22742 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.187404 21923 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:34.177446 21750 catalog_manager.cc:5697] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.197397 21994 raft_consensus.cc:2955] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.198899 21852 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.200366 22742 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.210253 21746 catalog_manager.cc:5697] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:34.215677 21922 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.223495 22749 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.233923 21852 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.239905 22583 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.237716 22737 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.242679 22582 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.248566 21994 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.269039 22766 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:34.272895 22737 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.275243 21846 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:34.287115 22583 raft_consensus.cc:2955] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.322992 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet e47334283cbf402c8d1c42ff7264f7e7 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:34.331472 22582 raft_consensus.cc:2955] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.333935 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02f67b74a580421b99787adc89841d21 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.341284 22584 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.343987 21994 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.343686 21747 catalog_manager.cc:5697] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.350677 22777 tablet_replica.cc:333] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:34.350677 22760 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:34.351817 22726 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.351094 21749 catalog_manager.cc:5697] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.358065 22777 raft_consensus.cc:2243] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.359340 22777 raft_consensus.cc:2272] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.366948 22758 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.368533 22584 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.374478 21994 raft_consensus.cc:2955] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.385265 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet 3732a691799e4f2abfe58158cddce045 with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:34.386088 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3732a691799e4f2abfe58158cddce045 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.403064 22777 ts_tablet_manager.cc:1916] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:34.408267 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 02f67b74a580421b99787adc89841d21 with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:34.429073 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 209865ca9a104769a09f3a5f4a1e8b79 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.458878 22778 tablet_replica.cc:333] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:34.463904 22779 tablet_replica.cc:333] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:34.465929 22779 raft_consensus.cc:2243] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.466770 22779 raft_consensus.cc:2272] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.464124 22778 raft_consensus.cc:2243] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.482034 22778 raft_consensus.cc:2272] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.477872 22779 ts_tablet_manager.cc:1916] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:34.467110 21746 catalog_manager.cc:5697] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:34.502909 22777 ts_tablet_manager.cc:1929] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.503834 22778 ts_tablet_manager.cc:1916] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:34.510699 22777 log.cc:1199] T e47334283cbf402c8d1c42ff7264f7e7 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/e47334283cbf402c8d1c42ff7264f7e7
I20260709 12:09:34.504469 22779 ts_tablet_manager.cc:1929] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.512552 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet e47334283cbf402c8d1c42ff7264f7e7 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:34.506700 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet 209865ca9a104769a09f3a5f4a1e8b79 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:34.512660 22779 log.cc:1199] T 02f67b74a580421b99787adc89841d21 P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/02f67b74a580421b99787adc89841d21
I20260709 12:09:34.526247 22777 tablet_replica.cc:333] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:34.526954 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 02f67b74a580421b99787adc89841d21 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:34.528785 22778 ts_tablet_manager.cc:1929] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.528908 22777 raft_consensus.cc:2243] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.529382 22778 log.cc:1199] T 3732a691799e4f2abfe58158cddce045 P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/3732a691799e4f2abfe58158cddce045
I20260709 12:09:34.530054 22777 raft_consensus.cc:2272] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.531569 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 3732a691799e4f2abfe58158cddce045 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:34.536931 22777 ts_tablet_manager.cc:1916] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:34.558857 22777 ts_tablet_manager.cc:1929] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.559285 22777 log.cc:1199] T 209865ca9a104769a09f3a5f4a1e8b79 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/209865ca9a104769a09f3a5f4a1e8b79
I20260709 12:09:34.560601 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet 209865ca9a104769a09f3a5f4a1e8b79 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:35.628918 21922 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:09:35.640318 21893 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1cc81c27d5d3424db1dfbfc977e0369d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.641448 21994 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.641673 21846 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.643093 22780 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.644101 22303 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.669230 21846 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:35.669445 22766 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:35.682677 21992 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:35.698885 22000 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:35.701695 21746 catalog_manager.cc:5697] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:35.721283 21967 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d3f324c9e584d26829ebc2cadc84629. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.722783 21922 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.724246 22727 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.726958 21850 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.771317 22735 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.818390 22735 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:35.821280 21922 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:35.845789 21850 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:35.851033 21846 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:35.861539 21749 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:09:35.897840 21818 consensus_peers.cc:597] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c93911a59a2c46bb9745487e082af441. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.902375 22000 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.904222 22726 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.907326 21922 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.908954 22760 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.929646 22758 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:35.931999 22000 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:35.942993 21922 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:35.951826 21749 catalog_manager.cc:5697] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.955755 21918 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:09:35.997141 21893 consensus_peers.cc:597] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1634cc7afa814a3889101c2be1c108ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.997169 22000 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.998817 21846 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.000568 22790 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.002228 22303 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.026252 21992 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:36.024924 22790 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:36.031917 21846 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:36.047319 21749 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:36.165910 22801 ts_tablet_manager.cc:933] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:36.185060 22803 ts_tablet_manager.cc:933] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:36.193878 22803 tablet_copy_client.cc:323] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:36.195765 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 1cc81c27d5d3424db1dfbfc977e0369d from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:36.196372 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 1cc81c27d5d3424db1dfbfc977e0369d from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-1cc81c27d5d3424db1dfbfc977e0369d
I20260709 12:09:36.198566 22801 tablet_copy_client.cc:323] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:36.200551 22011 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet 1d3f324c9e584d26829ebc2cadc84629 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:36.201105 22011 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet 1d3f324c9e584d26829ebc2cadc84629 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-1d3f324c9e584d26829ebc2cadc84629
I20260709 12:09:36.212098 22011 tablet_copy_source_session.cc:215] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.215935 21936 tablet_copy_source_session.cc:215] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.217820 22801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3f324c9e584d26829ebc2cadc84629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.221529 22803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc81c27d5d3424db1dfbfc977e0369d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.352452 22811 ts_tablet_manager.cc:933] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:36.379089 22811 tablet_copy_client.cc:323] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:36.392706 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet c93911a59a2c46bb9745487e082af441 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:36.393528 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet c93911a59a2c46bb9745487e082af441 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-c93911a59a2c46bb9745487e082af441
I20260709 12:09:36.394807 22801 tablet_copy_client.cc:806] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.395574 22801 tablet_copy_client.cc:670] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.404145 21862 tablet_copy_source_session.cc:215] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:09:36.405660 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 57638.8us
I20260709 12:09:36.419405 22811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93911a59a2c46bb9745487e082af441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.437803 22803 tablet_copy_client.cc:806] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.440860 22803 tablet_copy_client.cc:670] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.475019 22803 tablet_copy_client.cc:538] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.478873 22811 tablet_copy_client.cc:806] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.479784 22811 tablet_copy_client.cc:670] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.484493 22801 tablet_copy_client.cc:538] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.484750 22811 tablet_copy_client.cc:538] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.497676 22803 tablet_bootstrap.cc:492] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:36.498634 22801 tablet_bootstrap.cc:492] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:36.532908 22811 tablet_bootstrap.cc:492] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:36.617420 22814 ts_tablet_manager.cc:933] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:36.623135 22811 tablet_bootstrap.cc:492] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.624769 22811 tablet_bootstrap.cc:492] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:36.625557 22811 ts_tablet_manager.cc:1403] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.013s
I20260709 12:09:36.639513 22811 raft_consensus.cc:359] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:36.642516 22811 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:36.643390 22811 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:36.650506 22814 tablet_copy_client.cc:323] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:36.655678 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 1634cc7afa814a3889101c2be1c108ad from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:36.656293 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 1634cc7afa814a3889101c2be1c108ad from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-1634cc7afa814a3889101c2be1c108ad
I20260709 12:09:36.666091 21936 tablet_copy_source_session.cc:215] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.679520 22814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1634cc7afa814a3889101c2be1c108ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.686486 22811 ts_tablet_manager.cc:1434] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.004s
I20260709 12:09:36.694010 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-c93911a59a2c46bb9745487e082af441 received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:36.694561 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-c93911a59a2c46bb9745487e082af441 on tablet c93911a59a2c46bb9745487e082af441 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:36.710835 22803 tablet_bootstrap.cc:492] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.713122 22803 tablet_bootstrap.cc:492] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:36.712189 22801 tablet_bootstrap.cc:492] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.714231 22801 tablet_bootstrap.cc:492] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:36.714967 22801 ts_tablet_manager.cc:1403] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.217s	user 0.027s	sys 0.005s
I20260709 12:09:36.717949 22801 raft_consensus.cc:359] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:36.719650 22801 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:36.720378 22801 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:36.719293 22803 ts_tablet_manager.cc:1403] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.222s	user 0.029s	sys 0.008s
I20260709 12:09:36.724687 22803 raft_consensus.cc:359] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:36.727459 22803 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:36.728219 22803 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:36.727052 22801 ts_tablet_manager.cc:1434] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:36.730827 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-1d3f324c9e584d26829ebc2cadc84629 received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:36.731256 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-1d3f324c9e584d26829ebc2cadc84629 on tablet 1d3f324c9e584d26829ebc2cadc84629 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:36.731578 22803 ts_tablet_manager.cc:1434] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 12:09:36.734373 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-1cc81c27d5d3424db1dfbfc977e0369d received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:36.734848 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-1cc81c27d5d3424db1dfbfc977e0369d on tablet 1cc81c27d5d3424db1dfbfc977e0369d with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:36.751480 22814 tablet_copy_client.cc:806] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.752456 22814 tablet_copy_client.cc:670] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.762857 22584 raft_consensus.cc:1217] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.784705 22814 tablet_copy_client.cc:538] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.796262 22814 tablet_bootstrap.cc:492] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:36.831373 22584 raft_consensus.cc:1217] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.000185 22584 raft_consensus.cc:1217] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.003054 22814 tablet_bootstrap.cc:492] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.005510 22814 tablet_bootstrap.cc:492] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:37.006294 22814 ts_tablet_manager.cc:1403] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.210s	user 0.023s	sys 0.010s
I20260709 12:09:37.009438 22814 raft_consensus.cc:359] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:37.010375 22814 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:37.011386 22814 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:37.014354 22814 ts_tablet_manager.cc:1434] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:37.022451 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-1634cc7afa814a3889101c2be1c108ad received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:37.022871 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-1634cc7afa814a3889101c2be1c108ad on tablet 1634cc7afa814a3889101c2be1c108ad with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:37.150401 22303 raft_consensus.cc:1064] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:37.153086 22303 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:37.176105 22584 raft_consensus.cc:1217] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.178381 22582 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.183012 22808 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:37.191080 21852 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.191385 21994 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.193651 22808 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.194566 22303 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.221894 21994 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.217295 22808 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.242100 21852 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.250722 22582 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.261806 21748 catalog_manager.cc:5697] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:37.306536 21918 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:37.313133 21852 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.313635 22582 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.316459 22766 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:37.319727 22766 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:09:37.329788 22821 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.333564 21852 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.335155 22582 raft_consensus.cc:2955] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.346730 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1cc81c27d5d3424db1dfbfc977e0369d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.349635 21749 catalog_manager.cc:5697] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.362860 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cc81c27d5d3424db1dfbfc977e0369d with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:37.393103 22829 tablet_replica.cc:333] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:37.394681 22829 raft_consensus.cc:2243] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.397982 22829 raft_consensus.cc:2272] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:37.401023 22829 ts_tablet_manager.cc:1916] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:37.417483 22829 ts_tablet_manager.cc:1929] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:37.418038 22829 log.cc:1199] T 1cc81c27d5d3424db1dfbfc977e0369d P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/1cc81c27d5d3424db1dfbfc977e0369d
I20260709 12:09:37.420316 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 1cc81c27d5d3424db1dfbfc977e0369d (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:37.436081 22809 raft_consensus.cc:1064] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:37.438510 22809 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:37.457047 21918 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.458366 22582 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.459041 21994 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.458388 22758 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:37.462419 22809 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.463382 22728 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.485263 22735 raft_consensus.cc:1064] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:37.487388 22735 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:37.528043 22582 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.529609 21923 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.530265 22793 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.533283 22727 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.533753 21852 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.540541 22727 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.577137 22793 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.578902 21920 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.596621 21846 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.597425 22728 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.604522 21918 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.611109 21994 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.625854 21747 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.627239 22582 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.663587 21749 catalog_manager.cc:5697] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.678233 22584 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.712008 21994 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:37.718545 22584 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.720927 21846 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.721427 22839 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.723368 22839 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.728725 21852 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:37.736785 22727 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.746134 22582 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.749034 21918 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.749577 22809 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:37.740458 22584 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.753420 22809 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.760505 22758 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.767242 21920 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.768618 22582 raft_consensus.cc:2955] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.780881 21746 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.782141 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c93911a59a2c46bb9745487e082af441 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.782559 22821 raft_consensus.cc:1064] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:37.787750 22821 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:37.789685 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d3f324c9e584d26829ebc2cadc84629 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.801900 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d3f324c9e584d26829ebc2cadc84629 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:37.802335 21747 catalog_manager.cc:5697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.815352 21852 raft_consensus.cc:2955] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:37.836978 22582 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.841361 22821 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.849843 21846 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.852240 22821 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:09:37.861435 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet c93911a59a2c46bb9745487e082af441 with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:37.861490 21994 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.862483 22829 tablet_replica.cc:333] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:37.865015 22821 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:37.890214 22841 tablet_replica.cc:333] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:37.891505 22841 raft_consensus.cc:2243] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.892463 22841 raft_consensus.cc:2272] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:37.897020 22841 ts_tablet_manager.cc:1916] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:09:37.997124 22842 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:09:38.015116 22829 raft_consensus.cc:2243] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.015977 22829 raft_consensus.cc:2272] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.011524 22810 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:38.019415 22829 ts_tablet_manager.cc:1916] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.036118 22582 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:38.043741 21994 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:38.053635 21746 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:38.055573 21844 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:38.130713 21920 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:38.169160 21994 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.170338 22821 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.170817 22582 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.173246 22821 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.174124 22829 ts_tablet_manager.cc:1929] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.174589 22829 log.cc:1199] T c93911a59a2c46bb9745487e082af441 P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/c93911a59a2c46bb9745487e082af441
I20260709 12:09:38.176873 22841 ts_tablet_manager.cc:1929] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.177397 22841 log.cc:1199] T 1d3f324c9e584d26829ebc2cadc84629 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/1d3f324c9e584d26829ebc2cadc84629
I20260709 12:09:38.179821 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet c93911a59a2c46bb9745487e082af441 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:38.181157 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet 1d3f324c9e584d26829ebc2cadc84629 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:38.184909 22303 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:38.191429 22582 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:38.198176 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1634cc7afa814a3889101c2be1c108ad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.201664 21747 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:38.210289 21994 raft_consensus.cc:2955] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:38.215369 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 1634cc7afa814a3889101c2be1c108ad with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:38.235762 22845 tablet_replica.cc:333] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:38.237208 22845 raft_consensus.cc:2243] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:38.237996 22845 raft_consensus.cc:2272] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:38.243047 22845 ts_tablet_manager.cc:1916] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:38.259403 22845 ts_tablet_manager.cc:1929] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:38.259895 22845 log.cc:1199] T 1634cc7afa814a3889101c2be1c108ad P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/1634cc7afa814a3889101c2be1c108ad
I20260709 12:09:38.261778 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 1634cc7afa814a3889101c2be1c108ad (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:39.347478 21994 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:09:39.361824 21967 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3849f2f975df439d82d57276c716d6b8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.362387 21923 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.366891 22849 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:09:39.374701 21844 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.378273 22846 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:39.386142 22727 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.392943 21918 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.408140 21746 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.410785 21846 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:09:39.420359 21818 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e9858619e3a4ae383caadbb133747bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.422833 21994 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.424134 21918 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.425691 22847 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.427435 22760 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:39.429373 21846 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.450330 22760 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.458976 21918 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.458703 21992 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.471908 21994 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:39.486593 21747 catalog_manager.cc:5697] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.529210 21844 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.529794 21918 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.530925 22849 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:39.532049 21967 consensus_peers.cc:597] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74ed463cf25c4e46900f103087ec2300. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.532487 22727 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.540467 22846 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.542397 21846 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.545822 21918 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.557215 21920 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:39.565559 21746 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:39.594368 21893 consensus_peers.cc:597] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28c070f8afb4493ca787ffc8b1482e7a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:39.597160 21846 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.597751 21994 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:39.599076 22810 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.602185 22821 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:39.618321 22810 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.620728 21994 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.640733 21846 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:39.658152 21747 catalog_manager.cc:5697] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.815999 22866 ts_tablet_manager.cc:933] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:39.817916 22866 tablet_copy_client.cc:323] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:39.819468 22011 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet 3849f2f975df439d82d57276c716d6b8 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:39.819911 22011 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet 3849f2f975df439d82d57276c716d6b8 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-3849f2f975df439d82d57276c716d6b8
I20260709 12:09:39.825814 22011 tablet_copy_source_session.cc:215] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:39.829176 22866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3849f2f975df439d82d57276c716d6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:39.843066 22866 tablet_copy_client.cc:806] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:39.844223 22866 tablet_copy_client.cc:670] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:39.847489 22866 tablet_copy_client.cc:538] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:39.853951 22866 tablet_bootstrap.cc:492] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:40.138444 22870 ts_tablet_manager.cc:933] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:40.164322 22869 ts_tablet_manager.cc:933] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:40.179441 22873 ts_tablet_manager.cc:933] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:40.200645 22870 tablet_copy_client.cc:323] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:40.202318 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 28c070f8afb4493ca787ffc8b1482e7a from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:40.202847 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 28c070f8afb4493ca787ffc8b1482e7a from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-28c070f8afb4493ca787ffc8b1482e7a
I20260709 12:09:40.212231 21936 tablet_copy_source_session.cc:215] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.236810 22869 tablet_copy_client.cc:323] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:40.244606 22870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c070f8afb4493ca787ffc8b1482e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.279107 22873 tablet_copy_client.cc:323] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:40.289470 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet 3e9858619e3a4ae383caadbb133747bc from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:40.290053 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet 3e9858619e3a4ae383caadbb133747bc from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-3e9858619e3a4ae383caadbb133747bc
I20260709 12:09:40.301286 21862 tablet_copy_source_session.cc:215] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:09:40.308481 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 125416us
I20260709 12:09:40.334204 22869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e9858619e3a4ae383caadbb133747bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.353982 22866 tablet_bootstrap.cc:492] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.355103 22866 tablet_bootstrap.cc:492] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:40.355870 22866 ts_tablet_manager.cc:1403] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.502s	user 0.145s	sys 0.206s
I20260709 12:09:40.359942 22866 raft_consensus.cc:359] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:40.361594 22866 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:40.362300 22866 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:40.373953 22866 ts_tablet_manager.cc:1434] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.007s
I20260709 12:09:40.378118 22011 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet 74ed463cf25c4e46900f103087ec2300 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:40.378715 22011 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet 74ed463cf25c4e46900f103087ec2300 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-74ed463cf25c4e46900f103087ec2300
I20260709 12:09:40.386672 22011 tablet_copy_source_session.cc:215] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:09:40.401701 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50920.8us
I20260709 12:09:40.402307 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3849f2f975df439d82d57276c716d6b8 received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:40.408047 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3849f2f975df439d82d57276c716d6b8 on tablet 3849f2f975df439d82d57276c716d6b8 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:40.434135 22873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ed463cf25c4e46900f103087ec2300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:40.442924 22584 raft_consensus.cc:1217] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:40.484663 22869 tablet_copy_client.cc:806] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.485319 22869 tablet_copy_client.cc:670] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.490989 22869 tablet_copy_client.cc:538] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.501879 22870 tablet_copy_client.cc:806] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.502609 22870 tablet_copy_client.cc:670] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.505472 22873 tablet_copy_client.cc:806] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:40.506026 22873 tablet_copy_client.cc:670] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:40.512441 22869 tablet_bootstrap.cc:492] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:40.521689 22870 tablet_copy_client.cc:538] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.522156 22873 tablet_copy_client.cc:538] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:40.546921 22870 tablet_bootstrap.cc:492] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:40.552006 22873 tablet_bootstrap.cc:492] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:40.564265 22869 tablet_bootstrap.cc:492] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.565361 22869 tablet_bootstrap.cc:492] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:40.566185 22869 ts_tablet_manager.cc:1403] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.005s
I20260709 12:09:40.579283 22869 raft_consensus.cc:359] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:40.580117 22869 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:40.580641 22869 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:40.587939 22869 ts_tablet_manager.cc:1434] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:09:40.596913 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3e9858619e3a4ae383caadbb133747bc received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:40.597344 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3e9858619e3a4ae383caadbb133747bc on tablet 3e9858619e3a4ae383caadbb133747bc with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:40.597872 22584 raft_consensus.cc:1217] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:40.617923 22873 tablet_bootstrap.cc:492] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.623078 22873 tablet_bootstrap.cc:492] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:40.623757 22873 ts_tablet_manager.cc:1403] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.003s
I20260709 12:09:40.626665 22873 raft_consensus.cc:359] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:40.627486 22873 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:40.628153 22873 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:40.630762 22873 ts_tablet_manager.cc:1434] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:40.637586 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-74ed463cf25c4e46900f103087ec2300 received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:40.638010 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-74ed463cf25c4e46900f103087ec2300 on tablet 74ed463cf25c4e46900f103087ec2300 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:40.650983 22870 tablet_bootstrap.cc:492] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:40.651928 22870 tablet_bootstrap.cc:492] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:40.652668 22870 ts_tablet_manager.cc:1403] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.009s
I20260709 12:09:40.655591 22870 raft_consensus.cc:359] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:40.656422 22870 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:40.657058 22870 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:40.659724 22870 ts_tablet_manager.cc:1434] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:09:40.663365 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-28c070f8afb4493ca787ffc8b1482e7a received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:40.663823 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-28c070f8afb4493ca787ffc8b1482e7a on tablet 28c070f8afb4493ca787ffc8b1482e7a with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:40.718259 22584 raft_consensus.cc:1217] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:40.932037 22584 raft_consensus.cc:1217] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.012776 22849 raft_consensus.cc:1064] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:41.108552 22885 raft_consensus.cc:1064] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:41.112035 22885 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:09:41.222968 22886 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:09:41.402244 21922 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.405031 22583 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.432953 22891 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.463521 22728 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:41.473238 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:41.510629 21967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.012s	sys 0.001s
W20260709 12:09:41.511260 21967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.012s	sys 0.001s
W20260709 12:09:41.512924 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 503698us
I20260709 12:09:41.516989 22849 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:09:41.519558 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 271545us
I20260709 12:09:41.551100 22728 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.558254 21918 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.560555 22583 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.568395 22899 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.568408 21918 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.570864 21852 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.572556 21994 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.596825 22895 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.604843 22897 raft_consensus.cc:1064] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:41.606336 21746 catalog_manager.cc:5697] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:41.607774 22897 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:41.633870 22582 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.653484 22582 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.657439 22883 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.661868 22895 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.675622 22888 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.665828 22894 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.684582 21848 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:41.667909 22884 raft_consensus.cc:1064] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:41.707046 21918 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.708297 22582 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:41.709512 22888 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:41.701323 22884 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:41.723085 22891 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:41.723150 22872 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.726050 21918 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.738448 22580 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:09:41.742187 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 81206.1us
I20260709 12:09:41.742529 21920 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.752442 21848 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.762066 21992 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.807564 21852 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.819586 22897 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.826813 22582 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.829733 22583 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.831046 22846 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.832049 21747 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.841476 21848 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.843642 21927 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.845906 22884 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.847378 22899 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.853144 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e9858619e3a4ae383caadbb133747bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:41.861758 21994 raft_consensus.cc:2955] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.897346 22821 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.913713 22849 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.917131 21746 catalog_manager.cc:5697] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.927304 21918 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.934259 21852 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:41.946650 22582 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:09:41.962159 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 62906.4us
I20260709 12:09:41.974251 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e9858619e3a4ae383caadbb133747bc with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:41.984165 21746 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.000635 22810 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.020809 21994 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.040400 22922 tablet_replica.cc:333] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:42.053953 22580 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:09:42.056525 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080005ea00 after lost signal to thread 20708
W20260709 12:09:42.065101 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800300260 after lost signal to thread 21784
W20260709 12:09:42.066206 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800120420 after lost signal to thread 21876
W20260709 12:09:42.067186 21873 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8ec0 after lost signal to thread 21951
W20260709 12:09:42.068257 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800312920 after lost signal to thread 22025
I20260709 12:09:42.065876 21848 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:09:42.069258 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080031f760 after lost signal to thread 22608
I20260709 12:09:42.096881 22922 raft_consensus.cc:2243] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.106904 22922 raft_consensus.cc:2272] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.109375 21997 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:42.096954 21748 catalog_manager.cc:5697] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.117168 21918 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.118624 22849 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.121414 22922 ts_tablet_manager.cc:1916] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.133227 22580 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.135597 22849 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:42.148670 22884 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.160501 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 74ed463cf25c4e46900f103087ec2300 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.163132 22580 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.172571 21918 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:42.176920 21927 raft_consensus.cc:2955] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.189859 21746 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.196018 21997 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.198676 22911 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.196615 22580 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.204551 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 74ed463cf25c4e46900f103087ec2300 with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:42.205476 22810 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.212452 21994 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.207132 22911 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.232273 22580 raft_consensus.cc:2955] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.234659 22923 tablet_replica.cc:333] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:42.235921 22923 raft_consensus.cc:2243] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.237334 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28c070f8afb4493ca787ffc8b1482e7a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.239173 22923 raft_consensus.cc:2272] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.246706 22923 ts_tablet_manager.cc:1916] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.254602 21746 catalog_manager.cc:5697] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.276644 22922 ts_tablet_manager.cc:1929] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.278818 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 28c070f8afb4493ca787ffc8b1482e7a with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:42.278467 22922 log.cc:1199] T 3e9858619e3a4ae383caadbb133747bc P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/3e9858619e3a4ae383caadbb133747bc
I20260709 12:09:42.282495 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 3e9858619e3a4ae383caadbb133747bc (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:42.295647 21992 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:42.298477 22923 ts_tablet_manager.cc:1929] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.299027 22923 log.cc:1199] T 74ed463cf25c4e46900f103087ec2300 P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/74ed463cf25c4e46900f103087ec2300
I20260709 12:09:42.300671 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 74ed463cf25c4e46900f103087ec2300 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:42.301642 22923 tablet_replica.cc:333] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:42.301908 22580 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.302847 22923 raft_consensus.cc:2243] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.303683 22923 raft_consensus.cc:2272] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.303512 22899 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.312963 21848 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.314437 22884 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.315164 22923 ts_tablet_manager.cc:1916] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.316457 22849 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.319767 21848 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.327445 22580 raft_consensus.cc:2955] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.345511 21749 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:42.346722 22923 ts_tablet_manager.cc:1929] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.347225 22923 log.cc:1199] T 28c070f8afb4493ca787ffc8b1482e7a P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/28c070f8afb4493ca787ffc8b1482e7a
I20260709 12:09:42.348874 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 28c070f8afb4493ca787ffc8b1482e7a (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:42.356340 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet 3849f2f975df439d82d57276c716d6b8 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:42.360225 22924 tablet_replica.cc:333] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:42.360743 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3849f2f975df439d82d57276c716d6b8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.361223 22924 raft_consensus.cc:2243] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.362062 22924 raft_consensus.cc:2272] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.373102 22924 ts_tablet_manager.cc:1916] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.389467 22924 ts_tablet_manager.cc:1929] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.389926 22924 log.cc:1199] T 3849f2f975df439d82d57276c716d6b8 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/3849f2f975df439d82d57276c716d6b8
I20260709 12:09:42.392555 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet 3849f2f975df439d82d57276c716d6b8 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:43.860327 21921 consensus_queue.cc:237] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:43.893559 22000 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:43.894619 21893 consensus_peers.cc:597] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e2003af45914197b88e4cc3389271af. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:43.895195 22911 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:43.896862 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 219215us
I20260709 12:09:43.895161 21846 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:43.928233 22927 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:43.944196 22000 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:43.946928 22937 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:43.966898 21748 catalog_manager.cc:5697] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:43.973474 21848 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:43.999945 21844 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.023123 21923 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.023273 21999 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.024485 22933 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.026373 22945 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:44.031497 21818 consensus_peers.cc:597] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f74e6f0a66904748bff04fe46aed7685. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.038897 22933 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.040326 21923 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.042943 21999 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.054872 21999 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.056270 21749 catalog_manager.cc:5697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.063768 21923 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:44.064332 21967 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 817b6d8ff1d5425b9fdaf0cef3daa8c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.066646 22939 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.068022 21844 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.069494 22939 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.076408 22930 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.079401 21923 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.083819 21848 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.097543 21999 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.098804 21748 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.109078 21923 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:44.110250 21967 consensus_peers.cc:597] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abcd87e902c445c5b3c3a383d5f1b3eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.110781 21844 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.111482 22928 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.113404 22928 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.121277 22931 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.127792 21923 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.143409 21746 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:44.155792 21844 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:44.362586 22963 ts_tablet_manager.cc:933] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:44.364212 22963 tablet_copy_client.cc:323] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:44.365676 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 5e2003af45914197b88e4cc3389271af from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:44.366117 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 5e2003af45914197b88e4cc3389271af from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-5e2003af45914197b88e4cc3389271af
I20260709 12:09:44.372160 21936 tablet_copy_source_session.cc:215] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.379953 22963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2003af45914197b88e4cc3389271af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.398231 22963 tablet_copy_client.cc:806] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.398892 22963 tablet_copy_client.cc:670] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.406224 22963 tablet_copy_client.cc:538] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.415619 22963 tablet_bootstrap.cc:492] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:44.437276 22963 tablet_bootstrap.cc:492] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.438045 22963 tablet_bootstrap.cc:492] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:44.438666 22963 ts_tablet_manager.cc:1403] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.010s
I20260709 12:09:44.440979 22963 raft_consensus.cc:359] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.441707 22963 raft_consensus.cc:740] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:44.442389 22963 consensus_queue.cc:260] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.445389 22963 ts_tablet_manager.cc:1434] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:09:44.450834 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-5e2003af45914197b88e4cc3389271af received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:44.451268 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-5e2003af45914197b88e4cc3389271af on tablet 5e2003af45914197b88e4cc3389271af with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:44.464708 22963 ts_tablet_manager.cc:933] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:44.472224 22963 tablet_copy_client.cc:323] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:44.474368 22011 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:44.474995 22011 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-817b6d8ff1d5425b9fdaf0cef3daa8c2
I20260709 12:09:44.487389 22011 tablet_copy_source_session.cc:215] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.491453 22963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.506475 22963 tablet_copy_client.cc:806] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.507074 22963 tablet_copy_client.cc:670] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.510164 22963 tablet_copy_client.cc:538] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.516085 22963 tablet_bootstrap.cc:492] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:44.531244 22963 tablet_bootstrap.cc:492] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.531934 22963 tablet_bootstrap.cc:492] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:44.532482 22963 ts_tablet_manager.cc:1403] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 12:09:44.534598 22963 raft_consensus.cc:359] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.535188 22963 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:44.535694 22963 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.537909 22963 ts_tablet_manager.cc:1434] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:09:44.542801 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-817b6d8ff1d5425b9fdaf0cef3daa8c2 received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:44.543212 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-817b6d8ff1d5425b9fdaf0cef3daa8c2 on tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2 with peer ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:09:44.568471 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080031f460 after lost signal to thread 20708
W20260709 12:09:44.569972 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800153140 after lost signal to thread 21784
W20260709 12:09:44.571586 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800300360 after lost signal to thread 21876
W20260709 12:09:44.572778 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800292200 after lost signal to thread 21951
W20260709 12:09:44.573951 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080032b1c0 after lost signal to thread 22025
W20260709 12:09:44.580551 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800112160 after lost signal to thread 22608
I20260709 12:09:44.581426 22963 ts_tablet_manager.cc:933] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:44.589488 22963 tablet_copy_client.cc:323] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:44.591477 22011 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet abcd87e902c445c5b3c3a383d5f1b3eb from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:44.592036 22011 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet abcd87e902c445c5b3c3a383d5f1b3eb from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-abcd87e902c445c5b3c3a383d5f1b3eb
I20260709 12:09:44.605403 22011 tablet_copy_source_session.cc:215] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.624044 22972 ts_tablet_manager.cc:933] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:44.625051 22963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcd87e902c445c5b3c3a383d5f1b3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.635892 22972 tablet_copy_client.cc:323] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:44.637799 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet f74e6f0a66904748bff04fe46aed7685 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:44.638339 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet f74e6f0a66904748bff04fe46aed7685 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-f74e6f0a66904748bff04fe46aed7685
I20260709 12:09:44.646910 22963 tablet_copy_client.cc:806] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.653957 22963 tablet_copy_client.cc:670] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.657739 22963 tablet_copy_client.cc:538] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.657802 21862 tablet_copy_source_session.cc:215] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.661099 22972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74e6f0a66904748bff04fe46aed7685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.672168 22963 tablet_bootstrap.cc:492] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:44.680263 22972 tablet_copy_client.cc:806] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.681021 22972 tablet_copy_client.cc:670] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.684926 22972 tablet_copy_client.cc:538] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.696614 22972 tablet_bootstrap.cc:492] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:44.718271 22963 tablet_bootstrap.cc:492] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.719214 22963 tablet_bootstrap.cc:492] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:44.719941 22963 ts_tablet_manager.cc:1403] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.008s
I20260709 12:09:44.723126 22972 tablet_bootstrap.cc:492] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.724093 22972 tablet_bootstrap.cc:492] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:44.724819 22972 ts_tablet_manager.cc:1403] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.009s
I20260709 12:09:44.727944 22972 raft_consensus.cc:359] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.728808 22972 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:44.729502 22972 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.722671 22963 raft_consensus.cc:359] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.734601 22963 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:44.734824 22972 ts_tablet_manager.cc:1434] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:09:44.735286 22963 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:44.737272 22963 ts_tablet_manager.cc:1434] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:09:44.739617 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-f74e6f0a66904748bff04fe46aed7685 received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:44.740060 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-f74e6f0a66904748bff04fe46aed7685 on tablet f74e6f0a66904748bff04fe46aed7685 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:44.743830 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-abcd87e902c445c5b3c3a383d5f1b3eb received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:44.744261 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-abcd87e902c445c5b3c3a383d5f1b3eb on tablet abcd87e902c445c5b3c3a383d5f1b3eb with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:44.808529 22582 raft_consensus.cc:1217] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:44.985117 22583 raft_consensus.cc:1217] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.023537 22582 raft_consensus.cc:1217] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.073374 22583 raft_consensus.cc:1217] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.296514 22936 raft_consensus.cc:1064] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:45.298482 22936 consensus_queue.cc:237] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:45.304317 22000 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.305680 21848 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.306264 22583 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.308310 22969 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.309224 22970 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.317358 22969 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.336047 22936 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.339802 21844 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.341210 22000 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.349390 22583 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.361122 21746 catalog_manager.cc:5697] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.408073 21921 consensus_queue.cc:237] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:45.415542 22583 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.416280 21844 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.418180 22986 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.419927 22986 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.431282 21844 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.432560 22936 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.442281 22583 raft_consensus.cc:2955] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.451491 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e2003af45914197b88e4cc3389271af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.452450 21748 catalog_manager.cc:5697] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.466454 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e2003af45914197b88e4cc3389271af with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:45.468298 22989 tablet_replica.cc:333] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:45.471307 22989 raft_consensus.cc:2243] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.472046 22989 raft_consensus.cc:2272] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.475209 22989 ts_tablet_manager.cc:1916] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.492545 22989 ts_tablet_manager.cc:1929] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.492941 22989 log.cc:1199] T 5e2003af45914197b88e4cc3389271af P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/5e2003af45914197b88e4cc3389271af
I20260709 12:09:45.494483 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 5e2003af45914197b88e4cc3389271af (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:45.537739 22939 raft_consensus.cc:1064] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:45.540436 22939 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:45.542222 22990 raft_consensus.cc:1064] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:45.544683 22990 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:45.548581 22583 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.550859 21923 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.552217 22977 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.554067 22931 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.577327 21844 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.580019 22939 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.583390 22934 raft_consensus.cc:1064] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:45.587124 22934 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:45.603631 22996 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.604820 21923 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.613232 21852 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.622431 22583 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.624835 22994 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.628408 21999 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.630973 22994 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.629979 21747 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.647390 22582 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.658035 22934 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.659608 21921 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.665238 22582 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.660722 21999 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.668169 22931 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.663744 21920 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.668155 22945 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.663745 21852 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.673807 22977 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.675026 22931 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.691817 21921 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.722168 22583 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.735456 21999 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:45.738662 21748 catalog_manager.cc:5697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.743791 22580 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.745260 22996 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.756426 22990 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.759711 22581 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.771188 21844 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:45.772765 21852 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.776081 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.779546 21997 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.788667 22994 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.790701 22580 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.791339 22997 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.794238 22997 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.795810 21920 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.797745 21852 raft_consensus.cc:2955] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.805102 21844 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.808086 21747 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.815773 21746 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.811636 22934 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.802212 22582 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.823926 22872 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.825554 21999 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.839843 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f74e6f0a66904748bff04fe46aed7685 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.847765 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:45.846567 22580 raft_consensus.cc:2955] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.860347 21749 catalog_manager.cc:5697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.895984 23006 tablet_replica.cc:333] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:45.914696 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet f74e6f0a66904748bff04fe46aed7685 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:45.920511 21999 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:45.930478 22580 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.931391 21921 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.932343 22990 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.934935 23006 raft_consensus.cc:2243] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.935659 23006 raft_consensus.cc:2272] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.934930 22990 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:45.941284 23006 ts_tablet_manager.cc:1916] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.950345 22931 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.952561 22580 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.957146 21921 raft_consensus.cc:2955] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:45.959041 23006 ts_tablet_manager.cc:1929] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.959621 23006 log.cc:1199] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/817b6d8ff1d5425b9fdaf0cef3daa8c2
I20260709 12:09:45.961354 23006 tablet_replica.cc:333] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:45.961920 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet 817b6d8ff1d5425b9fdaf0cef3daa8c2 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:45.963363 23006 raft_consensus.cc:2243] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.964134 23006 raft_consensus.cc:2272] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.966566 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet abcd87e902c445c5b3c3a383d5f1b3eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.978128 23006 ts_tablet_manager.cc:1916] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.979115 21749 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.991194 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet abcd87e902c445c5b3c3a383d5f1b3eb with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:45.998999 23006 ts_tablet_manager.cc:1929] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.999713 23006 log.cc:1199] T f74e6f0a66904748bff04fe46aed7685 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/f74e6f0a66904748bff04fe46aed7685
I20260709 12:09:46.001740 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet f74e6f0a66904748bff04fe46aed7685 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:46.002466 23007 tablet_replica.cc:333] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:46.003553 23007 raft_consensus.cc:2243] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.004223 23007 raft_consensus.cc:2272] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.008947 23007 ts_tablet_manager.cc:1916] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.022076 23007 ts_tablet_manager.cc:1929] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.022511 23007 log.cc:1199] T abcd87e902c445c5b3c3a383d5f1b3eb P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/abcd87e902c445c5b3c3a383d5f1b3eb
I20260709 12:09:46.024156 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet abcd87e902c445c5b3c3a383d5f1b3eb (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:47.082202 21844 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.088791 21923 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.088793 21999 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:47.089231 21818 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d28906331f4545a29562f950eacb999e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.090556 22994 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.091533 22872 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.100225 22994 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.101751 21923 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.103127 21999 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.121050 21748 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.123807 21921 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:09:47.148170 21893 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b662199918843a1a8139ac42424d3f6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.148263 21844 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.150439 21999 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.153113 22969 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.155752 22936 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.165678 22936 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.193650 21852 consensus_queue.cc:237] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.196805 21999 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.202997 21748 catalog_manager.cc:5697] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.215018 21844 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.228096 21999 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:47.228174 21818 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff3fa17120b9481fbb27a63e11e13340. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.234472 21921 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.234898 22934 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.236909 22872 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.245581 22934 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.247141 21999 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.250888 21923 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.262645 21921 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.264983 21748 catalog_manager.cc:5697] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.274744 21852 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:47.274781 21893 consensus_peers.cc:597] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04f08cb5ae6d4138a6d803e9cf3c8f38. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.273554 21999 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.277482 23020 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.281803 22969 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.306550 22969 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.309149 21852 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.310359 21999 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.326697 21748 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:47.437945 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:47.517511 21844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:47.518116 21844 raft_consensus.cc:606] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:47.522043 21844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "279111025ee54aba83c27bba63339332"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:47.522605 21844 raft_consensus.cc:606] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:47.542037 21999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:47.542656 21999 raft_consensus.cc:606] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:47.545398 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:47.545945 22000 raft_consensus.cc:606] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:47.563131 21923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:47.563712 21923 raft_consensus.cc:606] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:47.568925 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:47.569474 22000 raft_consensus.cc:606] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:47.571035 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:47.572710 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:47.573874 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:47.573971 22997 raft_consensus.cc:993] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:47.574512 22997 raft_consensus.cc:1081] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:47.576656 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:58892
I20260709 12:09:47.577239 22580 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.577564 22580 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.584883 22580 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:47.587781 22580 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:47.588176 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:47.588853 21923 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.589088 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:47.589543 22000 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.589756 22000 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:47.590561 22000 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:47.592131 22000 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.595265 21923 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:47.596817 22547 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:47.602386 22000 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:47.609778 23032 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.611651 23032 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:47.612907 23032 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:47.624341 21748 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.647742 23036 ts_tablet_manager.cc:933] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:47.650756 23035 ts_tablet_manager.cc:933] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:47.653030 23036 tablet_copy_client.cc:323] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:47.655454 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet d28906331f4545a29562f950eacb999e from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:47.655540 23035 tablet_copy_client.cc:323] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:47.656072 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet d28906331f4545a29562f950eacb999e from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-d28906331f4545a29562f950eacb999e
I20260709 12:09:47.657742 21861 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet ff3fa17120b9481fbb27a63e11e13340 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:47.658293 21861 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet ff3fa17120b9481fbb27a63e11e13340 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-ff3fa17120b9481fbb27a63e11e13340
I20260709 12:09:47.666579 21861 tablet_copy_source_session.cc:215] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.665825 21862 tablet_copy_source_session.cc:215] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.670928 22997 raft_consensus.cc:993] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:47.671419 22997 raft_consensus.cc:1081] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:47.672676 23036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28906331f4545a29562f950eacb999e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.673815 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:58892
I20260709 12:09:47.674353 22580 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.674729 22580 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.681525 22580 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:47.683912 22580 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:47.685096 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:47.685750 22000 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.686081 22000 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:47.687063 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:47.686893 22000 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:47.687644 21921 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.688247 22000 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.689250 23035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff3fa17120b9481fbb27a63e11e13340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.701483 21921 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:47.702927 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:47.703992 23032 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.704506 23032 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:47.704810 22000 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:47.705448 23032 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:47.707412 23036 tablet_copy_client.cc:806] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.708207 23036 tablet_copy_client.cc:670] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.715376 23036 tablet_copy_client.cc:538] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.717250 23035 tablet_copy_client.cc:806] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.718549 23035 tablet_copy_client.cc:670] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.725879 23036 tablet_bootstrap.cc:492] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:47.726648 23035 tablet_copy_client.cc:538] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.737411 23039 ts_tablet_manager.cc:933] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:47.742363 21748 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.749641 23040 ts_tablet_manager.cc:933] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:47.755635 23035 tablet_bootstrap.cc:492] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:47.764592 23040 tablet_copy_client.cc:323] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:47.767129 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:47.767712 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 04f08cb5ae6d4138a6d803e9cf3c8f38 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-04f08cb5ae6d4138a6d803e9cf3c8f38
I20260709 12:09:47.777462 21936 tablet_copy_source_session.cc:215] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.781337 23040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.787829 23036 tablet_bootstrap.cc:492] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.789095 23036 tablet_bootstrap.cc:492] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:47.789929 23036 ts_tablet_manager.cc:1403] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.004s
I20260709 12:09:47.792517 23039 tablet_copy_client.cc:323] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:47.793758 23036 raft_consensus.cc:359] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.794656 23036 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:47.794628 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 3b662199918843a1a8139ac42424d3f6 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:47.795493 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 3b662199918843a1a8139ac42424d3f6 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-3b662199918843a1a8139ac42424d3f6
I20260709 12:09:47.795686 23036 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.803107 21936 tablet_copy_source_session.cc:215] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.806365 23036 ts_tablet_manager.cc:1434] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:09:47.808332 23035 tablet_bootstrap.cc:492] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.809437 23035 tablet_bootstrap.cc:492] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:47.811810 23039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b662199918843a1a8139ac42424d3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.815295 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-d28906331f4545a29562f950eacb999e received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:47.815811 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-d28906331f4545a29562f950eacb999e on tablet d28906331f4545a29562f950eacb999e with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:47.815936 23035 ts_tablet_manager.cc:1403] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.007s
I20260709 12:09:47.817998 23040 tablet_copy_client.cc:806] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.818616 23040 tablet_copy_client.cc:670] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.819533 23035 raft_consensus.cc:359] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.820572 23035 raft_consensus.cc:740] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:47.821322 23035 consensus_queue.cc:260] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.827008 23035 ts_tablet_manager.cc:1434] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:09:47.828598 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-ff3fa17120b9481fbb27a63e11e13340 received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:47.828995 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-ff3fa17120b9481fbb27a63e11e13340 on tablet ff3fa17120b9481fbb27a63e11e13340 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:47.835569 23040 tablet_copy_client.cc:538] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.855557 23040 tablet_bootstrap.cc:492] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:47.866367 23039 tablet_copy_client.cc:806] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.867205 23039 tablet_copy_client.cc:670] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.871486 23039 tablet_copy_client.cc:538] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.881922 23039 tablet_bootstrap.cc:492] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:47.882119 23040 tablet_bootstrap.cc:492] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.883030 23040 tablet_bootstrap.cc:492] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:47.883663 23040 ts_tablet_manager.cc:1403] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.010s
I20260709 12:09:47.886837 23040 raft_consensus.cc:359] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.887646 23040 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:47.888294 23040 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.893666 23040 ts_tablet_manager.cc:1434] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:47.895371 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-04f08cb5ae6d4138a6d803e9cf3c8f38 received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:47.895814 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-04f08cb5ae6d4138a6d803e9cf3c8f38 on tablet 04f08cb5ae6d4138a6d803e9cf3c8f38 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:47.909906 23039 tablet_bootstrap.cc:492] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.911033 23039 tablet_bootstrap.cc:492] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:47.911831 23039 ts_tablet_manager.cc:1403] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.005s
I20260709 12:09:47.914773 23039 raft_consensus.cc:359] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.915727 23039 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:47.916278 23039 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:47.918228 23039 ts_tablet_manager.cc:1434] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:09:47.920338 21936 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3b662199918843a1a8139ac42424d3f6 received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:47.920720 21936 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3b662199918843a1a8139ac42424d3f6 on tablet 3b662199918843a1a8139ac42424d3f6 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:47.959321 22934 raft_consensus.cc:993] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:47.959774 22872 raft_consensus.cc:1081] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:47.961153 22000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:47.961647 22000 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.961982 22000 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.970140 22936 raft_consensus.cc:993] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:47.970710 22969 raft_consensus.cc:1081] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:47.971280 22000 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:47.973115 21999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35522
I20260709 12:09:47.973484 22000 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:47.974608 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:47.973618 21999 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.975191 21920 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.975289 21999 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.980623 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:47.981184 21852 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.981449 21852 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:47.983729 22997 raft_consensus.cc:993] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:47.984189 22997 raft_consensus.cc:1081] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:47.984370 22934 raft_consensus.cc:993] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:47.984760 22934 raft_consensus.cc:1081] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:47.982158 21852 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:47.990658 21852 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.992187 21999 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:47.987797 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:58892
I20260709 12:09:47.988776 21997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "279111025ee54aba83c27bba63339332"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:47.994700 22580 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.995045 21997 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.995476 21997 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.996069 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:47.996585 21921 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.996855 21921 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:47.997525 21921 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:47.998560 21921 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.998721 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:47.999262 21844 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.004045 21997 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:48.006644 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:48.007097 21848 raft_consensus.cc:3055] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.007328 21848 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:48.007961 21848 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:48.008782 21848 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.010964 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:48.011521 21923 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.013257 21844 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:48.014171 21999 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:47.995111 22580 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.989456 21920 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:48.015120 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:48.016597 23029 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:48.017098 23029 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:48.017926 21923 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:48.018085 21997 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:48.022550 22582 raft_consensus.cc:1217] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.026479 21964 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:48.027433 21964 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:48.027568 22990 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:48.028358 22997 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:48.022593 23029 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:48.053422 21852 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:48.047660 21848 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:48.067899 21921 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:48.074162 22997 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:48.075337 22997 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:48.084596 22580 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:48.092182 22990 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:48.097325 21749 catalog_manager.cc:5697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.105078 22000 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.104995 22990 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:48.107129 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:48.116050 21852 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.120615 23032 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:48.109761 22580 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:48.130093 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:48.131944 21852 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:48.132423 22000 raft_consensus.cc:3055] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.132766 22000 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:48.133226 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:48.133450 22000 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:48.134756 22000 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.134771 23032 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:48.135419 23032 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:48.136269 23032 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:48.152383 21749 catalog_manager.cc:5697] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.154518 22580 raft_consensus.cc:1217] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.153972 21749 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.161334 21746 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.163411 22000 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:48.190862 21921 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.202231 23060 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:48.202268 22580 raft_consensus.cc:1217] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.219209 22580 raft_consensus.cc:1217] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.242089 21997 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.243508 23060 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:48.255439 21923 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.257944 23033 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:48.451653 22872 raft_consensus.cc:1064] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:48.454026 22872 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:48.459483 22582 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.459595 21997 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.461028 22872 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.462780 21921 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.461720 22994 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.464085 23067 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.477439 23067 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.479050 22582 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.486526 21921 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.491204 21997 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.502516 21748 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.530786 21997 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.532155 23033 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:48.535933 21848 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:48.543460 22580 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.544998 22872 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.549562 21921 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.552037 22994 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.553486 21848 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.555369 23048 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.554173 22872 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.557991 22969 raft_consensus.cc:1064] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:48.557283 22580 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.562160 22969 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:48.573128 21920 raft_consensus.cc:2955] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.577423 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d28906331f4545a29562f950eacb999e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:48.584858 21921 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.586711 23052 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.595475 21848 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.597023 22990 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.597369 21921 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.600044 21748 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.604637 22990 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.613546 21844 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:48.616222 23032 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:48.646163 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet d28906331f4545a29562f950eacb999e with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:48.646497 21848 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.648823 23052 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.655092 21999 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.655754 21844 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.656543 21920 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.661968 22580 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.667724 23052 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.667790 23077 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.693404 22969 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.694290 22936 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.695732 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:48.677719 23080 tablet_replica.cc:333] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:48.726536 23080 raft_consensus.cc:2243] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:48.727334 23080 raft_consensus.cc:2272] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:48.733294 23080 ts_tablet_manager.cc:1916] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:48.751780 23077 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.754634 21994 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.776085 22580 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.799458 23080 ts_tablet_manager.cc:1929] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:48.800254 23080 log.cc:1199] T d28906331f4545a29562f950eacb999e P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/d28906331f4545a29562f950eacb999e
I20260709 12:09:48.813234 22934 raft_consensus.cc:1064] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:48.814504 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet d28906331f4545a29562f950eacb999e (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:48.815584 22934 consensus_queue.cc:237] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:48.820781 21749 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.837355 21994 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.838815 23067 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.839826 21920 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:48.836668 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46246.6us
I20260709 12:09:48.841216 23067 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.843256 21848 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.848572 22580 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.858081 23067 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.864395 23087 raft_consensus.cc:1064] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:48.867532 23087 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:48.868418 21921 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:48.877161 23067 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.880199 22580 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.880174 21918 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.883680 23020 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.891698 21994 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.892191 22581 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.896811 21844 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.898324 23077 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.909061 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01221e34ce744d078265a58313d176a5"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:48.909636 21994 raft_consensus.cc:606] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:48.909977 23077 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.912549 22582 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.917361 21920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:48.917939 21920 raft_consensus.cc:606] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:48.917368 23020 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:48.920172 21749 catalog_manager.cc:5697] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.927455 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:48.928223 21994 raft_consensus.cc:606] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:48.930214 23020 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.932224 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:48.933637 22582 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:48.932988 21852 raft_consensus.cc:606] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:48.938383 21994 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.947299 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:48.948021 21994 raft_consensus.cc:606] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:48.951277 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:48.952116 21852 raft_consensus.cc:606] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:48.956982 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:48.959939 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:48.960644 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:48.962539 23087 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.972236 21994 raft_consensus.cc:2955] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.086398 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.086699 23020 raft_consensus.cc:993] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:49.087348 23020 raft_consensus.cc:1081] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:49.093035 21746 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.094630 23054 raft_consensus.cc:993] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:49.095141 23054 raft_consensus.cc:1081] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:49.096905 22582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:58892
I20260709 12:09:49.097471 22582 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.097844 22582 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.107443 22582 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.110365 22934 raft_consensus.cc:993] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:49.120537 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f08cb5ae6d4138a6d803e9cf3c8f38 with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:49.122468 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:49.123530 21848 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.132000 21848 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:49.141582 22934 raft_consensus.cc:1081] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:49.144464 22000 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.152518 22583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:33654
I20260709 12:09:49.153123 22583 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.153488 22583 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.157886 21994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35522
I20260709 12:09:49.158577 21994 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.158951 21994 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.160311 22583 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.153085 22936 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.162935 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:49.163924 23032 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.164400 23032 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:49.165251 23032 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.166841 22583 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:49.174605 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:49.175251 21852 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.175540 21852 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:49.176395 21852 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.177058 21994 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.177409 21852 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.187835 21748 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.191422 21844 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.193653 21852 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:49.195345 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:49.197063 23032 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.197866 22582 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:49.198097 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:09:49.198081 23032 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:49.200208 23032 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.198945 22580 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.204821 23106 tablet_replica.cc:333] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:49.197186 21994 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:09:49.210320 21848 consensus_queue.cc:237] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.214334 21999 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.218376 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:49.218984 22000 raft_consensus.cc:3055] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.219264 22000 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:49.223271 22000 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.225018 22000 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.222203 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:49.227540 21994 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.226928 21749 catalog_manager.cc:5697] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.211799 23106 raft_consensus.cc:2243] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.236249 23106 raft_consensus.cc:2272] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.242712 22582 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.246098 22583 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.265993 21999 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.269080 22994 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.270995 21746 catalog_manager.cc:5697] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.273712 22580 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:49.275389 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:49.271023 21920 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.273912 23067 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.276036 21918 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.276805 21918 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:49.277598 21918 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.278946 21918 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.287179 21967 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:09:49.288187 22990 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.288715 22990 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:49.289587 22990 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.296559 23103 raft_consensus.cc:993] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:49.297034 23048 raft_consensus.cc:1081] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:49.299775 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:58892
I20260709 12:09:49.300288 22580 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.300608 22580 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.304929 22994 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.308701 22582 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.310153 21997 raft_consensus.cc:2955] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.301218 21918 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:49.312417 22581 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.320907 23106 ts_tablet_manager.cc:1916] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.322479 21848 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.334100 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff3fa17120b9481fbb27a63e11e13340 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.352677 23048 raft_consensus.cc:993] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:49.360591 23048 raft_consensus.cc:1081] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:49.361033 21994 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:49.337877 21749 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.362694 21921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01221e34ce744d078265a58313d176a5"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:09:49.327184 22000 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:49.363235 21921 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.363648 21921 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.362910 21748 catalog_manager.cc:5697] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.347026 22580 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.358049 23096 raft_consensus.cc:993] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:49.345856 23077 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:09:49.367638 23097 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.370178 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:49.370434 23099 raft_consensus.cc:1081] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:49.370814 21844 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.374692 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:49.375269 22000 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.375543 22000 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:49.377301 22000 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.378875 22583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:33654
I20260709 12:09:49.378360 22000 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.379427 22583 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.379887 22583 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.383826 23101 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.385315 22580 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:49.395351 22583 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.397140 22000 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:49.398092 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:49.398731 21848 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.399076 21848 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:49.400270 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet ff3fa17120b9481fbb27a63e11e13340 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:49.400641 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:09:49.401587 23032 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.402040 23032 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:49.400964 21846 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.403123 23032 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.407294 21848 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.408409 21848 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.416051 22580 raft_consensus.cc:2955] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.417268 22583 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:49.428176 21921 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:49.430609 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:49.431260 21994 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.429143 21749 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.432471 21844 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:49.432466 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:49.433353 21846 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.428704 21848 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:49.436383 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:49.437546 23032 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.438158 23032 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:49.438787 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b662199918843a1a8139ac42424d3f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.439122 23032 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:49.443774 21921 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:49.445104 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:49.445700 22000 raft_consensus.cc:3055] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.445969 22000 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:49.446727 22000 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:49.447714 22000 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.453861 21846 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:09:49.454896 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:49.456033 23101 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.456537 23101 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:49.458046 23109 tablet_replica.cc:333] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:49.457645 23101 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:49.462844 23109 raft_consensus.cc:2243] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.463855 23109 raft_consensus.cc:2272] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.453446 21748 catalog_manager.cc:5697] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:49.461612 22000 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:09:49.479782 23109 ts_tablet_manager.cc:1916] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.480283 21994 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:49.487298 23106 ts_tablet_manager.cc:1929] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.491462 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b662199918843a1a8139ac42424d3f6 with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:49.499095 21749 catalog_manager.cc:5697] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 2 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.501992 23106 log.cc:1199] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/04f08cb5ae6d4138a6d803e9cf3c8f38
I20260709 12:09:49.506286 23113 tablet_replica.cc:333] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:49.507911 23113 raft_consensus.cc:2243] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.508728 23113 raft_consensus.cc:2272] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.510253 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 04f08cb5ae6d4138a6d803e9cf3c8f38 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:49.511042 23109 ts_tablet_manager.cc:1929] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.511678 23109 log.cc:1199] T ff3fa17120b9481fbb27a63e11e13340 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/ff3fa17120b9481fbb27a63e11e13340
I20260709 12:09:49.511111 21748 catalog_manager.cc:5697] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.513633 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet ff3fa17120b9481fbb27a63e11e13340 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:49.514204 23113 ts_tablet_manager.cc:1916] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.527423 23113 ts_tablet_manager.cc:1929] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.527709 23113 log.cc:1199] T 3b662199918843a1a8139ac42424d3f6 P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/3b662199918843a1a8139ac42424d3f6
I20260709 12:09:49.529081 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 3b662199918843a1a8139ac42424d3f6 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:49.586131 21994 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.587700 23032 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.606300 21846 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.607905 23061 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.669230 22000 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.670543 23060 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.681921 21846 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.683566 23032 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.779667 22580 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.780803 23103 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.791963 21918 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.796383 23105 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.873806 21994 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.875157 23032 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.886718 21846 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.888211 23032 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.916117 21846 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.917390 23032 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.929697 22000 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.932778 23120 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.039516 22000 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.040637 23101 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.053948 21846 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.056105 23129 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.120615 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.166327 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:50.166925 21994 raft_consensus.cc:606] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:50.169190 21918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:50.169673 21918 raft_consensus.cc:606] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:50.171839 21846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:50.172266 21846 raft_consensus.cc:606] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:50.174346 21846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:50.174805 21846 raft_consensus.cc:606] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:50.176934 21846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:50.177330 21846 raft_consensus.cc:606] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:50.178238 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:50.179391 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:50.180027 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.338552 23099 raft_consensus.cc:993] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:50.339094 23096 raft_consensus.cc:1081] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:50.340628 21994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:50.341137 21994 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.341463 21994 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.346635 21994 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:50.349140 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:50.349330 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:50.349725 21846 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.349954 21921 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.350065 21846 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:50.351042 23048 raft_consensus.cc:993] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:50.350947 21846 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:50.351539 22990 raft_consensus.cc:1081] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:50.351884 21846 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.353042 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:58892
I20260709 12:09:50.353611 22580 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.353976 22580 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.357117 21921 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:50.348830 21994 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:50.358006 21846 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:50.358520 21964 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:50.359862 22990 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.360349 22990 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:50.361104 22990 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:50.369144 22580 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:50.372408 22580 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:50.372845 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:50.373474 21921 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.373147 21749 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.376818 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:50.377384 21994 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:50.377651 21994 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:50.378341 21994 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:50.379509 21994 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.379415 21921 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:09:50.385175 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:50.385998 23120 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.386484 23120 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:50.387265 23120 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:50.387889 21994 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:09:50.398164 21748 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 3 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.487924 23099 raft_consensus.cc:993] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:50.488389 23096 raft_consensus.cc:1081] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:50.489651 21994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:50.490046 21994 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.490265 21994 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.496770 21994 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:50.498957 21994 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:50.499732 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:50.500309 21846 raft_consensus.cc:3055] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.501713 21846 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:50.502728 21846 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:50.503978 21846 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.509001 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:50.509655 21921 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.510594 21846 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:50.511735 21966 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:50.512445 23048 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.512900 23048 raft_consensus.cc:697] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:50.513765 23048 consensus_queue.cc:237] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:50.517727 21921 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:50.528285 21748 catalog_manager.cc:5697] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.576910 21994 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:50.582446 21846 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.582623 21921 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:50.583315 21967 consensus_peers.cc:597] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d194e05a662143ea99bad3093bf3e0dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.583976 23048 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.586498 23105 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.588367 23099 raft_consensus.cc:993] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:50.588876 23096 raft_consensus.cc:1081] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:50.590337 21994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:50.590926 21994 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.592662 21994 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.600980 21994 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:50.599954 23105 raft_consensus.cc:2955] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.603554 21994 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:50.603744 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:50.604291 21918 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.603364 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:50.607528 21846 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.607868 21846 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:50.608572 21846 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:50.609793 21846 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.616366 21846 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:50.616076 21844 raft_consensus.cc:2955] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.619501 21921 raft_consensus.cc:2955] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.621057 21966 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:50.623160 22990 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.623586 22990 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:50.626109 21918 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:50.639557 22990 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:50.646265 23077 raft_consensus.cc:993] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:50.646899 23077 raft_consensus.cc:1081] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:50.652817 21846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56594
I20260709 12:09:50.653347 21846 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.653656 21846 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.658558 21749 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.660435 21846 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:50.663422 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:50.663513 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:09:50.664012 21918 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.664125 22580 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.664376 21918 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:50.665241 21918 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:50.666296 21918 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.671277 22580 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:09:50.676064 21846 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:09:50.675982 21818 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:50.676937 23099 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.677410 23099 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:50.673374 21994 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:50.678191 23099 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:50.681798 21918 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
W20260709 12:09:50.682837 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 61849.6us
W20260709 12:09:50.695433 21967 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8fce2d558023440ebf41a6f0ed6a062b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.699805 21846 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.699836 21921 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.701999 23141 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.704521 23141 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.705505 21749 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.710549 21748 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.723935 23140 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.727047 21921 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.739177 21918 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:50.741523 21846 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.745144 21748 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:50.751490 21893 consensus_peers.cc:597] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a7076f768c74a41bc54edd6bcaaaf83. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.758944 21994 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.759987 21846 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.762215 23101 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.765764 23129 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.771775 23077 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.784173 22000 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.787812 21846 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.793282 21746 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.794691 21918 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:50.806277 21921 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:50.809760 23061 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:09:50.820164 21893 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77a9143d931e458e9c5824195395a69b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.821682 22000 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:50.824746 23032 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:50.831393 21846 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.832463 21994 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.835489 23077 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:09:50.843518 23101 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.863543 23101 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.866221 22000 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.882925 21844 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.892306 21846 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.892318 21749 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:50.897778 23140 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.907974 21920 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.909196 22990 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.925776 21918 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.928382 23141 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.969944 21846 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.975744 23141 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.035274 23166 ts_tablet_manager.cc:933] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:51.037467 23166 tablet_copy_client.cc:323] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:51.039270 22011 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet d194e05a662143ea99bad3093bf3e0dd from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:51.039813 22011 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet d194e05a662143ea99bad3093bf3e0dd from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-d194e05a662143ea99bad3093bf3e0dd
I20260709 12:09:51.047670 22011 tablet_copy_source_session.cc:215] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.050787 23166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d194e05a662143ea99bad3093bf3e0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.070046 23166 tablet_copy_client.cc:806] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.070659 23166 tablet_copy_client.cc:670] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.073937 23166 tablet_copy_client.cc:538] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.083309 23166 tablet_bootstrap.cc:492] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:51.085062 22580 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.087172 23096 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.114398 23166 tablet_bootstrap.cc:492] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.115411 23166 tablet_bootstrap.cc:492] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:51.116170 23166 ts_tablet_manager.cc:1403] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.008s
I20260709 12:09:51.119127 21920 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.119045 23166 raft_consensus.cc:359] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:51.120007 23166 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:51.120729 23166 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:51.123476 23166 ts_tablet_manager.cc:1434] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:51.128273 23168 ts_tablet_manager.cc:933] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:51.131845 22990 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:09:51.152439 21921 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.158208 23171 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.170011 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-d194e05a662143ea99bad3093bf3e0dd received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:51.170600 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-d194e05a662143ea99bad3093bf3e0dd on tablet d194e05a662143ea99bad3093bf3e0dd with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:51.219978 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:51.222556 21846 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.225430 23048 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:51.244006 23175 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:09:51.255782 23168 tablet_copy_client.cc:323] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:51.276969 22011 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet 8fce2d558023440ebf41a6f0ed6a062b from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:51.277510 22011 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet 8fce2d558023440ebf41a6f0ed6a062b from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-8fce2d558023440ebf41a6f0ed6a062b
I20260709 12:09:51.288699 23166 ts_tablet_manager.cc:933] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:51.295909 22011 tablet_copy_source_session.cc:215] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.299207 23168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fce2d558023440ebf41a6f0ed6a062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.308902 23166 tablet_copy_client.cc:323] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:51.310688 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 3a7076f768c74a41bc54edd6bcaaaf83 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:51.311224 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 3a7076f768c74a41bc54edd6bcaaaf83 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-3a7076f768c74a41bc54edd6bcaaaf83
I20260709 12:09:51.318706 21936 tablet_copy_source_session.cc:215] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.324618 23166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7076f768c74a41bc54edd6bcaaaf83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.326378 23168 tablet_copy_client.cc:806] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.327080 23168 tablet_copy_client.cc:670] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.331576 23168 tablet_copy_client.cc:538] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.332949 21844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:51.333540 21844 raft_consensus.cc:606] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:51.336494 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:51.337041 22000 raft_consensus.cc:606] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:51.340620 23168 tablet_bootstrap.cc:492] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:51.340584 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:51.343232 21994 raft_consensus.cc:606] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:51.344065 23166 tablet_copy_client.cc:806] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.344707 23166 tablet_copy_client.cc:670] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.348323 21846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:51.348876 21846 raft_consensus.cc:606] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:51.352609 21920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:51.353192 21920 raft_consensus.cc:606] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:51.354637 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:51.356529 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:51.359503 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:51.361892 23166 tablet_copy_client.cc:538] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.364842 23168 tablet_bootstrap.cc:492] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.374748 23166 tablet_bootstrap.cc:492] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:51.377440 23168 tablet_bootstrap.cc:492] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:51.377704 23180 ts_tablet_manager.cc:933] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:51.378618 23168 ts_tablet_manager.cc:1403] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.001s
I20260709 12:09:51.382936 23168 raft_consensus.cc:359] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:51.383828 23168 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:51.385262 23180 tablet_copy_client.cc:323] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:51.384516 23168 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:51.420666 23168 ts_tablet_manager.cc:1434] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 12:09:51.444808 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-8fce2d558023440ebf41a6f0ed6a062b received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:51.445269 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-8fce2d558023440ebf41a6f0ed6a062b on tablet 8fce2d558023440ebf41a6f0ed6a062b with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:51.468816 21936 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 77a9143d931e458e9c5824195395a69b from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:51.469430 21936 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 77a9143d931e458e9c5824195395a69b from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-77a9143d931e458e9c5824195395a69b
I20260709 12:09:51.497920 21936 tablet_copy_source_session.cc:215] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.511718 23180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a9143d931e458e9c5824195395a69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.526448 22580 raft_consensus.cc:1217] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.529106 23166 tablet_bootstrap.cc:492] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.530426 23166 tablet_bootstrap.cc:492] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:51.531313 23166 ts_tablet_manager.cc:1403] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.157s	user 0.024s	sys 0.006s
I20260709 12:09:51.534119 23166 raft_consensus.cc:359] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:51.534986 23166 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:51.535925 23180 tablet_copy_client.cc:806] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.536461 23166 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:51.536507 23180 tablet_copy_client.cc:670] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.539068 23166 ts_tablet_manager.cc:1434] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:51.541445 21937 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3a7076f768c74a41bc54edd6bcaaaf83 received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:51.541939 21937 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3a7076f768c74a41bc54edd6bcaaaf83 on tablet 3a7076f768c74a41bc54edd6bcaaaf83 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:51.543263 23180 tablet_copy_client.cc:538] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.548148 23096 raft_consensus.cc:993] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:51.549466 23096 raft_consensus.cc:1081] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:51.552855 21994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:51.553390 21994 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.553732 21994 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.555785 23180 tablet_bootstrap.cc:492] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:51.556201 23172 raft_consensus.cc:993] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:51.556655 23172 raft_consensus.cc:1081] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:51.560212 22000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:51.560730 22000 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.561126 22000 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.560842 21994 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.564764 21994 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:51.565265 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:51.565833 21920 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.566062 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:51.566664 21844 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.566926 21844 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:51.567685 21844 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.568681 21844 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.574697 21920 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:51.578768 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:51.581771 23141 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.583002 23141 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:51.584012 23180 tablet_bootstrap.cc:492] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.583887 23141 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.585022 23180 tablet_bootstrap.cc:492] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:51.585772 23180 ts_tablet_manager.cc:1403] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.030s	user 0.028s	sys 0.000s
I20260709 12:09:51.588713 23180 raft_consensus.cc:359] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:51.589566 23180 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:51.590250 23180 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:51.594590 23180 ts_tablet_manager.cc:1434] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:51.596346 21937 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-77a9143d931e458e9c5824195395a69b received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:51.596760 21937 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-77a9143d931e458e9c5824195395a69b on tablet 77a9143d931e458e9c5824195395a69b with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:51.597342 22580 raft_consensus.cc:1217] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.607892 23182 raft_consensus.cc:993] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:51.608359 23182 raft_consensus.cc:1081] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:51.611658 21848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56594
I20260709 12:09:51.612213 21848 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.612546 21848 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.612821 21844 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:51.614529 22000 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.617486 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:51.619395 21844 raft_consensus.cc:3055] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.619721 21844 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:51.620507 21844 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.621511 21844 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.626859 21748 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.632968 21844 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:51.632725 21848 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.634222 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:51.635015 23141 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.635488 23141 raft_consensus.cc:697] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:51.636349 23141 consensus_queue.cc:237] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.637120 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:51.637712 21920 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.634841 22000 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:51.639038 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:51.639566 21927 raft_consensus.cc:3055] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.639863 21927 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:51.640597 21927 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.641570 21927 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.646235 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:51.649893 21994 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.657586 21994 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:09:51.658634 21848 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:51.665244 23140 raft_consensus.cc:993] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:51.666345 22990 raft_consensus.cc:1081] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:51.668113 21921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:09:51.668689 21921 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.669045 21921 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.669425 21817 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:51.670349 23096 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.672381 23096 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:51.673422 23096 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.676819 21921 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.677349 21927 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:09:51.679997 21921 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:51.680099 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:51.681182 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:51.685567 21994 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:51.685978 21994 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:51.687204 21994 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.689371 21994 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.690232 21920 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:51.688624 21844 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.699700 21844 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:09:51.700958 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:51.701673 23157 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:51.702144 23157 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:51.703240 21748 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.703555 23157 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.704656 21994 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:09:51.704963 21746 catalog_manager.cc:5697] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.729048 21746 catalog_manager.cc:5697] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.849113 22580 raft_consensus.cc:1217] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.897006 22580 raft_consensus.cc:1217] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.936093 23141 raft_consensus.cc:993] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:51.936765 23140 raft_consensus.cc:1081] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:51.939494 21848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:09:51.940053 21848 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.940387 21848 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.948745 21848 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.951099 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:51.951299 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:51.951725 21920 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.951886 21994 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.952286 21994 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:51.953006 21994 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.953696 21994 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.955008 21848 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:51.959276 21994 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:09:51.959304 21920 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:09:51.960522 21817 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:51.961709 23172 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.962152 23172 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:51.962983 23172 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:51.977061 21748 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.005456 23140 raft_consensus.cc:1064] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:52.007443 23140 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:52.013516 22580 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.014478 21921 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.015218 23141 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.016749 21844 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.017897 23141 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.024852 23140 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.026559 23141 raft_consensus.cc:1064] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:52.029891 23141 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:52.054591 21844 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.050155 22990 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.063354 22580 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.065467 23048 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.066805 21920 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.068946 23140 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.078156 21748 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.087217 21927 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.089766 21844 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.090147 21848 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.091429 23141 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.092936 23198 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.106634 22000 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.107911 21918 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.108181 23099 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.110373 23198 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.114121 21852 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.115566 23141 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.134733 21922 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.136453 23141 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.160439 21852 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:52.185297 23182 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.202834 22580 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.215284 21927 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.222456 23198 raft_consensus.cc:2955] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.228024 21922 raft_consensus.cc:2955] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.241976 22582 raft_consensus.cc:2955] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:09:52.230590 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47866.3us
W20260709 12:09:52.249467 23204 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:09:52.255192 23173 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.355851 21748 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:52.402493 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 86647.6us
I20260709 12:09:52.423162 22000 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:09:52.430858 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 143095us
I20260709 12:09:52.449230 21994 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:52.439505 23156 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:09:52.454209 22000 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:52.469099 22580 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.476580 23219 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.478132 22580 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.478461 21850 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.480396 23141 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.483196 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.490875 22990 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.525522 21994 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.535116 21922 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.535300 23048 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.538448 21844 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.548223 23157 raft_consensus.cc:1064] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:52.548703 23221 raft_consensus.cc:1064] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:52.539536 23141 raft_consensus.cc:2955] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.551234 23221 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:52.553944 23157 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:52.557422 21922 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.558218 23099 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.559868 23172 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.567028 22580 raft_consensus.cc:2955] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.576814 23222 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.577809 22583 raft_consensus.cc:2955] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.599886 21922 raft_consensus.cc:2955] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.589702 21748 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.604074 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d194e05a662143ea99bad3093bf3e0dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.632718 21749 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.656368 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fce2d558023440ebf41a6f0ed6a062b with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:52.661525 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8fce2d558023440ebf41a6f0ed6a062b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.671168 21994 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.672078 22580 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.675829 23182 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.676306 21844 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.678965 23213 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.680702 23213 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.702845 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet d194e05a662143ea99bad3093bf3e0dd with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:52.720928 22583 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.722457 21844 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.723985 21999 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.729868 23221 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.731228 23234 tablet_replica.cc:333] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:52.733448 21918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02f67b74a580421b99787adc89841d21"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:52.734009 21918 raft_consensus.cc:606] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:52.734529 23157 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:52.735988 23182 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.760982 23234 raft_consensus.cc:2243] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.761672 23234 pending_rounds.cc:70] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: Trying to abort 1 pending ops.
I20260709 12:09:52.762856 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:52.763432 22000 raft_consensus.cc:606] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:52.769299 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:52.761999 23234 pending_rounds.cc:77] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305621471346753536 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "d194e05a662143ea99bad3093bf3e0dd" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } } }
I20260709 12:09:52.769835 22000 raft_consensus.cc:606] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:52.769944 23234 raft_consensus.cc:2917] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:09:52.772341 23234 raft_consensus.cc:2889] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:09:52.772796 23234 raft_consensus.cc:2272] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.773768 21850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:52.774519 21850 raft_consensus.cc:606] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:52.777118 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:52.778858 23234 ts_tablet_manager.cc:1916] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.791595 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:52.792579 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.827171 23213 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.830590 22580 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.835417 21997 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.854959 23230 tablet_replica.cc:333] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:52.855944 23230 raft_consensus.cc:2243] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.856627 23230 raft_consensus.cc:2272] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.863265 23215 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.871886 21994 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.874769 23220 raft_consensus.cc:993] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:52.875264 23156 raft_consensus.cc:1081] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:52.877374 22000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02f67b74a580421b99787adc89841d21"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35522
I20260709 12:09:52.877858 22000 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.878175 22000 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.880683 23230 ts_tablet_manager.cc:1916] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.891922 22000 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:52.893173 21749 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.892091 21844 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.897992 22000 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:09:52.899085 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:09:52.899695 22583 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.912137 23234 ts_tablet_manager.cc:1929] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:52.912694 23234 log.cc:1199] T d194e05a662143ea99bad3093bf3e0dd P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/d194e05a662143ea99bad3093bf3e0dd
I20260709 12:09:52.934875 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet d194e05a662143ea99bad3093bf3e0dd (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:52.937140 21747 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:09:52.941819 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 48006us
I20260709 12:09:52.948410 22583 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:52.954298 23096 raft_consensus.cc:993] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:52.957590 21967 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:09:52.958468 22990 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.959156 22990 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:52.961800 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:52.962371 21918 raft_consensus.cc:3055] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.962656 21918 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:52.963266 21918 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:52.964219 21918 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.959987 22990 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:52.969725 23096 raft_consensus.cc:1081] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:52.972182 23230 ts_tablet_manager.cc:1929] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:52.974671 23230 log.cc:1199] T 8fce2d558023440ebf41a6f0ed6a062b P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/8fce2d558023440ebf41a6f0ed6a062b
I20260709 12:09:52.975369 21994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:52.980240 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet 8fce2d558023440ebf41a6f0ed6a062b (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:52.975951 21994 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.980841 21994 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.975998 21844 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:52.984174 21918 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:52.992901 22582 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:52.994601 21994 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:53.002074 22583 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:53.010390 21750 catalog_manager.cc:5697] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.015125 21994 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:53.017534 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:53.018064 21850 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.018337 21850 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:53.019088 21850 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:53.020262 21850 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.027360 21918 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:53.031298 21921 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:53.038668 21848 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.041169 23241 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.044730 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:53.045298 21921 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.051724 21921 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:53.053777 21964 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:53.054747 22582 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.055373 22580 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.054772 22990 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.056052 23215 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:53.057152 22990 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:53.057946 22990 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:53.065193 21850 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:53.072212 23182 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.071910 21844 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:53.081849 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77a9143d931e458e9c5824195395a69b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.082741 23140 raft_consensus.cc:993] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:53.083215 23222 raft_consensus.cc:1081] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:53.083595 23182 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.086997 21850 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.087646 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:58892
I20260709 12:09:53.088224 22580 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.088575 22580 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.089404 22582 raft_consensus.cc:2955] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:53.096635 23220 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.098194 22580 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:53.103211 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:53.103794 21847 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.105059 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:53.105654 21994 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.106004 21994 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:53.106745 21994 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:53.107762 21994 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.108739 23215 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:53.122946 21747 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.129397 21749 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.134557 22580 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:53.135223 21994 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:53.137089 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:09:53.136942 22583 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:53.138185 23214 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.138720 23214 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:53.139510 23214 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:53.142521 21847 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:53.148386 23222 raft_consensus.cc:993] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:53.148881 23141 raft_consensus.cc:1081] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:53.153330 21747 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.155599 21918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:09:53.157836 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet 77a9143d931e458e9c5824195395a69b with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:53.158097 21918 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.158636 21918 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.162055 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a7076f768c74a41bc54edd6bcaaaf83 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.170014 21918 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:53.172587 21918 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:53.157280 21847 raft_consensus.cc:2955] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:53.172689 21749 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.176632 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:53.177268 21994 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:53.177611 21994 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:53.176761 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:53.178821 21850 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.178475 21994 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:53.182463 21994 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.187515 21982 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a7076f768c74a41bc54edd6bcaaaf83 with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:53.191018 21994 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:09:53.192142 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:53.193164 23241 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:53.193629 23241 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:53.194465 23241 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:53.195971 23247 tablet_replica.cc:333] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:53.197000 23247 raft_consensus.cc:2243] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.197801 23247 raft_consensus.cc:2272] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.194607 21850 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:09:53.201836 23247 ts_tablet_manager.cc:1916] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.215129 21747 catalog_manager.cc:5697] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.220172 23247 ts_tablet_manager.cc:1929] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.220631 23247 log.cc:1199] T 77a9143d931e458e9c5824195395a69b P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/77a9143d931e458e9c5824195395a69b
I20260709 12:09:53.221956 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 77a9143d931e458e9c5824195395a69b (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:53.222084 23247 tablet_replica.cc:333] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:53.224068 23247 raft_consensus.cc:2243] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.224792 23247 raft_consensus.cc:2272] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.228475 23247 ts_tablet_manager.cc:1916] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.240486 23247 ts_tablet_manager.cc:1929] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.240799 23247 log.cc:1199] T 3a7076f768c74a41bc54edd6bcaaaf83 P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/3a7076f768c74a41bc54edd6bcaaaf83
I20260709 12:09:53.242223 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 3a7076f768c74a41bc54edd6bcaaaf83 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:53.494896 21918 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.496321 23222 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.497044 21850 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.498231 23222 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.521080 22583 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.523114 23141 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.529359 21918 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.534309 23141 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.557062 21847 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.559029 23061 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.603135 22000 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.704409 23259 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:09:53.737812 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 121203us
I20260709 12:09:53.756407 21850 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:53.761272 23220 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.775369 21994 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:53.777725 23220 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.068696 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.109404 21999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02f67b74a580421b99787adc89841d21"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:54.110042 21999 raft_consensus.cc:606] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:54.113487 21999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:54.113972 21999 raft_consensus.cc:606] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:54.116271 21850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:54.116763 21850 raft_consensus.cc:606] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:54.119609 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:54.120153 21994 raft_consensus.cc:606] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:54.122540 21921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:54.122977 21921 raft_consensus.cc:606] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:54.124008 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:54.125203 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:54.125955 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.128284 23141 raft_consensus.cc:993] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:54.128764 23218 raft_consensus.cc:1081] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:54.130275 22583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02f67b74a580421b99787adc89841d21"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:58892
I20260709 12:09:54.130832 22583 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.131117 22583 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.135818 22583 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:54.137637 22583 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:54.139456 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:54.139624 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:54.140015 21921 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.140139 21994 raft_consensus.cc:3055] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:54.140479 21994 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:54.141168 21994 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:54.142280 21994 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.149029 21921 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:09:54.150182 22547 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:54.151093 23061 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:54.151582 23061 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:54.152411 23061 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:54.153940 21994 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:09:54.162926 21747 catalog_manager.cc:5697] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 3 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.207301 23140 raft_consensus.cc:993] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:54.207803 23218 raft_consensus.cc:1081] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:54.209198 21850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:09:54.209750 21850 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.210084 21850 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.216814 21850 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:54.218690 21850 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:54.219543 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:54.219599 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:54.220242 21918 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.220275 21999 raft_consensus.cc:3055] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:54.220774 21999 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:54.221549 21999 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:54.222566 21999 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.228744 21918 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:09:54.229213 21999 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:09:54.231544 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:54.232308 23173 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:54.232781 23173 raft_consensus.cc:697] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:54.233508 23173 consensus_queue.cc:237] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:54.254581 21747 catalog_manager.cc:5697] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.272167 21999 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:54.277307 21918 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:09:54.277622 21967 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbfd595fdbf3470193f7cd91b4969857. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.277356 21850 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.278759 23141 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.279564 23140 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.287976 21920 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.293089 23218 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.305888 23220 raft_consensus.cc:993] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:54.306519 23220 raft_consensus.cc:1081] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:54.308352 21847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56594
I20260709 12:09:54.308926 21847 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.309291 21847 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.316886 21847 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:54.319600 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:54.319857 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:54.320179 21918 raft_consensus.cc:3055] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.320487 21999 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.320518 21918 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:54.321417 21918 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:54.322486 21918 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.326678 21847 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:54.327078 23217 raft_consensus.cc:993] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:54.327564 23217 raft_consensus.cc:1081] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:54.329025 21918 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:09:54.329452 21994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:54.329969 21994 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.330312 21994 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.331312 21815 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:54.333092 22000 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:54.334551 21747 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.341742 23173 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.344424 21850 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.345986 23173 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:54.347070 23173 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:54.353103 21999 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
W20260709 12:09:54.361743 21967 consensus_peers.cc:597] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f127c5582f284fbd97aa877ecdd4d4f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.362833 21994 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:54.365864 21847 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.367152 23272 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.370998 21918 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.379212 23272 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.385643 21994 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:54.387095 23141 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.387863 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:54.388805 21847 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:54.389110 21847 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:54.391086 23271 raft_consensus.cc:993] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:54.391006 21847 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:54.391682 23271 raft_consensus.cc:1081] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:54.390746 21848 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.392619 21847 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.393972 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:54.394610 21920 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.394863 21921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:09:54.395411 21921 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.395740 21921 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.402504 21921 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:54.404868 21847 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:09:54.406294 21966 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:54.407270 21921 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:09:54.407418 23273 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:54.407577 21920 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:09:54.407965 23273 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:54.412474 23273 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:54.403126 21918 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.408463 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:54.408565 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:09:54.417241 22583 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.417171 22000 raft_consensus.cc:3055] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.417783 22000 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:54.418884 22000 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:54.428472 22000 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.423976 21747 catalog_manager.cc:5697] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.430667 22583 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:09:54.436885 21893 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:54.438136 23265 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.438971 23265 raft_consensus.cc:697] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:54.439900 23265 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:54.446439 22000 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:09:54.452322 21749 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.418787 21848 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:54.480768 21747 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 2 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.487260 21918 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.483913 21750 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 2 to 3, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 3 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.488597 23261 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 12:09:54.498844 21818 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68b43b3517064c3b81e50b88c21938ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.488134 22000 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.502223 23261 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.700503 23261 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.804591 21994 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.814965 21999 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.819196 23291 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.833077 23292 ts_tablet_manager.cc:933] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:54.835819 21918 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:54.844787 23259 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:54.860221 21747 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.886924 21922 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.905742 22000 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:54.916122 21922 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:54.927111 21848 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:54.955013 21920 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.957085 23272 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.961547 21844 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.963074 23272 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:54.971251 23286 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:54.982082 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 64872.3us
W20260709 12:09:54.985015 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 107689us
I20260709 12:09:54.986403 22000 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.990489 23220 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.994468 23061 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:09:55.025794 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49921.1us
I20260709 12:09:55.036669 23292 tablet_copy_client.cc:323] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:55.083911 23297 ts_tablet_manager.cc:933] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:09:55.086130 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 59479.7us
I20260709 12:09:55.092231 21920 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.093575 21923 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.108834 22582 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.108834 21999 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:55.109758 21997 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.113109 23299 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.113258 23285 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.114272 23306 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.114588 23290 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:55.123512 21818 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dae741cd77e441b281f9ed48a672f87d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:55.123561 22011 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet f127c5582f284fbd97aa877ecdd4d4f4 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:55.124207 22011 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet f127c5582f284fbd97aa877ecdd4d4f4 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-f127c5582f284fbd97aa877ecdd4d4f4
I20260709 12:09:55.095618 23297 tablet_copy_client.cc:323] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:55.146848 23317 ts_tablet_manager.cc:933] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:55.151592 22011 tablet_copy_source_session.cc:215] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.154457 22010 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet fbfd595fdbf3470193f7cd91b4969857 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:55.156613 22010 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet fbfd595fdbf3470193f7cd91b4969857 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-fbfd595fdbf3470193f7cd91b4969857
I20260709 12:09:55.162132 23317 tablet_copy_client.cc:323] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:55.164005 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet 68b43b3517064c3b81e50b88c21938ce from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:55.164541 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet 68b43b3517064c3b81e50b88c21938ce from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-68b43b3517064c3b81e50b88c21938ce
I20260709 12:09:55.164915 22010 tablet_copy_source_session.cc:215] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:09:55.168830 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 58893.3us
I20260709 12:09:55.183145 23297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfd595fdbf3470193f7cd91b4969857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.190850 23283 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:55.203868 23292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f127c5582f284fbd97aa877ecdd4d4f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.211736 21862 tablet_copy_source_session.cc:215] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.220844 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.277281 23303 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:55.285776 22001 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:55.293656 23317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b43b3517064c3b81e50b88c21938ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.303227 21844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:55.303973 21844 raft_consensus.cc:606] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:55.327255 21921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:55.327809 21921 raft_consensus.cc:606] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:55.379943 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:55.380529 22000 raft_consensus.cc:606] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:55.387053 21923 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:55.394150 21850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:55.397920 21850 raft_consensus.cc:606] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:55.418071 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:55.389489 23297 tablet_copy_client.cc:806] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.402629 21747 catalog_manager.cc:5697] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:55.421094 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:55.424463 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.434451 23297 tablet_copy_client.cc:670] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
W20260709 12:09:55.458359 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 55347.7us
I20260709 12:09:55.463681 23292 tablet_copy_client.cc:806] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.464337 23292 tablet_copy_client.cc:670] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
W20260709 12:09:55.474889 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 54712.3us
I20260709 12:09:55.504559 23292 tablet_copy_client.cc:538] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.505987 23297 tablet_copy_client.cc:538] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.507898 23287 raft_consensus.cc:993] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:55.508392 23287 raft_consensus.cc:1081] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:55.512825 23326 raft_consensus.cc:993] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:55.513309 23326 raft_consensus.cc:1081] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:55.513926 23317 tablet_copy_client.cc:806] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.516494 23317 tablet_copy_client.cc:670] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.518684 21844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56594
I20260709 12:09:55.519222 21844 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.519505 21844 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.521947 21927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:09:55.522442 21927 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.522747 21927 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.536561 21844 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:55.538746 21844 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:55.539774 23317 tablet_copy_client.cc:538] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.540329 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:55.540866 22000 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.549021 22000 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:09:55.550267 21817 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:55.539222 21927 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:55.551545 23318 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:55.552026 23318 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:55.552196 23292 tablet_bootstrap.cc:492] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:55.553779 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:55.554384 21923 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:55.554709 21923 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:55.555405 21923 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:55.556555 21923 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.557111 23297 tablet_bootstrap.cc:492] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:55.553922 21927 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:55.560556 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:55.560892 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:55.561188 21850 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.561398 22000 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:55.561682 22000 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:55.563347 22000 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:55.564425 22000 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.568524 23318 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:55.576030 21850 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:09:55.577028 23317 tablet_bootstrap.cc:492] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:55.579478 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:55.580092 22000 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:09:55.586194 21923 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:09:55.580382 23326 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:55.590647 23326 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:55.602135 23326 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:55.641449 21747 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 3 to 4, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 4 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.646468 23285 raft_consensus.cc:993] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:55.646988 23285 raft_consensus.cc:1081] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:55.650012 21993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:55.650619 23332 ts_tablet_manager.cc:933] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:55.650615 21993 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.651270 21993 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.651623 21749 catalog_manager.cc:5697] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 4, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 4 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.661513 21993 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:55.666730 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:55.667485 21850 raft_consensus.cc:3055] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:55.667877 21850 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:55.668804 21850 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:55.670142 21850 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.678859 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:55.679415 21927 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.696060 21993 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:55.677317 23332 tablet_copy_client.cc:323] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:55.702034 21850 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:09:55.702200 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet dae741cd77e441b281f9ed48a672f87d from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:55.703706 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet dae741cd77e441b281f9ed48a672f87d from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-dae741cd77e441b281f9ed48a672f87d
I20260709 12:09:55.708922 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:55.709725 23287 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:55.710098 23292 tablet_bootstrap.cc:492] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.710979 23287 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:09:55.711519 21948 debug-util.cc:398] Leaking SignalData structure 0x7b08000e60a0 after lost signal to thread 20708
W20260709 12:09:55.712512 21948 debug-util.cc:398] Leaking SignalData structure 0x7b0800167980 after lost signal to thread 21784
I20260709 12:09:55.713627 21862 tablet_copy_source_session.cc:215] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:09:55.713635 21948 debug-util.cc:398] Leaking SignalData structure 0x7b08003441e0 after lost signal to thread 21876
W20260709 12:09:55.720112 21948 debug-util.cc:398] Leaking SignalData structure 0x7b0800371f60 after lost signal to thread 21951
W20260709 12:09:55.721149 21948 debug-util.cc:398] Leaking SignalData structure 0x7b08001affa0 after lost signal to thread 22025
I20260709 12:09:55.722352 23332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae741cd77e441b281f9ed48a672f87d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:55.723078 21948 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad2a0 after lost signal to thread 22608
I20260709 12:09:55.717618 23292 tablet_bootstrap.cc:492] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:55.734300 21927 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:09:55.728598 23287 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:55.770660 23292 ts_tablet_manager.cc:1403] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.219s	user 0.024s	sys 0.012s
I20260709 12:09:55.773659 23292 raft_consensus.cc:359] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:55.779026 23292 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:55.779824 23292 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:55.784303 23292 ts_tablet_manager.cc:1434] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 12:09:55.783026 23297 tablet_bootstrap.cc:492] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.787153 23297 tablet_bootstrap.cc:492] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:55.778913 21749 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 2 to 3, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 3 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.792579 23297 ts_tablet_manager.cc:1403] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.236s	user 0.020s	sys 0.019s
I20260709 12:09:55.804154 23297 raft_consensus.cc:359] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:55.805105 23297 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:55.806267 23297 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:55.807943 23332 tablet_copy_client.cc:806] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.808482 23297 ts_tablet_manager.cc:1434] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:55.791553 23317 tablet_bootstrap.cc:492] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.808583 23332 tablet_copy_client.cc:670] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.809690 23317 tablet_bootstrap.cc:492] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:55.810611 23317 ts_tablet_manager.cc:1403] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.243s	user 0.051s	sys 0.030s
I20260709 12:09:55.810527 22011 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-f127c5582f284fbd97aa877ecdd4d4f4 received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:55.811471 22011 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-f127c5582f284fbd97aa877ecdd4d4f4 on tablet f127c5582f284fbd97aa877ecdd4d4f4 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:55.812446 22010 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-fbfd595fdbf3470193f7cd91b4969857 received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:55.812844 22010 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-fbfd595fdbf3470193f7cd91b4969857 on tablet fbfd595fdbf3470193f7cd91b4969857 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:55.815713 23332 tablet_copy_client.cc:538] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.817813 23317 raft_consensus.cc:359] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:55.818724 23317 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:55.819414 23317 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:55.828469 23332 tablet_bootstrap.cc:492] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:55.831885 23317 ts_tablet_manager.cc:1434] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:09:55.841915 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-68b43b3517064c3b81e50b88c21938ce received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:55.842402 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-68b43b3517064c3b81e50b88c21938ce on tablet 68b43b3517064c3b81e50b88c21938ce with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:55.833995 22583 raft_consensus.cc:1217] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:55.869331 23303 raft_consensus.cc:993] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:55.870347 23303 raft_consensus.cc:1081] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:55.880606 23332 tablet_bootstrap.cc:492] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.881558 23332 tablet_bootstrap.cc:492] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:55.882275 23332 ts_tablet_manager.cc:1403] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.005s
I20260709 12:09:55.885257 23332 raft_consensus.cc:359] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:55.886077 23332 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:55.886751 23332 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:55.889549 23332 ts_tablet_manager.cc:1434] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:55.891223 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-dae741cd77e441b281f9ed48a672f87d received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:55.891759 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-dae741cd77e441b281f9ed48a672f87d on tablet dae741cd77e441b281f9ed48a672f87d with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:55.896224 21927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60628
W20260709 12:09:55.944387 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46036.2us
I20260709 12:09:55.896744 21927 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.947314 21927 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.953704 21927 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:55.962863 21927 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:09:55.965595 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:09:55.966163 22583 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.974299 22583 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:09:55.979173 21893 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:55.981127 22583 raft_consensus.cc:1217] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:55.984548 23326 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:55.985129 23326 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:55.986004 23326 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:56.006042 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:56.006704 21850 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:56.007000 21850 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:56.007773 21850 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:56.008841 21850 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.013278 22584 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:56.022398 21850 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:09:56.024462 21850 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:56.026147 21747 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 3, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.035172 23241 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:09:56.071872 21927 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:56.080827 23286 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.090744 21993 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:56.092619 23327 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.097522 22584 raft_consensus.cc:1217] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:56.104285 22584 raft_consensus.cc:1217] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:56.142072 21993 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:56.143636 23286 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.183048 21927 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:56.186699 23288 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.202082 21844 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:56.203553 23272 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.229367 23272 raft_consensus.cc:1064] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:56.252697 23272 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:56.278175 22583 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.280737 21922 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.286361 23287 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.289543 23218 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.322535 23218 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:56.323648 22583 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:56.346838 21844 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.348503 23288 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.349989 21749 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:56.383893 21923 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:56.391839 21844 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:56.440754 23288 raft_consensus.cc:1064] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:56.443387 23288 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:56.451063 22583 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.452445 23272 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.511382 21927 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.515295 21847 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.526813 23273 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.557809 22584 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:56.567126 23273 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.581131 23303 raft_consensus.cc:1064] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:56.582682 23241 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:56.587092 23303 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:56.641876 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.645874 21847 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:56.654008 23326 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:56.713415 22580 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.759167 23285 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 12:09:56.780335 23360 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:09:56.786816 21993 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.811797 23286 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.812650 23318 raft_consensus.cc:1064] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:09:56.818246 23318 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:56.880385 21927 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.889139 21923 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.910562 23218 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:56.912755 21994 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.920002 21844 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:56.931855 23303 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.939316 21921 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:56.941871 22582 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.960775 23365 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.961107 23286 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.966238 23286 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.993984 21993 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:57.009066 23303 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.012117 21994 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.017129 21844 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.026826 22584 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.031479 23287 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:09:57.036228 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 57358.3us
I20260709 12:09:57.036300 23273 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:57.044610 22582 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.044505 23358 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.033798 21747 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.063266 22584 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.063838 22583 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.068671 23272 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:09:57.110255 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 67671.7us
I20260709 12:09:57.120368 21750 catalog_manager.cc:5697] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.165828 22000 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.174765 21852 raft_consensus.cc:2955] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.191110 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fbfd595fdbf3470193f7cd91b4969857 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:57.196225 22584 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.265187 21922 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.277822 21918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:57.278854 21918 raft_consensus.cc:606] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:57.277766 21921 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.290766 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:57.291350 22000 raft_consensus.cc:606] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:57.295455 21844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:57.296482 21844 raft_consensus.cc:606] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:57.299778 22000 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:57.302670 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:57.304440 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:57.305467 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:57.308631 22584 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.310563 23218 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.320402 21749 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 2 to 3, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.322548 21749 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 4 to 5, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.335948 23364 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.346827 22584 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.354983 21844 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:57.360670 21993 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:57.361784 22582 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:57.362376 23379 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:57.363457 23374 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:57.367606 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet fbfd595fdbf3470193f7cd91b4969857 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:57.367817 21844 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:57.373730 23374 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.382810 21993 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.385838 22582 raft_consensus.cc:2955] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.399040 21921 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.402766 23218 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.407184 21921 raft_consensus.cc:2955] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.411899 22583 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:57.419275 23286 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:57.423657 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dae741cd77e441b281f9ed48a672f87d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:57.427421 23385 tablet_replica.cc:333] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:57.427556 21750 catalog_manager.cc:5697] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 3 to 4, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.428701 23385 raft_consensus.cc:2243] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:57.429491 23385 raft_consensus.cc:2272] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:57.432698 21922 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:57.435175 23285 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:57.447664 23385 ts_tablet_manager.cc:1916] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:57.452435 21749 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 4 to 5, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.454401 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet dae741cd77e441b281f9ed48a672f87d with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60614
I20260709 12:09:57.455183 23285 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.459824 21921 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.466596 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68b43b3517064c3b81e50b88c21938ce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:57.468251 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f127c5582f284fbd97aa877ecdd4d4f4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:57.485486 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet f127c5582f284fbd97aa877ecdd4d4f4 with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:56590
I20260709 12:09:57.502200 22583 raft_consensus.cc:2955] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:09:57.508940 23385 ts_tablet_manager.cc:1929] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:57.525125 23385 log.cc:1199] T fbfd595fdbf3470193f7cd91b4969857 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/fbfd595fdbf3470193f7cd91b4969857
I20260709 12:09:57.526858 23385 tablet_replica.cc:333] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:09:57.527607 23385 raft_consensus.cc:2243] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:57.527616 21749 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 3 to 4, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 1 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.531692 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet fbfd595fdbf3470193f7cd91b4969857 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:57.539444 23386 tablet_replica.cc:333] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:09:57.541245 23386 raft_consensus.cc:2243] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:57.542069 23386 raft_consensus.cc:2272] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:57.528486 23385 raft_consensus.cc:2272] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:57.548400 23385 ts_tablet_manager.cc:1916] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:57.557263 23386 ts_tablet_manager.cc:1916] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:57.560628 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet 68b43b3517064c3b81e50b88c21938ce with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35504
I20260709 12:09:57.582504 23385 ts_tablet_manager.cc:1929] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:57.583089 23385 log.cc:1199] T dae741cd77e441b281f9ed48a672f87d P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/dae741cd77e441b281f9ed48a672f87d
I20260709 12:09:57.584872 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet dae741cd77e441b281f9ed48a672f87d (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:57.598188 23386 ts_tablet_manager.cc:1929] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:57.598724 23386 log.cc:1199] T f127c5582f284fbd97aa877ecdd4d4f4 P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/f127c5582f284fbd97aa877ecdd4d4f4
I20260709 12:09:57.600531 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet f127c5582f284fbd97aa877ecdd4d4f4 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:57.601951 23387 tablet_replica.cc:333] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:09:57.602900 23387 raft_consensus.cc:2243] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:57.603649 23387 raft_consensus.cc:2272] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:57.606722 23387 ts_tablet_manager.cc:1916] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:57.623782 23387 ts_tablet_manager.cc:1929] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:57.624212 23387 log.cc:1199] T 68b43b3517064c3b81e50b88c21938ce P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/68b43b3517064c3b81e50b88c21938ce
I20260709 12:09:57.625875 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 68b43b3517064c3b81e50b88c21938ce (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:09:57.656109 23283 raft_consensus.cc:993] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:57.656643 23283 raft_consensus.cc:1081] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:57.658461 21852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56594
I20260709 12:09:57.659037 21852 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.659343 21852 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.666913 21852 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:57.668601 21852 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:57.669863 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:57.669704 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:57.670384 21921 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.670492 21993 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.670778 21921 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:57.671593 21921 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:57.672796 21921 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.677568 21993 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:09:57.679042 21817 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:09:57.679795 23285 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.680286 23285 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:57.681182 23285 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:57.683053 21921 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:09:57.701713 21749 catalog_manager.cc:5697] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.861186 23272 raft_consensus.cc:993] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:57.861688 23364 raft_consensus.cc:1081] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:09:57.863018 21844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:09:57.863511 21844 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.863777 21844 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.870566 21844 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:57.873659 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:57.874169 21921 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.875910 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:57.876513 21993 raft_consensus.cc:3055] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:57.876798 21993 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:57.877548 21993 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:57.878654 21993 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.880550 21921 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:09:57.881819 21815 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:57.882611 23285 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.883095 23285 raft_consensus.cc:697] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:57.883926 23285 consensus_queue.cc:237] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:57.889542 21993 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:09:57.895713 23285 raft_consensus.cc:993] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:57.896158 23285 raft_consensus.cc:1081] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:57.897687 21993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:57.898236 21993 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.898618 21993 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.902643 21749 catalog_manager.cc:5697] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.905776 21993 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:57.908263 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:57.908761 21852 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.909034 21852 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:57.909431 21993 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:09:57.910701 21844 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:57.909796 21852 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:57.914677 21852 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.934396 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:09:57.935045 22584 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.940079 22584 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:57.941226 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:09:57.941991 23272 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.941954 21852 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:57.942643 23272 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:57.943572 23272 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:57.965464 21749 catalog_manager.cc:5697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.091553 21921 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:58.092733 23286 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.111706 21993 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:58.123329 23374 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.335891 21844 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:58.337126 23272 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:58.347148 22583 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:58.358721 23397 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:58.469424 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.472519 22000 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:58.477607 23286 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.497927 21921 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:58.505174 23374 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.622768 21918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:58.623389 21918 raft_consensus.cc:606] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:58.626082 21844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5937d593814d4b568742fc86c954922d"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:58.626783 21844 raft_consensus.cc:606] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:09:58.629485 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:58.629992 22000 raft_consensus.cc:606] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:09:58.632714 21844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d28906331f4545a29562f950eacb999e"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:09:58.633165 21844 raft_consensus.cc:606] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:58.634171 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:58.635851 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:58.636656 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.681736 22000 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:09:58.692881 21967 consensus_peers.cc:597] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 265f2ffa166449ee9bfd498dacfcc48f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:58.694334 21918 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:58.694885 21844 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:58.696228 23364 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.697216 23272 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.718375 23364 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:58.729354 21852 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:58.735064 21922 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:58.753278 21747 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 2, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 1 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.749383 22000 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:58.769263 23374 raft_consensus.cc:993] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:58.770072 23379 raft_consensus.cc:1081] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:09:58.775903 22583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d28906331f4545a29562f950eacb999e"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:33654
I20260709 12:09:58.776782 22583 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.783324 22583 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.791715 21918 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:58.792563 21852 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:58.794513 23272 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:58.795782 21967 consensus_peers.cc:597] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 279111025ee54aba83c27bba63339332. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:58.796869 23272 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.816303 23397 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:58.822669 21844 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:09:58.845405 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 50937.4us
I20260709 12:09:58.844014 22583 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:58.849314 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:58.849913 21918 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.849717 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:58.850579 21850 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.850953 21850 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:58.852025 21850 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:58.853451 21850 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.862787 21922 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:58.877853 21918 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:58.882831 22547 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:58.880692 22583 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:58.883723 23401 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.884270 23401 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:09:58.885138 23401 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:09:58.892812 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 51531.8us
I20260709 12:09:58.901266 21850 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:09:58.919054 21844 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:58.924794 21748 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:58.933086 21747 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:58.965512 21818 consensus_peers.cc:597] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d50c36e857cb4e33997aee7e5dd39447. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:58.982347 21993 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:58.982743 21922 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:58.983970 23379 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.987761 23286 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.990001 23286 raft_consensus.cc:993] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:58.990377 23286 raft_consensus.cc:1081] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:58.997610 23286 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:58.998850 21993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5937d593814d4b568742fc86c954922d"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:09:58.999410 21993 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.999740 21993 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.003962 21921 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:59.013209 23370 raft_consensus.cc:993] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:59.013741 23370 raft_consensus.cc:1081] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:59.012507 21993 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:59.016220 21999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35522
I20260709 12:09:59.016790 21999 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:59.017134 21999 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.019066 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:59.019690 21922 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.022989 21993 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:59.030253 21922 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:59.032562 21748 catalog_manager.cc:5697] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:59.033898 21964 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:59.034881 23410 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.035456 23410 raft_consensus.cc:697] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:59.036626 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:59.037271 21852 raft_consensus.cc:3055] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.037580 21852 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:09:59.038385 21852 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:59.039763 21852 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.039577 23410 consensus_queue.cc:237] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:59.047650 21922 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:59.053431 21852 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:59.056313 21999 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:59.060801 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:59.061384 21921 raft_consensus.cc:3055] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.061707 21921 raft_consensus.cc:740] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:59.068044 21994 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:59.070883 21921 consensus_queue.cc:260] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:59.072399 21921 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:59.093801 21893 consensus_peers.cc:597] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1238ec38c933498cadf6153a5554f6e0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:59.094403 21852 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:59.095785 23283 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:59.098050 21748 catalog_manager.cc:5697] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.101687 21994 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:59.102988 23283 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:59.105659 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:09:59.106330 22583 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.115401 23283 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:59.122836 21852 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:59.136310 23364 raft_consensus.cc:993] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:59.136915 23364 raft_consensus.cc:1081] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:09:59.139488 21922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:09:59.140086 21922 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:59.140450 21922 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.167269 21999 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:09:59.162014 21922 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:59.169945 21922 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:59.183172 21748 catalog_manager.cc:5697] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index -1 to 4, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:59.188809 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:09:59.200526 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:09:59.201260 21994 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:59.201602 21994 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:59.200920 21852 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.202390 21994 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:59.203584 21994 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.203951 21993 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:09:59.213044 23425 ts_tablet_manager.cc:933] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:59.218468 21921 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:59.222507 21964 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:59.225168 22583 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:09:59.228641 23272 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.229128 23272 raft_consensus.cc:697] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:09:59.229959 23272 consensus_queue.cc:237] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:59.222069 21994 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:09:59.251338 23425 tablet_copy_client.cc:323] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:59.262023 21852 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:09:59.262718 21850 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.265237 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:09:59.266139 23418 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.266692 23418 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:59.267485 23418 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:09:59.279063 22010 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet 265f2ffa166449ee9bfd498dacfcc48f from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:59.279641 22010 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet 265f2ffa166449ee9bfd498dacfcc48f from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-265f2ffa166449ee9bfd498dacfcc48f
I20260709 12:09:59.287878 22010 tablet_copy_source_session.cc:215] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:59.298343 21748 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.301489 23425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265f2ffa166449ee9bfd498dacfcc48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:59.311343 23429 ts_tablet_manager.cc:933] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:09:59.315243 21750 catalog_manager.cc:5697] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.337194 21921 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.338322 23429 tablet_copy_client.cc:323] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:09:59.342990 23401 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.354549 22010 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet 279111025ee54aba83c27bba63339332 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:09:59.355089 22010 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet 279111025ee54aba83c27bba63339332 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-279111025ee54aba83c27bba63339332
I20260709 12:09:59.364929 22010 tablet_copy_source_session.cc:215] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:59.367997 23425 tablet_copy_client.cc:806] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:59.368227 23429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279111025ee54aba83c27bba63339332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:59.376663 23425 tablet_copy_client.cc:670] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:59.391927 21852 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.393044 23425 tablet_copy_client.cc:538] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:59.393393 23401 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.429719 23425 tablet_bootstrap.cc:492] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:59.435194 23429 tablet_copy_client.cc:806] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:59.436926 23429 tablet_copy_client.cc:670] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:59.444113 23429 tablet_copy_client.cc:538] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:59.461025 23429 tablet_bootstrap.cc:492] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:59.473145 23436 ts_tablet_manager.cc:933] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:09:59.535019 21850 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.536968 23364 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.543023 23439 ts_tablet_manager.cc:933] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:09:59.546828 23436 tablet_copy_client.cc:323] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:09:59.549093 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet d50c36e857cb4e33997aee7e5dd39447 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:09:59.549646 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet d50c36e857cb4e33997aee7e5dd39447 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-d50c36e857cb4e33997aee7e5dd39447
I20260709 12:09:59.559202 23425 tablet_bootstrap.cc:492] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:59.562685 21862 tablet_copy_source_session.cc:215] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:59.566440 23436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d50c36e857cb4e33997aee7e5dd39447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:59.568053 23425 tablet_bootstrap.cc:492] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:59.568827 23425 ts_tablet_manager.cc:1403] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.139s	user 0.017s	sys 0.008s
I20260709 12:09:59.599473 23439 tablet_copy_client.cc:323] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:09:59.601373 21937 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 1238ec38c933498cadf6153a5554f6e0 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:09:59.602036 21937 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 1238ec38c933498cadf6153a5554f6e0 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-1238ec38c933498cadf6153a5554f6e0
I20260709 12:09:59.602808 21922 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.604563 23272 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.608497 23436 tablet_copy_client.cc:806] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:59.609055 23436 tablet_copy_client.cc:670] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:59.609872 21937 tablet_copy_source_session.cc:215] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:59.617486 21922 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.618923 23413 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.619572 23425 raft_consensus.cc:359] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:59.620424 23425 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:59.621057 23425 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:59.629315 23425 ts_tablet_manager.cc:1434] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 12:09:59.639911 23436 tablet_copy_client.cc:538] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:59.649274 22010 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-265f2ffa166449ee9bfd498dacfcc48f received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:59.649770 22010 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-265f2ffa166449ee9bfd498dacfcc48f on tablet 265f2ffa166449ee9bfd498dacfcc48f with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:59.650074 23436 tablet_bootstrap.cc:492] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:59.659010 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1238ec38c933498cadf6153a5554f6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:59.672484 22583 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.679279 23413 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.688091 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:59.699328 23429 tablet_bootstrap.cc:492] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:59.700316 23429 tablet_bootstrap.cc:492] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:59.701067 23429 ts_tablet_manager.cc:1403] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.240s	user 0.020s	sys 0.022s
I20260709 12:09:59.704227 23429 raft_consensus.cc:359] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:59.705086 23429 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:59.705699 23429 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:59.708237 23429 ts_tablet_manager.cc:1434] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 12:09:59.717793 23436 tablet_bootstrap.cc:492] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:59.718695 23436 tablet_bootstrap.cc:492] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:59.719331 23436 ts_tablet_manager.cc:1403] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.011s
I20260709 12:09:59.721580 23436 raft_consensus.cc:359] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:59.722204 23436 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:59.722918 23436 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:59.725826 23436 ts_tablet_manager.cc:1434] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.006s
I20260709 12:09:59.734097 22010 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-279111025ee54aba83c27bba63339332 received from {username='slave'} at 127.0.0.1:56824
I20260709 12:09:59.734691 22010 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-279111025ee54aba83c27bba63339332 on tablet 279111025ee54aba83c27bba63339332 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:59.737732 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-d50c36e857cb4e33997aee7e5dd39447 received from {username='slave'} at 127.0.0.1:39640
I20260709 12:09:59.738230 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-d50c36e857cb4e33997aee7e5dd39447 on tablet d50c36e857cb4e33997aee7e5dd39447 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:59.751573 23439 tablet_copy_client.cc:806] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:59.752211 23439 tablet_copy_client.cc:670] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:59.757980 23439 tablet_copy_client.cc:538] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:59.758888 21850 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:59.775075 23448 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:59.779071 23439 tablet_bootstrap.cc:492] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:09:59.808502 22583 raft_consensus.cc:1217] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:59.825879 23439 tablet_bootstrap.cc:492] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:59.835187 23439 tablet_bootstrap.cc:492] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:09:59.835999 23439 ts_tablet_manager.cc:1403] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.000s
I20260709 12:09:59.839046 23439 raft_consensus.cc:359] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:59.840049 23439 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:09:59.840793 23439 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:09:59.843222 23439 ts_tablet_manager.cc:1434] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:59.857965 21918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:09:59.858606 21918 raft_consensus.cc:606] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
W20260709 12:09:59.867136 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 92450.4us
I20260709 12:09:59.869324 21993 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:59.872284 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:59.872920 21994 raft_consensus.cc:606] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:59.882941 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:09:59.883538 21994 raft_consensus.cc:606] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:09:59.886299 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:59.887151 21937 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-1238ec38c933498cadf6153a5554f6e0 received from {username='slave'} at 127.0.0.1:46426
I20260709 12:09:59.887625 21937 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-1238ec38c933498cadf6153a5554f6e0 on tablet 1238ec38c933498cadf6153a5554f6e0 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:09:59.887935 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:59.888885 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:59.889355 23283 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:59.902324 22583 raft_consensus.cc:1217] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:59.933746 23449 raft_consensus.cc:993] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:59.934257 23449 raft_consensus.cc:1081] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:09:59.936827 21999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35522
I20260709 12:09:59.937364 21999 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:59.937737 21999 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.945751 21999 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:59.956825 22583 raft_consensus.cc:1217] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:09:59.975162 22582 raft_consensus.cc:1217] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:59.994503 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:09:59.995090 21922 raft_consensus.cc:3055] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.995426 21922 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:09:59.996194 21922 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:09:59.997282 21922 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:00.005146 23453 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:10:00.007907 21922 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:00.009124 21964 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:00.010241 21999 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:00.015643 23364 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.016149 23364 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:00.016938 23364 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:00.019652 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:00.020236 22583 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.025182 22583 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:00.044320 21749 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:00.139581 23413 raft_consensus.cc:993] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:10:00.140051 23413 raft_consensus.cc:1081] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:10:00.153249 21847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:10:00.153983 21847 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.154381 21847 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.161985 21847 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:00.165758 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:00.166286 21922 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.171322 21847 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:00.173470 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:00.173995 21994 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.174258 21994 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:00.178345 21994 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:00.180131 21994 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.185454 21922 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:00.187383 21815 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:00.188783 23286 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.189276 23286 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:00.190111 23286 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:00.207160 21994 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:00.216930 21749 catalog_manager.cc:5697] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:00.224852 23410 raft_consensus.cc:993] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:10:00.225400 23410 raft_consensus.cc:1081] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:10:00.227020 21852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:10:00.227536 21852 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.227876 21852 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.240207 21852 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:00.243235 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:00.243979 21921 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.244793 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:00.245386 21994 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.245684 21994 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:00.246529 21852 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:00.247321 21994 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:00.248867 21994 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.250811 21921 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:00.252198 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:00.253410 23286 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.254099 23286 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:00.255165 23286 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:00.262861 21994 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:00.279525 21749 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:00.292963 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56590
I20260709 12:10:00.293442 21852 raft_consensus.cc:606] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:10:00.296677 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56590
I20260709 12:10:00.297086 21852 raft_consensus.cc:606] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Received request to transfer leadership
W20260709 12:10:00.298121 21736 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 265f2ffa166449ee9bfd498dacfcc48f already in progress [suppressed 2 similar messages]
I20260709 12:10:00.298713 23364 raft_consensus.cc:1064] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:10:00.301080 23364 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:00.304118 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56590
I20260709 12:10:00.305323 21852 raft_consensus.cc:606] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Received request to transfer leadership
W20260709 12:10:00.310374 21798 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:10:00.310823 21798 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 265f2ffa166449ee9bfd498dacfcc48f already in progress
W20260709 12:10:00.311092 21798 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 265f2ffa166449ee9bfd498dacfcc48f already in progress
I20260709 12:10:00.328629 22583 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.330009 21921 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.330365 21852 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.330243 23413 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:00.336898 23364 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:00.337724 23410 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:00.366319 23364 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:00.379308 22582 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:00.388545 21852 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:00.391844 21922 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:00.393983 21749 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.413887 21999 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:00.482684 23283 raft_consensus.cc:1064] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:10:00.484826 23283 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:00.500396 22584 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.502045 23397 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.507424 21847 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.512998 22583 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.531839 23410 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.599169 23413 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.602553 22584 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:00.606536 23449 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.630151 21922 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.640349 23467 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:00.646235 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46618us
I20260709 12:10:00.708851 21922 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.608605 23379 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:01.609359 23379 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:01.613585 23379 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:01.661988 23379 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:01.682296 23379 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:10:01.886754 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800315c60 after lost signal to thread 20708
W20260709 12:10:01.888173 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080032a360 after lost signal to thread 21784
I20260709 12:10:01.978714 23482 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:01.979622 23482 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:02.013796 20710 debug-util.cc:398] Leaking SignalData structure 0x7b080000f5c0 after lost signal to thread 22548
W20260709 12:10:02.014497 20710 kernel_stack_watchdog.cc:198] Thread 22548 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 291ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:10:02.036796 23482 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.037727 23482 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.038486 23482 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.053275 23482 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.089294 23482 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.078543 23468 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.090320 23468 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.057569 23379 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.093473 23379 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.094025 23379 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.098565 23379 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.099160 23379 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.099700 23379 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.091082 23482 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:02.102830 22548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.381s	user 0.028s	sys 0.032s
I20260709 12:10:02.102984 23484 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:02.103344 22548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.029s	sys 0.032s
I20260709 12:10:02.104384 23481 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.104990 23482 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.134816 23482 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.135433 23482 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.138473 23482 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.139325 23482 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.140041 23482 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.144526 23482 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.148610 23482 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.109923 23450 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.163378 23450 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.165803 23450 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.166314 23450 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.166999 23450 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.169126 23450 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.169661 23450 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.170239 23450 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.174062 23450 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.114610 23480 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.096167 23468 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.107072 23379 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.144930 23454 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.175499 23454 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.147555 23283 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.148654 23413 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.178798 23283 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.179366 23413 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.180848 23283 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.181350 23283 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.181495 23413 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.182053 23413 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.181800 23283 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.151757 23410 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.152801 23489 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.184891 23489 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.187733 23489 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.188587 23489 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.189263 23489 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.190793 23482 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.145879 23481 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.133919 23484 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.108584 23483 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.196633 23481 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.112063 23485 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.196417 23483 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.197347 23485 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.199554 23485 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.184811 23410 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:02.202255 23410 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.202309 23484 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.202841 23410 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.203363 23410 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.205281 23410 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.155303 23490 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.187819 23283 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.191809 23489 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.159096 23486 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.205989 23490 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.206612 23486 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.208302 23490 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.183487 23480 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.209012 23486 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.182847 23454 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.211045 23480 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.199632 23483 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.347476 23483 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.348133 23483 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.351403 23483 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.352073 23483 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.352388 23454 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.352759 23483 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.353019 23454 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.355299 23454 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.355813 23454 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.212117 23482 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.214112 23410 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.356340 23454 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.356678 23410 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.214438 23490 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.214316 23489 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.218847 23283 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.362982 23283 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.219040 23450 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.216686 23364 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.215139 23413 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.228734 23492 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.231099 23498 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.232124 23397 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:02.234390 23494 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.237433 23286 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.238180 23485 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.239727 23481 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.240867 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:02.394236 23286 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.241420 23379 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.246479 23468 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.248034 23467 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.268119 23449 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.278707 23491 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:02.283562 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800114ee0 after lost signal to thread 21876
I20260709 12:10:02.384313 23486 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.292975 23501 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.293871 22582 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 LEARNER]: Advancing to term 2
I20260709 12:10:02.300391 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.309449 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.311434 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.317709 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.318851 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.321831 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.323303 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.325278 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.325716 21749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58738 (request call id 280) took 1625 ms. Trace:
I20260709 12:10:02.328362 23505 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.331785 23374 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.525079 23374 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.358541 23454 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.384923 23466 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.464277 23379 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.535491 23502 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.385561 23495 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.386240 23497 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.329295 23487 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.390487 23364 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.542027 23364 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.355959 23483 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:02.392586 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 43998.6us
I20260709 12:10:02.386291 23506 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.401161 23283 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.395498 23489 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:02.465545 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080031f7e0 after lost signal to thread 21951
I20260709 12:10:02.519972 23482 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.404723 23286 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.404011 23481 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.484156 23488 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.484730 23507 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.485260 23496 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.390242 23493 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.491245 23486 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.493818 23511 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.488570 22583 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:02.530983 23517 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.532539 23374 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.391695 23450 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.386914 23490 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.486727 23504 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.542659 23503 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.396564 23492 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.539752 22577 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:02.547580 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.547638 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.510891 23480 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.494866 23449 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:02.465103 23468 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.403825 23485 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:02.559091 21873 debug-util.cc:398] Leaking SignalData structure 0x7b08000fc100 after lost signal to thread 22025
I20260709 12:10:02.291874 21850 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:02.617942 21873 debug-util.cc:398] Leaking SignalData structure 0x7b08002af160 after lost signal to thread 22026
I20260709 12:10:02.560547 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.514094 22581 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:02.535830 23466 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.463855 23498 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.574343 23283 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.543700 23410 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.548241 23454 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.515865 23491 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.540069 23508 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.549477 23484 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.514634 21749 rpcz_store.cc:276] 0709 12:10:00.700012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.714397 (+ 14385us) service_pool.cc:224] Handling call
0709 12:10:02.261448 (+1547051us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540041e1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d05090 00007f3be4da3f3a 00007f3beab59e9c 00007f3beac5804e 00007f3be91192a4 00007f3be9119232 00007f3be9119161 00007f3be91190dc 00007f3be9118392 00007f3be30d648c 00007f3be30d58c6
0709 12:10:02.325624 (+ 64176us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":658814208}
I20260709 12:10:02.587644 23520 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.488229 23467 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.536159 23502 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.594283 22582 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.556892 23497 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.558904 23487 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.543102 23513 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.638614 23364 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.639135 23364 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:02.494284 23494 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.610745 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.593317 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.614279 23286 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:02.619930 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080035eb80 after lost signal to thread 22608
W20260709 12:10:02.641702 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080031e6e0 after lost signal to thread 23444
I20260709 12:10:02.641548 23286 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.621419 21999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:10:02.588207 23488 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.623952 23512 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.624163 23500 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.566995 23495 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.665802 23512 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.665918 23500 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.625505 23450 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.626011 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.668107 23495 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.614555 23379 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.626871 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.626668 23283 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.668677 23495 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.628319 21921 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.626258 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.669175 23495 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.669862 21848 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
I20260709 12:10:02.670087 23283 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.607225 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.594722 23482 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.573982 23506 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:02.642663 21999 raft_consensus.cc:606] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:02.625516 23486 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.645855 23364 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.594956 23507 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.664462 23286 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.607098 23493 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.645227 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.672767 23506 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.672712 22582 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:02.673921 23493 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.674208 23495 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.676447 23364 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.665344 23522 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.668196 23500 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.642652 21844 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:02.676998 23364 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.672036 23482 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.662940 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.550558 23505 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.614982 23504 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.689325 23466 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.638427 23397 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.642123 23413 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.522984 23501 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.642279 23410 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.623374 23480 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.694690 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.679028 23495 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.700438 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.702495 23507 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.703467 23364 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.703415 23487 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.635398 23484 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.633746 23454 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.708967 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.616384 23503 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.714495 21852 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
I20260709 12:10:02.596454 23496 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.700711 23493 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.689975 23515 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.705099 23497 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.705530 23500 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.607723 23517 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.707342 23495 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.760473 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.699545 23397 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.705101 23488 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.614643 23511 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:02.814102 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.705947 23410 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.716327 23481 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.840155 23491 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.707774 23522 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.724390 23493 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.677711 23520 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.851083 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.849159 23522 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.847734 23490 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.850292 23449 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.850481 23468 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.643989 23508 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.683751 23513 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.843649 23454 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.813283 21818 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:02.820523 22578 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:02.818802 23500 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:02.864097 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 50595us
I20260709 12:10:02.833884 23519 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.868396 23397 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.869621 23504 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.871978 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.883178 21922 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:02.859537 23467 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.855173 23498 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.846051 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.881158 21818 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:02.852743 23485 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.859180 23514 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.886861 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.891649 23494 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.900231 23524 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:02.904873 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.905596 23364 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.866632 23511 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.884184 23491 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:02.928704 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.934301 23364 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.908324 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.882519 23489 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.921969 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.907032 21922 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:02.920696 22584 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:02.935180 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.937140 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.938856 21844 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:02.820308 23515 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.922959 23286 raft_consensus.cc:1064] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:10:02.938351 22580 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:02.942068 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.906435 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.906670 23467 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.980230 23286 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:02.982292 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:02.910121 23397 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.904726 23492 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.904841 23505 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:02.906507 23522 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.987653 23364 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.921455 23507 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.922891 23454 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:02.930945 23493 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.994908 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.985266 23484 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.928707 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:02.937801 23480 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:02.940056 23511 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:02.907078 23519 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:02.933588 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.019308 23508 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.020509 23512 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.022032 23517 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:02.933670 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.025133 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.033273 21919 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:03.025820 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.936358 23524 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:03.023439 23454 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:03.027338 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 463791us
I20260709 12:10:03.027376 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.029829 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.030534 23364 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:03.031050 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.984439 23467 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:03.026470 23525 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:02.985994 23497 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.040691 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:02.997298 23526 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:03.043874 23364 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.050949 21918 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:02.975934 23491 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.047948 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:03.053659 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.031051 23500 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.001101 23397 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:03.057734 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.056061 23502 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.095628 23523 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:03.096222 23523 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.096112 23502 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:03.023593 22579 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:03.109284 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.043720 23524 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.035810 23511 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:03.047988 23467 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.098357 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.017194 23507 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:03.055773 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:03.122977 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 67286us
I20260709 12:10:03.123131 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.045186 21849 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:03.007753 23522 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.120560 23364 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.116788 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.139681 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.094430 21918 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:03.143052 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.054380 23413 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:03.148459 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.117080 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.123631 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:03.149542 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.043061 23496 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.153198 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.149072 21920 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
I20260709 12:10:03.154922 22547 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:03.122038 23495 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.163664 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.054375 23497 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:03.054744 21851 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:03.165815 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.101518 23503 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.174556 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.175201 21848 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:02.928663 23514 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:03.143208 23489 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.165551 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.169833 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.170096 23499 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.170297 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.170554 23530 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:03.170977 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.170922 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.171608 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.171934 23522 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:03.172806 22547 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.177033 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.200990 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.143028 21845 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:03.151063 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.210279 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.205082 21921 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:03.178385 21852 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:03.179442 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.180073 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.182703 21992 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:03.143152 23501 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.187851 21927 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:03.196717 23523 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.178481 21997 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:03.219715 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.148057 23500 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:03.210917 21994 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:03.174757 23496 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.178207 23489 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:03.220201 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 172850us
I20260709 12:10:03.117873 23526 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:03.166481 23413 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.225898 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:03.094064 23525 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.197824 23499 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.203390 23530 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:03.207171 23519 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:03.214062 23517 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.237666 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.218586 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.221184 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.243638 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.230487 23489 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.247764 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.209185 21998 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:03.267144 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.267750 22582 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:03.268662 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.269645 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.270730 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.271349 21845 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:03.271934 21818 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:03.272331 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.272954 21848 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:03.274290 23480 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.274741 23480 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:03.275090 23480 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.277717 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.278627 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.230882 23466 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.239877 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.279673 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.253998 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.254556 22576 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:03.255923 23454 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:03.257627 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.281862 22581 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:03.257881 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.282723 21997 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:03.259594 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.286007 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.290467 23513 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:03.221144 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.294550 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:03.294699 21995 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:03.296355 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.297345 23497 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:03.299223 23397 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.299401 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.300284 23468 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.300359 23507 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.300753 23468 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.301144 23468 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.301909 21818 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:03.251300 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.235491 23520 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:03.239097 23499 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.231518 23481 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:03.278756 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.260933 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.318114 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:03.318877 21852 raft_consensus.cc:606] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:03.301206 23515 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.305002 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.306118 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.314848 22547 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:03.325511 23482 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.329396 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.329999 23466 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.333093 23491 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.315779 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:03.337371 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:03.290324 23480 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:03.340092 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 63473.6us
I20260709 12:10:03.344640 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.244385 23517 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.241659 23530 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.252753 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.348299 23482 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.356434 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.370273 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:03.358603 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.369822 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.360960 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.356802 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.365103 23502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35504 (request call id 81) took 2950 ms. Trace:
I20260709 12:10:03.365521 23485 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.365464 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.354733 23514 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:03.366988 23410 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.367731 23517 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.259641 23413 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.369596 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.370958 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:03.360208 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 44501.4us
I20260709 12:10:03.373201 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.374193 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.380016 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:03.381352 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 151997us
I20260709 12:10:03.375137 23525 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:03.349099 21843 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:03.382637 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.416025 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.384627 21818 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:03.375406 23482 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.419771 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.371703 23488 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.368383 23492 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.379321 23500 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.422883 23500 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.423291 23500 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.375638 23454 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.426514 21993 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:03.427505 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.380653 23498 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.420589 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.423638 23467 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.380815 23485 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.455258 23494 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.586073 23494 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:03.586573 23494 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.459493 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:03.588119 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 160679us
I20260709 12:10:03.508069 21997 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:03.479079 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.565002 21893 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:03.385231 21919 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:03.516500 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.591926 23480 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.595261 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:03.595372 23520 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.379382 23502 rpcz_store.cc:276] 0709 12:10:00.411612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.411734 (+   122us) service_pool.cc:224] Handling call
0709 12:10:00.416312 (+  4578us) log.cc:844] Serialized 494 byte log entry
0709 12:10:03.357219 (+2940907us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":814,"raft.run_cpu_time_us":934,"raft.run_wall_time_us":934,"spinlock_wait_cycles":1486720}
I20260709 12:10:03.428757 23454 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.613453 23454 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.597281 21893 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.597422 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.598474 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.600991 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:03.424686 23519 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.616233 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:03.489147 23511 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.623471 21893 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.592758 23485 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.624487 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.580228 23526 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.595295 23514 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.646564 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.649047 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:03.627183 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 206717us
I20260709 12:10:03.616415 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.653823 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.598476 23524 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.656682 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.658381 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.626134 23519 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:03.625769 23513 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.672124 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.648828 23520 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.661352 22579 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:03.661868 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.645504 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.627282 23510 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.664019 23488 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.624935 23468 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.664686 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.665680 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:03.666908 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.644356 23466 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.660718 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.704566 23520 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.703653 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:03.709014 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 60036.1us
I20260709 12:10:03.660147 23538 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.672418 23497 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:03.671424 23519 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:03.722515 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 77617.1us
I20260709 12:10:03.710352 23510 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.671991 23513 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.645865 23514 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.731603 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.740036 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.718263 23533 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:03.715670 21995 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:03.734815 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:03.743311 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.744091 21994 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:03.745005 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.723470 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.736451 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.715471 23488 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.750140 21846 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.708706 23493 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.730782 23520 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.724368 23466 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.741005 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.758692 21992 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
I20260709 12:10:03.754819 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.758062 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.759815 21999 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:03.708599 23500 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:03.731319 23497 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.753050 23493 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.728616 23538 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.728181 21849 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:03.751314 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.769443 21850 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:03.758059 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.759508 21844 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:03.755621 23489 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.738390 23510 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.771214 22580 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.765244 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.745406 23514 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.772320 23489 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:03.743043 23513 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.778475 23510 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:03.779218 23514 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:03.781080 23510 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:03.750986 23533 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.754828 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.792264 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.790095 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.761967 23466 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.769131 23497 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.768838 23493 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.768638 23538 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.799079 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.799122 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:03.803083 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:03.802089 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.801349 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.808406 23510 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.809391 23510 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.813095 23510 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.817625 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.819029 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.819499 22584 raft_consensus.cc:1813] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Handling vote request from an unknown peer ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:03.819926 22584 raft_consensus.cc:2410] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:03.820549 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.822778 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.793627 23533 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:03.834616 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 84249.8us
I20260709 12:10:03.837927 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:03.800912 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:03.762846 23542 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.838404 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.792948 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.841310 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:03.846210 22000 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:03.790778 23543 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.849054 23543 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.848482 22577 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:03.849561 23543 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.853282 23543 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.861928 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:03.876506 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:03.832367 23498 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:03.858922 23510 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.858747 23501 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.840822 23542 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.797714 23530 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.844352 23467 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.865856 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:03.873827 23540 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.946996 23286 raft_consensus.cc:1064] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:10:03.947149 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:03.889781 23508 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:10:03.921459 23494 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.956714 21918 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.948868 23546 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:03.959343 23494 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:03.889627 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:03.947453 23286 raft_consensus.cc:1068] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Unable to promote non-voter ac07267c8cab47d4b59dc27d6fe9a386: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:03.915535 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:03.915530 23510 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.973390 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:03.915947 23542 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.974649 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:03.915779 23501 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:03.858251 23549 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:10:03.891479 23498 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:03.949458 23540 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:03.988765 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:03.999984 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 158727us
I20260709 12:10:03.978106 23510 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:04.004541 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 340026us
I20260709 12:10:04.014143 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:04.002106 23540 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.981019 23501 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.016243 21815 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:04.027720 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:03.960052 23494 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:04.040776 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.029595 23537 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.030781 23500 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.045398 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:04.051286 21815 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:04.065348 23501 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.053328 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:04.093803 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:04.094901 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.045178 23514 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.097056 22001 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.046135 23481 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:04.113359 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 109815us
I20260709 12:10:04.033408 23513 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.073215 23480 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.072501 23379 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.075213 23501 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:04.092962 23490 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.046284 23554 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.107764 21998 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.049019 23537 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:04.141947 21920 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:04.142086 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 68437us
I20260709 12:10:04.108011 23555 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.151888 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.125252 23379 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:04.139014 23490 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:04.119817 23480 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:04.157644 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:04.143992 22549 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.146097 23537 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.162787 22549 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.115651 23557 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:04.158398 23379 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.167316 23492 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.224787 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.225669 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.160084 23490 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.161409 23480 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.161909 23530 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:04.150125 23555 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:10:04.252086 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.224807 23512 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.165191 23500 consensus_queue.cc:1059] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:10:04.282449 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.283069 22001 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
W20260709 12:10:04.269058 23517 consensus_meta.cc:287] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.844s	user 0.008s	sys 0.004s
I20260709 12:10:04.231484 23489 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:10:04.280673 23499 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.931s	user 0.007s	sys 0.006s
W20260709 12:10:04.280380 23488 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.001s
W20260709 12:10:04.282137 23562 log.cc:927] Time spent T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:10:04.281283 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:04.246711 23557 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:04.354507 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.356077 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.286367 23498 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:04.354943 23513 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:04.376495 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 141854us
W20260709 12:10:04.364404 23482 consensus_meta.cc:287] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.002s
I20260709 12:10:04.328598 23543 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.384572 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.377720 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.351152 23488 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.388149 23488 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.390946 23490 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.391577 23542 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.393306 23490 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.393970 23542 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.394495 23557 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:04.395908 23485 consensus_meta.cc:287] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.001s
I20260709 12:10:04.396435 23485 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:04.397657 23520 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.641s	user 0.008s	sys 0.000s
I20260709 12:10:04.398051 23480 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.331254 23517 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:04.399739 23493 consensus_meta.cc:287] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.001s
I20260709 12:10:04.400110 23493 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.401635 23517 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.402077 23493 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.339624 23499 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.404093 23540 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.405705 23480 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.405874 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.407912 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.408882 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.409806 21843 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:04.410544 23555 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.412225 21844 raft_consensus.cc:1813] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Handling vote request from an unknown peer ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.412896 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.412532 23482 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.416601 23492 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:04.429112 21844 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:04.423333 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.432737 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.423540 22577 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:04.432109 23497 consensus_meta.cc:287] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.004s
I20260709 12:10:04.439811 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.398052 23520 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.447252 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.448676 23510 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.435477 23468 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:04.451133 21893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.013s	sys 0.008s
W20260709 12:10:04.451453 21893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.013s	sys 0.008s
W20260709 12:10:04.451725 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 611776us
I20260709 12:10:04.452167 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.453011 22001 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
W20260709 12:10:04.454289 21817 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.029s	sys 0.098s
W20260709 12:10:04.454749 21817 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.029s	sys 0.098s
W20260709 12:10:04.455085 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 628827us
I20260709 12:10:04.442703 23497 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.454392 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.457864 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.614498 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.618017 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.600912 23548 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:04.599969 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:04.595356 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.619004 23548 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.621454 23548 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.476096 23550 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:04.623282 23550 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.625806 23550 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:04.483171 23510 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:04.552379 23454 consensus_meta.cc:287] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.000s
I20260709 12:10:04.642097 23454 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.645535 23454 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.626587 23530 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:04.647472 23530 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:10:04.537904 21964 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.035s	sys 0.037s
W20260709 12:10:04.654626 21964 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.035s	sys 0.041s
W20260709 12:10:04.659641 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 875868us
I20260709 12:10:04.660928 23524 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:04.483412 23468 raft_consensus.cc:993] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:10:04.628511 23497 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.477246 23482 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:04.690864 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.477139 23485 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:04.693534 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.632647 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.636327 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.639348 21817 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.639530 23480 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:04.694885 22000 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:04.627398 21996 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:04.653151 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.654327 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:04.655114 23514 raft_consensus.cc:3055] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.656581 23557 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.477535 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:04.664448 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 499515us
I20260709 12:10:04.736877 22582 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 2: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:10:04.476683 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 109216us
I20260709 12:10:04.665330 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:04.739147 22584 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:04.739185 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 99922.2us
I20260709 12:10:04.666078 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.669590 22583 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.668974 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:04.675091 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:04.681461 21921 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.483347 23572 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:04.759405 22547 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.678308 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.760646 21846 raft_consensus.cc:2393] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:04.686262 23466 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.854s	user 0.004s	sys 0.005s
I20260709 12:10:04.695819 21844 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.475459 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:04.718360 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.720672 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:04.723613 22579 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.598332 23567 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:04.772253 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:04.725925 23519 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.976s	user 0.011s	sys 0.000s
I20260709 12:10:04.726927 23499 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.730278 23379 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.733444 23543 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.713953 23514 raft_consensus.cc:740] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:04.735025 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.734805 23480 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.735558 23468 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.735634 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:04.792248 21923 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:04.733021 23537 consensus_meta.cc:287] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
W20260709 12:10:04.723664 23538 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.890s	user 0.011s	sys 0.000s
I20260709 12:10:04.694344 23546 raft_consensus.cc:1081] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:10:04.766860 21817 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:04.772881 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.765995 23517 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:04.800092 21817 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.800992 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.801620 21846 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.802610 23539 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.803041 23539 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:04.803635 23554 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:04.804049 23554 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:04.804426 23554 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:04.766358 23466 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.784818 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.787221 21892 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:04.788281 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.788945 22581 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:04.789440 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.817042 21817 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.789827 23379 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.766804 23454 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.835547 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:04.790287 23397 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:04.791030 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 119525us
I20260709 12:10:04.807715 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.654362 23530 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.795698 23537 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.798475 21921 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.855249 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.855504 23537 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.774200 23572 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.733106 22578 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:04.859757 23572 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.860342 23520 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:04.860719 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.861972 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.793965 23468 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:04.862617 23468 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.862960 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.863612 23577 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:04.863993 23577 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:04.864223 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.796347 23540 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:04.811691 23485 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:10:04.883790 22583 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.824661 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.864784 23577 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.891830 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.825826 21919 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:04.799208 23538 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.823014 23508 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.809938 23539 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:04.774497 23533 consensus_meta.cc:287] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.911s	user 0.012s	sys 0.000s
I20260709 12:10:04.838053 21844 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:04.870393 23489 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.779567 23567 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.842661 22581 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.845631 23480 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:04.846135 23514 consensus_queue.cc:260] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.847466 23555 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.913230 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.848096 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.848794 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.849581 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.849743 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.850245 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.851034 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.851317 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.851976 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.840462 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:04.760455 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:04.786731 21851 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:04.858023 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:04.863394 23397 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:04.784842 23519 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.783924 22584 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:04.947239 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:04.869542 21922 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:04.869850 21921 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:04.947984 23519 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:04.948326 21850 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.870318 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:04.871189 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 54213.3us
I20260709 12:10:04.950999 21817 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.952363 23480 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.952718 23480 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:04.953056 23480 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.871627 21846 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:04.879143 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.954515 23540 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.955163 21920 raft_consensus.cc:2393] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:04.955067 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.880602 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.956118 21923 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:04.880942 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:04.956310 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:04.956979 21926 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:04.881916 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:04.862571 23454 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.812161 23565 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:10:04.887521 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:04.896711 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.811204 23517 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:04.840462 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.903195 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:04.980301 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 77229.9us
I20260709 12:10:04.982587 22547 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:04.865406 23466 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.870069 23482 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:04.904852 21849 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:04.914058 21844 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:04.989117 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:04.941568 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:04.960198 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 72745.8us
I20260709 12:10:04.962158 21847 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:04.947950 22584 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 2: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:04.963321 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:04.963986 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 176477us
W20260709 12:10:04.970974 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.971560 21848 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:04.973695 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:04.904896 23481 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.976138 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.977157 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.978287 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.960093 22579 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.979306 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.909446 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.950139 23567 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:04.911326 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:04.931722 23577 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.995602 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:04.932897 23543 consensus_queue.cc:1059] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:10:04.994076 21997 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
W20260709 12:10:05.013950 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 129560us
I20260709 12:10:05.014357 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:04.997651 21852 raft_consensus.cc:2393] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:04.983999 21845 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:04.908053 23533 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:04.979423 23565 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.002821 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1362) took 1158 ms. Trace:
I20260709 12:10:05.003693 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.005110 21815 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.021137 21992 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:05.006142 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.003556 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.006910 21848 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:04.986546 23520 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:04.990577 21993 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:04.990188 23490 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.015260 21997 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:05.015271 23466 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:10:05.023442 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.024109 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.042366 21999 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:05.000113 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:05.043404 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.003444 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:05.014364 21843 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:05.020534 21850 rpcz_store.cc:276] 0709 12:10:03.837200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.837296 (+    96us) service_pool.cc:224] Handling call
0709 12:10:03.873811 (+ 36515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.948717 (+1074906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.995550 (+ 46833us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540017e8d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:04.995719 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2470790400}
I20260709 12:10:05.030889 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.036032 21845 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.060832 21993 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:05.061635 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.062367 21993 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:05.062592 21843 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.036721 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.063128 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.063546 22001 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:05.063666 21993 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:05.037411 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.064323 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.038908 21846 raft_consensus.cc:2393] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:05.044203 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.065110 21997 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:05.029388 21995 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:05.003881 23581 consensus_queue.cc:1059] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:05.079831 23581 raft_consensus.cc:3055] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.080188 23581 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:05.080933 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:05.081125 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.045006 23485 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:05.057320 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 63101.3us
I20260709 12:10:05.028084 23537 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.027297 23570 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:05.045732 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 45673.1us
I20260709 12:10:05.065897 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.053537 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.064337 21993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:10:05.071651 21893 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:05.074687 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.074934 23530 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:05.076002 23580 log.cc:927] Time spent T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:05.106544 23583 consensus_queue.cc:1059] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:10:05.133170 23583 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.133523 23583 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:05.134440 23583 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.076737 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1359) took 1240 ms. Trace:
I20260709 12:10:05.078890 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:05.135613 23583 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.136175 23467 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:05.136349 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 57547us
I20260709 12:10:05.079012 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.137121 21817 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:05.046393 23520 raft_consensus.cc:697] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:05.074733 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:05.144609 21922 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:05.090346 23480 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:05.091572 21748 catalog_manager.cc:5697] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 4 to 5, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:05.093717 23579 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.054621 23490 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:05.148603 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.055847 23567 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.002094 23482 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:05.101763 23517 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:05.119567 21993 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:10:05.119704 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 48132.6us
I20260709 12:10:05.163863 21993 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.123517 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.164162 21893 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.124519 23572 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.138232 21817 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:05.155375 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.156634 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.173260 21817 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:05.098348 23538 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:05.102859 23533 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:05.155807 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.106978 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:05.173434 22000 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:05.208823 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:05.222981 23546 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.223528 23546 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:05.224366 23546 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:05.226830 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 120014us
I20260709 12:10:05.231242 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.233920 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.255743 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.149489 23467 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.258800 21848 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.259806 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.262538 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:05.262534 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 53304us
W20260709 12:10:05.265367 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 90825.4us
I20260709 12:10:05.266139 21817 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.267287 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:05.268345 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.149222 23579 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:05.272836 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.275344 23485 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.275746 23485 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:05.276141 23485 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.283187 23485 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.272239 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.192303 23514 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:05.337234 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.080957 23581 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.169119 23557 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:10:05.167393 23570 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.208823 23547 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.135788 21849 rpcz_store.cc:276] 0709 12:10:03.836115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.840268 (+  4153us) service_pool.cc:224] Handling call
0709 12:10:05.076544 (+1236276us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400401ad4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:05.076660 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047106304}
W20260709 12:10:05.340658 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 175374us
I20260709 12:10:05.144776 23554 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:05.217412 23524 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.219753 23481 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.381771 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.382527 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:05.333699 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 65436us
I20260709 12:10:05.384279 21846 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.408645 21817 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:05.408017 22000 raft_consensus.cc:2393] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:05.370193 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.369043 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:05.416150 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 264261us
I20260709 12:10:05.331496 21850 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.258304 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.264990 23567 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:05.284502 23541 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.272846 23540 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.424206 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.145005 23539 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:05.381724 22549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.688s (SENT) [suppressed 33 similar messages]
I20260709 12:10:05.389173 23485 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:05.389590 23490 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.392076 22579 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
W20260709 12:10:05.394785 22578 consensus_meta.cc:287] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 12:10:05.451305 23570 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:05.269491 23520 consensus_queue.cc:237] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:05.414561 21817 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.425206 23541 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:05.420421 21852 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:05.420287 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 211188us
I20260709 12:10:05.460083 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.367880 21993 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:05.380503 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.458092 21817 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:05.461278 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.466446 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:05.425426 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.428056 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:05.428903 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 155575us
W20260709 12:10:05.429713 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 48019.4us
I20260709 12:10:05.412324 23581 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.411653 21843 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.430733 21848 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.404857 23494 consensus_queue.cc:1059] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:05.434779 21851 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.435331 21845 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.435827 23539 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:05.411938 23579 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.437449 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:05.438014 23468 consensus_meta.cc:287] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.575s	user 0.004s	sys 0.004s
I20260709 12:10:05.438762 23480 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:05.429867 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:05.465556 21849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:05.418867 23467 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.432353 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.418787 23519 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.273393 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 279111025ee54aba83c27bba63339332 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:05.471674 21993 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:05.473482 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49725.7us
I20260709 12:10:05.505596 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.506137 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.506352 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:05.462520 23541 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.475656 23591 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.486593 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.435886 21996 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:05.516095 21846 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:05.491513 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.497345 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.517832 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.518613 22000 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.498241 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.499155 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.474694 23537 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:05.476892 23538 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.507997 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:05.478711 23533 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.511305 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.513753 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.502969 23467 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:05.515280 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.461788 23572 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:05.507378 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.519614 21999 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:05.542900 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.520419 21997 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:05.527107 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.543916 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.544270 21997 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.544209 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.527114 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.462020 23540 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.530925 21922 raft_consensus.cc:2393] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:05.530318 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 47694.4us
I20260709 12:10:05.509644 21849 raft_consensus.cc:606] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:05.534973 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.551095 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.551256 21848 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.540795 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.511920 23482 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:05.558945 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.501641 23468 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:05.515516 21736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 246468us
I20260709 12:10:05.512068 23594 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.564383 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:05.570678 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 102867us
I20260709 12:10:05.539605 23467 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.537973 23537 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:05.572269 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:05.575362 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.577668 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.579082 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.579761 21999 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:05.555004 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.581496 21847 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.582661 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.572391 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.595996 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.596140 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.596748 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.520370 23567 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:05.604990 23468 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:05.578650 23482 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:05.599112 23550 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:05.574115 23584 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.569581 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.617033 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.619107 22000 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:05.620039 23540 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.620211 23533 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.623208 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.624462 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.626487 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.628790 21846 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.598893 23530 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.633749 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.596998 23554 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:05.633769 21997 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:05.634832 23592 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.636130 23499 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:05.595341 23604 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.640669 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.663671 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.664569 22000 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:05.665310 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.668713 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:05.671375 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 75447.1us
W20260709 12:10:05.639441 23587 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:10:05.638777 23499 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.633947 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.695839 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.695922 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.665258 23570 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.668138 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:05.705130 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 193946us
I20260709 12:10:05.672544 23489 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.616333 23572 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.707361 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.710047 21964 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:05.711349 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.703706 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.708684 23537 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.722790 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.719875 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:05.724134 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.725339 23583 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.715276 23604 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.717760 23594 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.720003 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:05.727219 21845 raft_consensus.cc:1240] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.733870 22549 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.735378 21845 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.736745 21999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:34358
I20260709 12:10:05.737332 21999 raft_consensus.cc:606] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.716424 23606 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.723745 23591 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:10:05.732388 23594 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:05.742910 22549 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.743901 23594 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:05.744685 23508 consensus_meta.cc:287] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.843s	user 0.006s	sys 0.005s
I20260709 12:10:05.746850 23604 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.737214 21843 raft_consensus.cc:3055] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:05.738639 23530 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.759265 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.782645 21846 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.760123 23541 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.761902 23499 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:05.762856 21998 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:05.764649 21843 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:05.782011 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.793756 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1369) took 1144 ms. Trace:
I20260709 12:10:05.796983 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:05.799139 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.749643 23508 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.802940 21847 rpcz_store.cc:276] 0709 12:10:04.649359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.001957 (+352598us) service_pool.cc:224] Handling call
0709 12:10:05.019485 (+ 17528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.581910 (+562425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.793440 (+211530us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400208d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:05.793667 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292077952}
I20260709 12:10:05.795233 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:05.814044 21997 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:05.820648 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 252456us
I20260709 12:10:05.822381 21845 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.824750 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:05.822973 21817 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.827653 23575 raft_consensus.cc:993] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:10:05.833436 22579 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.833745 23579 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.838683 23538 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.851027 21966 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:05.852150 23541 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:05.853314 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:05.854255 22575 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:05.839684 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:05.827181 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 246617us
I20260709 12:10:05.843674 21843 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:05.844587 23575 raft_consensus.cc:1081] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:10:05.866873 22581 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.867858 23467 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.825623 21992 raft_consensus.cc:2376] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3. Re-sending same reply.
I20260709 12:10:05.862874 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.874962 21966 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.878480 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:05.881067 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:05.884603 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:05.891196 23467 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:05.893254 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:05.879019 21843 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.881841 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.886968 21817 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:05.869586 23577 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.897502 21994 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:05.904138 23607 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:05.906447 23570 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.907161 23549 raft_consensus.cc:3055] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:05.888804 23500 consensus_queue.cc:1059] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:10:05.935907 23549 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:05.907346 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.879456 23584 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.873746 23591 consensus_queue.cc:1059] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:05.879593 23397 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:05.873080 23583 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.910224 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.915814 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.917091 21997 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.936390 23500 raft_consensus.cc:3055] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.917773 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.917929 23454 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:05.953727 23454 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.954106 23454 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:05.955415 23454 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.918460 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.956651 21998 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.960054 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1292) took 1056 ms. Trace:
I20260709 12:10:05.960500 21996 rpcz_store.cc:276] 0709 12:10:04.904096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.904938 (+   842us) service_pool.cc:224] Handling call
0709 12:10:05.959833 (+1054895us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400235fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:05.959962 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289287424}
I20260709 12:10:05.919720 21995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:10:05.962833 21995 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:05.963277 21995 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.919389 22000 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:10:05.966881 23611 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.211s	user 0.003s	sys 0.000s
I20260709 12:10:05.921113 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:05.968904 21999 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.923859 23575 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.951378 23500 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:05.982725 23575 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:05.983319 23500 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.983649 23575 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.925364 23493 raft_consensus.cc:3055] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:05.926796 22576 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:05.987949 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 113089us
W20260709 12:10:05.988269 23613 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:10:05.930850 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:05.885424 23541 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.921744 23594 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:05.942818 22001 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.941599 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.915716 23494 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:05.943158 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.943557 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:05.951663 21992 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.970228 22582 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.973721 21998 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:05.950999 23555 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.981498 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1373) took 1241 ms. Trace:
I20260709 12:10:05.998054 21852 rpcz_store.cc:276] 0709 12:10:04.740344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.022385 (+282041us) service_pool.cc:224] Handling call
0709 12:10:05.022755 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.461844 (+439089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.981225 (+519381us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54000bf9d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:05.981431 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914108288}
I20260709 12:10:05.984750 23500 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.942679 23583 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:05.937551 23549 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:05.987030 23493 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:05.925518 22578 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:10:05.991782 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50272.3us
W20260709 12:10:05.993419 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 49936.8us
I20260709 12:10:06.003862 21999 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:05.994840 23570 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.997625 23550 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.012667 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:05.990201 23577 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.994729 23541 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:06.007072 23594 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:06.018224 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.043061 21925 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.043851 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.044215 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:06.046954 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.014914 21849 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.058948 23615 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.016690 23493 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.023754 21966 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.013984 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 206) took 1786 ms. Trace:
I20260709 12:10:06.063571 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.065145 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.030920 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.031387 21817 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.035053 21923 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.035367 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:06.039263 21926 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.032590 23576 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:10:06.040771 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:06.082006 21922 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:06.041970 21919 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.084972 21995 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.069476 21966 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.061666 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:06.074424 23612 raft_consensus.cc:3055] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.075646 21851 rpcz_store.cc:276] 0709 12:10:04.227605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.957222 (+729617us) service_pool.cc:224] Handling call
0709 12:10:04.957490 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.492208 (+534718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.992138 (+499930us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540017f7d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:06.012802 (+ 20664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097221888}
I20260709 12:10:06.061713 23493 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.076768 23397 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.076987 23584 raft_consensus.cc:3055] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.079042 21993 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:06.079811 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.095386 21815 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:06.107067 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 75745.1us
I20260709 12:10:06.083303 23481 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.080590 23607 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.115957 23572 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.116238 23607 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.080883 23594 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.112987 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.088405 23549 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.088996 23550 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.085007 23614 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.115088 23480 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.103596 23555 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.212272 21995 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:06.083287 23579 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:06.214082 23579 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.214443 23579 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:06.215212 23579 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.130329 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:06.216601 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 86352.7us
I20260709 12:10:06.217264 21892 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.112121 23584 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:06.103693 21924 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.128181 23570 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:06.141525 23494 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.219996 21892 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:06.111912 23533 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:06.220847 22575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 550) took 1763 ms (client timeout 2116 ms). Trace:
I20260709 12:10:06.222491 21920 raft_consensus.cc:1240] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.075495 23541 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.230530 23533 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:06.230708 23570 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.230016 23557 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.231060 23570 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:06.231364 23557 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:06.231503 23533 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.231988 23557 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.231949 23570 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.224151 23615 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.233893 23615 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.083496 23583 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.220356 23494 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:06.236038 23494 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.236060 23583 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.141525 23379 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:06.220525 23594 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:06.238965 23594 consensus_queue.cc:1243] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:06.238679 23379 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.223095 21927 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.223748 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.224033 21918 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.222249 23597 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:06.221282 22575 rpcz_store.cc:269] 0709 12:10:04.457372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.458298 (+   926us) service_pool.cc:224] Handling call
0709 12:10:06.220657 (+1762359us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400733054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:06.220769 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488248192}
I20260709 12:10:06.234395 23530 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:06.234781 23604 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:06.244257 23604 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.248574 23379 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:06.248327 23530 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.242003 23597 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:06.250466 23597 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.202454 21919 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:06.267032 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:06.269982 22001 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:06.274163 21817 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:06.271618 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 47949.2us
I20260709 12:10:06.275274 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.276464 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:06.278285 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.280048 21921 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
W20260709 12:10:06.274626 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.218938 23614 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:06.201545 22576 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:06.254846 23604 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:06.303355 21920 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:06.297107 23481 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.296936 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:06.292671 23547 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.311923 23530 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:06.312129 23547 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:06.312551 23547 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.292435 23555 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:06.297683 23614 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.280855 23508 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.110594 23612 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:06.338967 21992 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:06.321758 23481 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:06.325997 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:06.329747 23591 raft_consensus.cc:3055] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.322965 23555 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:06.324851 23508 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:06.342509 22575 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 2: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:06.335639 21843 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
W20260709 12:10:06.350979 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.322710 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 225950us
I20260709 12:10:06.353596 21849 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:06.380929 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:06.382618 21923 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.352840 23555 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.351744 23591 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:06.353885 23508 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.385666 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:06.386529 23612 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.346580 23615 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:06.392058 23597 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.349328 23609 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:10:06.336493 23584 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.407101 23603 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:06.426683 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 168747us
W20260709 12:10:06.425977 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 147770us
I20260709 12:10:06.378310 23557 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.428200 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.395673 23577 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:06.394536 23591 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:06.451531 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 382126us
I20260709 12:10:06.377902 23481 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.415938 23576 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:10:06.428304 23622 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.435535 23584 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.463730 21893 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.465353 23591 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.468779 21844 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.453692 23612 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:06.461277 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 138058us
I20260709 12:10:06.472977 22582 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.462369 23550 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:06.474377 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.431517 23603 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.467703 23622 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:06.489447 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 61348.6us
W20260709 12:10:06.471762 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 58710.7us
I20260709 12:10:06.490490 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.473785 23626 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.476495 23604 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:06.476344 23397 consensus_queue.cc:1059] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:06.512225 23603 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:06.240002 23581 consensus_queue.cc:1175] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:06.521059 23494 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.523263 23494 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:06.474769 23623 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:06.523878 23494 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:06.524677 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.487327 23622 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.481834 23550 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:06.535948 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 78113.5us
I20260709 12:10:06.536924 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.527225 23467 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:06.485111 23606 consensus_queue.cc:1059] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:06.527139 23520 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.540727 23467 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:06.540189 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 68440.7us
I20260709 12:10:06.542099 23557 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:06.529955 21924 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:06.524801 23604 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.559475 23467 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:06.542538 23636 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.577982 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:06.578332 21995 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:06.578696 22577 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:06.579522 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:06.581475 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:06.581779 21923 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:06.582345 23549 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.583854 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:06.582780 23549 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.585391 23549 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.557335 23597 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:06.560928 23623 raft_consensus.cc:3055] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.589536 21964 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:06.557149 23634 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:10:06.560105 23572 raft_consensus.cc:2764] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:06.591485 23637 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:06.538338 23547 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:06.596789 23594 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:06.605453 23549 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.613049 23549 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:06.613977 23570 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.595323 23623 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:06.618974 21927 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.615334 21919 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.597246 23480 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:06.620395 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:06.620918 23637 raft_consensus.cc:697] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:06.620992 22578 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:06.623265 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 86418.3us
I20260709 12:10:06.624676 21966 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.601819 23638 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.630525 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:06.632015 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.632205 21966 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.635217 23550 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:06.626772 23584 consensus_queue.cc:1059] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:06.636616 23508 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.644562 23623 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.623462 23594 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:06.629367 23606 consensus_queue.cc:1243] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:06.649152 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:06.622206 23637 consensus_queue.cc:237] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.647800 23623 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.653546 23606 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.661412 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:06.653985 22577 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:06.662081 23638 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.661952 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:06.665593 23576 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.706353 21893 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:06.697958 23628 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:06.699087 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:06.670646 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:06.715021 23565 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:06.729005 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 238646us
W20260709 12:10:06.722267 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 80777us
I20260709 12:10:06.728492 23565 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:06.730280 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.730650 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:06.730854 23565 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.712643 23508 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:06.731897 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.735052 21966 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.739118 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:06.738847 23493 raft_consensus.cc:2764] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:06.736593 23642 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:10:06.740525 23639 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.740758 23607 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.741016 23639 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.744412 21966 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.745594 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.746651 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.731523 23604 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:06.734288 23576 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.741165 23607 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:06.752876 23641 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.729815 23494 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:06.747604 23493 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.714680 23638 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:10:06.743995 23639 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.749500 23547 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:06.761974 22578 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:06.708537 23594 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.769318 23624 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:06.770455 23641 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.768548 23576 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.775997 23624 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.767089 23607 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.748759 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:06.789402 23579 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:06.880015 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.838071 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 95102.7us
W20260709 12:10:06.849987 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.856565 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.868471 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.832036 21849 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:06.832865 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:06.902722 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 155977us
I20260709 12:10:06.870117 23493 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.861557 23467 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.855654 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:06.856878 23466 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.910737 23466 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:06.792735 23624 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:06.917016 23466 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:06.933359 21966 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:06.946898 21843 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
I20260709 12:10:06.947666 23607 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:06.939695 23555 consensus_meta.cc:287] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.537s	user 0.004s	sys 0.013s
I20260709 12:10:06.938687 23467 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:06.954731 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50587us
I20260709 12:10:06.955650 23467 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:06.958905 23646 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.963452 21995 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:06.966518 22000 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:06.955679 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:06.968994 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:06.969419 22001 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.969878 21999 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:06.975951 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:06.976728 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 219) took 1071 ms. Trace:
I20260709 12:10:06.872762 23494 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.978114 23605 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:06.978749 23605 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:06.979257 23605 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.979593 23466 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:06.983243 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50303.9us
I20260709 12:10:06.972244 23565 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.985450 23485 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:07.002513 23485 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.002862 23519 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.003762 23519 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:06.986896 23493 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.978134 23609 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:06.986912 23624 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:06.988624 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:06.977301 21844 rpcz_store.cc:276] 0709 12:10:05.905412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.905521 (+   109us) service_pool.cc:224] Handling call
0709 12:10:05.905946 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.470973 (+565027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.976184 (+505211us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400292054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:06.976481 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293974784}
I20260709 12:10:06.988996 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:06.957243 23555 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.004045 23622 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.008445 23493 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:07.011061 23493 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.012277 23466 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.011981 23624 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.013073 23622 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.012975 23466 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.017845 23624 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:07.017912 23643 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.014767 21995 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:06.994246 23606 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.033493 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:07.041167 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.030066 23640 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.031471 23519 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.044097 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:07.047886 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:07.048801 21993 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:07.046093 23466 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:07.059456 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 71153.1us
I20260709 12:10:07.061283 23547 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.061771 23547 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:07.062103 23547 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.062602 23640 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:07.063896 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 53708.5us
I20260709 12:10:07.063987 23607 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.064888 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.065084 23640 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.068948 23639 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.070397 23570 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.071346 23570 consensus_queue.cc:1243] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:07.063117 23565 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.071946 23570 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.072381 23570 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:07.073499 23570 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.075778 23645 raft_consensus.cc:3055] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.076334 23645 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:07.070526 23520 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:07.086696 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:07.086994 23591 consensus_meta.cc:287] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.003s
I20260709 12:10:07.089871 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.087306 23555 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.091681 21844 raft_consensus.cc:2393] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:07.092140 23572 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.093853 23572 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:07.094331 23572 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.080771 23520 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:07.097524 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.098099 21851 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:07.101898 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.077685 23645 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.105007 23606 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.105325 23627 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.105873 23627 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:07.107159 23627 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.108368 23627 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.130699 23607 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.108558 23639 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.132943 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.133940 21923 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:07.135519 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.136125 21925 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.136375 21922 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:07.137756 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.139149 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.142727 21926 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:07.142871 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 76528.9us
I20260709 12:10:07.143889 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.144364 21966 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.144964 21921 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.145393 23623 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.146104 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.144644 21926 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:07.147483 21921 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:07.144366 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.148641 21923 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.148983 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:07.149641 22576 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.090646 23547 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.157970 23397 raft_consensus.cc:3055] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.158752 21922 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.162297 22577 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.204136 22000 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.162397 21748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58736 (request call id 277) took 2176 ms. Trace:
I20260709 12:10:07.097141 23605 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.109788 23577 raft_consensus.cc:3055] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.203606 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:07.204689 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.169235 23499 consensus_queue.cc:1059] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:10:07.238289 21992 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:07.238849 23499 consensus_queue.cc:1243] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:07.239370 23499 raft_consensus.cc:3055] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.239743 23499 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:07.201588 23639 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.240940 23499 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.241133 23639 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.173979 23554 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:07.243810 23639 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.244083 23554 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.206743 23555 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:07.245975 23555 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.246429 23555 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:07.246546 23499 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.199102 23570 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.247740 23555 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.249068 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.207073 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:07.249930 22581 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:07.250087 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:07.250725 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 43887.4us
I20260709 12:10:07.251071 22580 raft_consensus.cc:2368] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3.
I20260709 12:10:07.252393 23604 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.252764 23604 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:07.253104 23604 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.253940 22576 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:07.254552 23624 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.249274 23555 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.204820 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:07.204986 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:07.162886 23645 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.177424 23466 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.182106 23481 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:07.270810 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.270983 21922 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.207537 23615 consensus_queue.cc:1059] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:10:07.271178 23481 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.272509 23615 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.272735 22580 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:07.272892 23615 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:07.273348 23481 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.204334 23614 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:07.230466 23397 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:07.234835 21851 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.269857 23624 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.192239 23454 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.300248 22577 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:07.263370 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 58740.9us
I20260709 12:10:07.303584 23547 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.293288 23554 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.215350 23520 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:07.307765 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.308719 22575 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.309093 23605 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:07.310885 21817 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:07.275411 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 131252us
I20260709 12:10:07.173055 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.270066 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:07.172397 23533 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:07.274120 23614 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.183722 23493 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.288930 23397 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.290352 23499 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.294971 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:07.372043 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.372710 21849 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.372949 23454 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.372076 21922 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:07.373438 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.171775 23537 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 12:10:07.209127 23572 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.317065 23481 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.353207 23482 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.273983 23615 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:07.346825 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.357064 22582 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.320174 23520 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.354127 23624 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.347041 21817 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:07.296382 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.270824 23466 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.296164 23642 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:07.326094 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.256395 23577 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:07.376173 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 124387us
I20260709 12:10:07.377609 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.362915 23609 consensus_queue.cc:1059] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:07.374827 23547 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.380661 23481 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.391430 21848 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.381417 23643 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.379448 23454 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.391909 23642 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.404031 23642 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.376288 23533 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.397111 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.408766 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.395006 23481 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.418992 23454 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.419262 23579 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:07.419692 21924 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.419970 23579 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:07.422360 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.422379 23579 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.423060 21918 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.429934 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.431344 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:07.434777 23577 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.436435 23577 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:07.436710 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.437767 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 120671us
I20260709 12:10:07.438802 21966 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.440713 23579 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.397554 23623 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:07.441987 23623 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.444569 23623 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.445684 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.391971 23607 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:07.447228 23607 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.449483 23607 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:07.450173 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.452342 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.454491 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.450767 22583 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:07.412076 23609 consensus_queue.cc:1243] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:07.428310 22578 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:07.441349 23572 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.403178 23547 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:07.459740 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 88189.6us
I20260709 12:10:07.231307 21748 rpcz_store.cc:276] 0709 12:10:04.985926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.986067 (+   141us) service_pool.cc:224] Handling call
0709 12:10:07.162124 (+2176057us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:05.444572 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:05.445163 (+   591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:05.445199 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:10:05.445217 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:05.445565 (+   348us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:05.445657 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:05.445692 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:05.445873 (+   181us) tablet.cc:701] Row locks acquired
0709 12:10:05.445892 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:10:05.446022 (+   130us) write_op.cc:270] Start()
0709 12:10:05.446137 (+   115us) write_op.cc:276] Timestamp: P: 1783599005445980 usec, L: 0
0709 12:10:05.446159 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:05.479612 (+ 33453us) log.cc:844] Serialized 595 byte log entry
0709 12:10:05.939980 (+460368us) spinlock_profiling.cc:243] Waited 959 us on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:06.310354 (+370374us) op_driver.cc:464] REPLICATION: finished
0709 12:10:06.529990 (+219636us) write_op.cc:301] APPLY: starting
0709 12:10:06.531797 (+  1807us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:06.539750 (+  7953us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:06.542768 (+  3018us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:06.582940 (+ 40172us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:06.599245 (+ 16305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:06.603751 (+  4506us) write_op.cc:312] APPLY: finished
0709 12:10:06.618933 (+ 15182us) log.cc:844] Serialized 23 byte log entry
0709 12:10:06.641654 (+ 22721us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.648734 (+  7080us) write_op.cc:454] Released schema lock
0709 12:10:06.649932 (+  1198us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:06.666219 (+ 16287us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.668200 (+  1981us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":183480,"apply.run_cpu_time_us":2749,"apply.run_wall_time_us":131933,"num_ops":1,"prepare.queue_time_us":296830,"prepare.run_cpu_time_us":27394,"prepare.run_wall_time_us":263904,"raft.queue_time_us":341991,"raft.run_cpu_time_us":18122,"raft.run_wall_time_us":148016,"replication_time_us":864017,"spinlock_wait_cycles":2206592,"thread_start_us":801571,"threads_started":4,"wal-append.queue_time_us":249079}]]}
I20260709 12:10:07.456439 23468 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.396495 23482 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.467253 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.456976 23499 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:07.476811 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.482990 21919 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.470294 23468 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.495474 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:07.479628 23397 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.480978 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.500978 21848 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:07.486860 23468 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.505255 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.503134 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.489661 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:07.513360 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.514420 23539 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.478960 23499 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.516106 23539 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.519435 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:07.496745 23454 consensus_queue.cc:1059] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:07.507422 23615 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.586822 21927 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.588008 23665 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:10:07.534425 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.610535 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.506022 23614 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.613374 22547 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:07.614962 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 93125.3us
I20260709 12:10:07.520550 21843 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:07.519964 23493 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.618775 21918 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.620363 21818 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:07.621341 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 143156us
I20260709 12:10:07.609122 23624 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.623797 23554 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.628667 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.629570 23665 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.633486 23570 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.633863 23570 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:07.634719 23570 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.635401 23539 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.635989 23570 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.638759 23454 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.639004 23605 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.639429 23605 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:07.639272 23454 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.640384 23605 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.641399 23454 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.641633 23605 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.628829 23499 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.643870 21818 leader_election.cc:400] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3.
I20260709 12:10:07.618425 23466 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.649878 21818 leader_election.cc:403] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:07.624419 23624 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:07.657829 23639 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.662144 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.662775 21918 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
W20260709 12:10:07.664407 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.669349 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.656038 23624 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.673017 23539 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.659621 23639 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.666917 23554 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:07.681816 23639 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.660132 23466 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3.
I20260709 12:10:07.687273 23482 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.690243 21925 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
W20260709 12:10:07.691020 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.678992 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.695796 23579 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.696399 21966 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.697276 23579 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:07.702104 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.703006 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:07.703801 21918 raft_consensus.cc:2368] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3.
W20260709 12:10:07.704905 23627 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.596s	user 0.004s	sys 0.005s
W20260709 12:10:07.706779 23667 log.cc:927] Time spent T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:10:07.706884 21924 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.707839 21923 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.709347 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.710523 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.711130 21922 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:07.711409 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:07.712040 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.712821 23555 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.712534 23481 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.713351 23555 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:10:07.714289 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.714749 23555 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.715381 23466 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:07.715909 23642 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.717298 23482 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:07.721132 23520 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:07.723270 21893 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:07.724155 23520 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.724754 23520 raft_consensus.cc:697] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:07.725997 23520 consensus_queue.cc:237] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.728133 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.728408 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.733485 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.733827 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.734321 22578 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:07.735555 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.735872 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:07.736600 22578 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.737202 21923 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:07.736742 23397 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.740036 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:07.743090 22583 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.743763 23468 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:07.762601 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 152852us
I20260709 12:10:07.765882 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:07.767800 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.769213 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.769600 21927 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:07.770620 21918 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:07.771004 21922 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.775279 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.776613 23397 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.777276 23397 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.778514 23642 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.779220 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.779444 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:07.780076 23645 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.780210 21999 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:07.780781 23602 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.780642 23645 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.781175 23602 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:07.782806 23481 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.735980 23604 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.784615 21995 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:07.785147 23604 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:07.786005 21992 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.786700 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:07.786887 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.787516 21847 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.787343 23624 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.787868 21847 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:07.788708 21847 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.789419 23624 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:07.789793 21847 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.789960 23533 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.790149 22579 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:07.791010 22547 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.791417 23627 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.792253 22547 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.792407 21999 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:07.779582 23397 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.794572 23454 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.795322 23454 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:07.780210 21924 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:07.796466 23454 consensus_queue.cc:1059] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:07.797322 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.797595 23454 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.797963 23454 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:07.798563 23499 raft_consensus.cc:3055] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.798913 23499 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:07.799216 23539 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.799575 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.800175 21846 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.799753 23539 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.799793 21992 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.801939 23539 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.802470 23481 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.802963 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.803687 21992 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:07.803823 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.804491 22576 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:07.801838 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.805140 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.805930 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.806735 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.808135 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.808800 21992 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:07.809793 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.799841 23499 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.811965 23499 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.810356 23454 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.816452 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.817042 21993 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.792023 23627 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:07.819494 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.832365 22578 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:07.817414 23454 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.840057 21847 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
W20260709 12:10:07.843860 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.845652 21844 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:07.792754 23668 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.849069 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:07.847185 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:07.854295 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.789987 23624 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.857820 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:07.859956 21992 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:07.843403 23604 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.864046 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.863090 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:07.864758 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:07.841112 23397 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.848376 23570 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.864813 23520 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:10:07.871410 23570 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.872614 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:07.873282 21995 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:07.873708 23570 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:07.879186 21999 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.854738 23539 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.883299 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.884441 23607 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.884785 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.866300 22584 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:07.885610 23554 consensus_queue.cc:1059] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:07.886541 23519 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.886685 23554 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.887207 23519 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.887581 23519 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:07.888398 23519 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:07.889544 23519 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.896448 21815 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:07.861948 23577 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.861608 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:07.916026 21815 leader_election.cc:400] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3.
I20260709 12:10:07.909545 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:07.948755 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:07.949396 21992 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.863406 23645 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:07.953987 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:07.954242 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44814.4us
I20260709 12:10:07.863621 23605 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:07.782020 23602 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:07.956164 21920 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:07.905736 23482 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.967272 21922 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.962393 21818 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:07.966650 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.947808 23665 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.972546 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:07.952009 23577 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.863651 23624 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.974692 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:07.908380 23614 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.971822 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:08.013173 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.025617 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.948024 23607 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:07.973577 21918 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:07.975754 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:08.021680 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 53133.9us
W20260709 12:10:08.022354 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.881727 23604 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.883992 23397 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.038254 21846 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:08.038254 21992 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:07.974685 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.023070 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.028779 22577 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:08.050787 23671 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:10:08.057221 23397 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:08.020896 22584 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.029260 23524 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.032771 22583 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:07.968367 23609 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:08.044872 21999 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
W20260709 12:10:07.991235 22549 leader_election.cc:336] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.872s (SENT)
I20260709 12:10:08.049532 21919 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:07.972995 23640 consensus_queue.cc:1059] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:10:08.046554 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:07.974093 23605 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.020800 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:07.954114 23539 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.058015 21998 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:08.021926 23577 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.081350 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:08.057214 23669 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:10:08.080837 23379 consensus_queue.cc:1059] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:10:08.082717 23575 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.078217 23485 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.083462 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.083276 23609 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.086781 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.087102 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.083276 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:08.088984 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.027099 23665 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.116504 21926 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:08.090111 22000 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:08.040401 23614 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.098898 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:08.152969 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 54159.2us
I20260709 12:10:08.153821 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.076335 23524 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.105098 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.029592 23482 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:07.976409 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.125325 23673 consensus_queue.cc:1059] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:08.125788 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:08.126192 23645 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:08.127475 23520 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.184186 21996 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:08.183984 23520 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.128051 23547 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:08.139014 23468 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:08.151149 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 64110.3us
I20260709 12:10:08.151026 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:08.088045 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:08.187760 22000 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.115677 23485 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:08.164844 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 138160us
I20260709 12:10:08.166356 21999 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:08.167203 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 195500us
I20260709 12:10:08.137776 21749 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 4, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 4 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.179101 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:08.108923 23575 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:08.183375 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 217487us
I20260709 12:10:08.194025 22584 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:08.160821 21921 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:08.191233 21992 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.186230 23520 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:08.171380 23524 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.171847 23607 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:08.207336 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.174866 23397 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.166254 23627 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:08.214708 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.188697 23642 raft_consensus.cc:3055] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.226752 21999 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:08.221649 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.228068 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.219035 23397 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.224699 23639 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.229568 23397 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.230026 23541 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.230509 23604 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:08.231228 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:08.231918 23645 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.232748 23605 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:08.232481 23645 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.233287 23605 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.234608 23624 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:08.235167 23546 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:10:08.235725 23665 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:08.235649 23546 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:08.226364 23642 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:08.236584 23546 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.237037 23642 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.238268 23614 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:08.237051 23546 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.241859 23482 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:08.241991 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.205469 23485 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.242364 23482 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.242919 23482 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.245076 23482 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:08.245756 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:08.201159 21749 catalog_manager.cc:5697] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 3 to 4, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:08.246555 21847 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:08.247344 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.248553 23481 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.248876 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:08.244939 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.251534 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.251644 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.253624 21993 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:08.260576 21844 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:08.247397 21749 catalog_manager.cc:5697] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 3, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.274441 21749 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 4 to 5, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.206858 23468 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.252090 21852 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:08.298384 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:08.231423 23685 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.204311 23575 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.299347 21993 raft_consensus.cc:2368] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4.
I20260709 12:10:08.292631 22547 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:08.313822 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.320569 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:08.335237 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.337075 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.338055 21847 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:08.339282 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.352439 21749 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 2, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:08.353964 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 98713.8us
W20260709 12:10:08.356663 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 64155.2us
I20260709 12:10:08.357659 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:08.273765 23579 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.370116 23690 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.370496 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:08.370752 23690 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:08.370970 21995 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.371133 21997 raft_consensus.cc:2376] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3. Re-sending same reply.
I20260709 12:10:08.371832 23690 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.377986 21919 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:08.322234 23639 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:08.392087 22549 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.842s (SENT)
I20260709 12:10:08.388029 22000 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:08.387897 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.394182 21993 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:08.397171 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.288554 23499 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:10:08.358561 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:08.381656 21749 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 3, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.400094 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:08.388474 23454 consensus_meta.cc:287] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.002s
I20260709 12:10:08.362486 23665 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.296343 23565 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:10:08.406802 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.410575 21749 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 3, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:08.412139 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.387662 23645 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:08.388631 23624 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.358124 23468 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.428789 23524 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.396291 23575 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.435449 23624 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:08.442957 22577 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:08.360106 23685 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.447170 21749 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 3, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.400381 21843 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:08.400801 23639 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.401634 23686 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.468729 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.472395 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.475721 23537 raft_consensus.cc:3055] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.476492 23537 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:08.478229 23639 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:08.483544 21817 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.485028 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:08.485561 23614 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.488370 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:08.489079 22580 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:08.492228 23481 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.492743 23481 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.475821 23468 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:08.500667 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.501353 21817 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:08.507200 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:08.486137 23614 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:08.511432 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.474241 21845 raft_consensus.cc:2368] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3.
I20260709 12:10:08.516896 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:08.518841 21817 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:08.516304 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:08.517550 22583 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:08.522931 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:08.525259 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.525851 21844 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:08.477626 23537 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.493117 23481 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.529826 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.535293 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.537896 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.539595 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.513857 23668 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:08.543766 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 223258us
I20260709 12:10:08.515086 23614 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.544987 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.546120 21927 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:08.547178 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.547417 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.547503 21920 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:08.542254 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.548521 21923 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:08.548097 21926 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:08.550470 23538 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.550953 23538 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:08.551180 23524 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:08.551293 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.526942 23579 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:08.551757 23538 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.499254 23686 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.557963 23685 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:08.558754 21925 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.542594 23468 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.560449 23468 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.560851 23468 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.562904 21924 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.552438 23579 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.565033 23579 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:08.565304 22579 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.566041 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:08.566725 21923 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.527666 23607 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.567497 23607 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.567865 23607 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.502380 23485 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.570904 23547 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.571318 23547 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:08.571893 23485 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:08.572250 23547 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.536419 23627 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.573954 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.536852 23689 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.574776 21921 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:08.575506 21850 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:08.546343 23668 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:08.576004 23668 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.573854 23627 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.552407 23694 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.573372 23547 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.582666 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:08.596145 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.596484 21920 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:08.578773 23602 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.606513 21923 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:08.608402 22549 leader_election.cc:400] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4.
I20260709 12:10:08.609331 22549 leader_election.cc:403] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.609433 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.583314 23537 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.590526 23694 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.544863 23467 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:10:08.618503 23533 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.620857 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.621686 23499 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4.
I20260709 12:10:08.622309 23499 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.607823 23579 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.622697 23499 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:08.623119 23499 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.623037 23579 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.625371 23579 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:08.616664 23694 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.626559 23541 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:08.601964 23624 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.631717 23499 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.633899 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.636168 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.603538 23645 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.638957 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.622092 22549 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.604943 23686 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:08.645972 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 108132us
I20260709 12:10:08.646687 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.647729 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.648640 21927 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:08.644898 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:08.635036 23604 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.653115 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.654801 21964 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.655980 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:08.641682 23577 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.005s
I20260709 12:10:08.653884 21927 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:08.656751 21920 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:08.663486 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.664098 21918 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:08.642516 23615 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.620885 23533 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.663888 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.667410 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.667817 21999 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:08.668069 21920 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:08.666677 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.669010 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.650614 23454 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.672981 21920 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.672465 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.677237 21815 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.678927 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:08.681238 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.683604 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.682375 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.665463 23686 raft_consensus.cc:476] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:08.686123 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.686123 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.687266 21844 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:08.687598 22000 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:08.689296 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:08.691813 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:08.695089 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50301us
I20260709 12:10:08.695219 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:08.695851 22580 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:08.669485 23533 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.696159 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:08.679703 23485 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.683157 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.667744 23577 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.710865 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.682716 23499 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:08.709983 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44922.7us
I20260709 12:10:08.723428 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.669974 23579 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:08.687508 23685 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.672686 23397 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.716650 23704 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.717590 23696 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.720152 23627 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:08.720873 23539 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:08.713531 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:08.730495 22582 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.676508 23565 consensus_queue.cc:1059] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:10:08.708467 23485 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.682531 23615 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.731951 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:08.711515 23639 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:08.706561 23454 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.711529 23645 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.732735 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:08.738476 21998 raft_consensus.cc:2368] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 2. Current term is 3.
I20260709 12:10:08.742719 21993 raft_consensus.cc:2393] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:08.729950 23704 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:08.745699 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 201164us
I20260709 12:10:08.729429 23604 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:08.734543 23499 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.734491 23485 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.735184 23685 raft_consensus.cc:697] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:08.731588 23696 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.748328 21817 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.741972 23520 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.739900 23627 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.761111 21817 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.747789 23704 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.763084 23684 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.763000 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.750560 23696 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.763844 23685 consensus_queue.cc:237] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.773064 22582 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:08.750572 23520 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.754851 23627 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.745321 23639 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.756245 23686 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.777994 23539 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.754287 23705 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:08.761000 23565 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.782891 23627 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.776129 23684 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.802958 23686 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:08.845918 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:08.853958 21918 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.784228 23520 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.763023 23607 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:08.837474 23714 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:08.856084 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.856491 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.847031 23539 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:08.863502 23715 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:10:08.853349 23684 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.805186 23481 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.865272 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:08.871901 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.872076 23711 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:10:08.872440 21924 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.873365 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:08.874107 21996 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:08.846434 23468 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:08.874805 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:08.837580 23604 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.876081 23468 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:08.876554 21843 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:08.877928 21844 raft_consensus.cc:2393] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:08.878003 21843 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:08.874245 23686 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:08.879676 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.880290 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:08.881757 23668 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.883729 23577 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:08.885069 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:08.907998 22582 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.909026 23575 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:08.902786 21817 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:08.904418 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:08.911525 22584 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.912248 21996 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:08.912744 22577 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:08.913110 23707 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:08.861337 23397 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:08.913889 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:08.913601 23707 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:08.916540 23379 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.850620 23705 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:08.919232 23709 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:10:08.920008 23668 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:08.920718 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:08.915688 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 219584us
I20260709 12:10:08.942324 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:08.932821 21918 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:08.944005 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:08.944712 21918 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.945473 22582 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
W20260709 12:10:08.938712 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.963476 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:08.941665 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:08.948236 23577 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:09.071671 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:09.138478 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:09.080809 22584 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:09.139894 21921 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:09.109643 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.031844 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 147413us
I20260709 12:10:09.066752 22549 leader_election.cc:400] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3.
I20260709 12:10:09.141425 22001 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.141510 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 74916.6us
I20260709 12:10:08.955447 23604 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:09.106076 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 362377us
W20260709 12:10:09.134927 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.066190 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:09.068333 21848 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.053987 21918 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:08.957600 23499 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.950502 23711 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.097337 23615 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:09.192298 23537 consensus_meta.cc:287] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
I20260709 12:10:08.965366 23397 raft_consensus.cc:476] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Not starting pre-election -- already a leader
W20260709 12:10:09.012398 23722 log.cc:927] Time spent T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:09.200897 21922 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:10:09.201474 23695 raft_consensus.cc:3055] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.201418 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.010915 23702 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.061897 23721 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.010594 23706 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.207056 23481 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.212232 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:09.213374 23707 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.032889 23539 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.225557 23520 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.120378 21924 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:09.215049 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:09.217072 21817 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:09.217593 23627 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.205193 23607 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.225488 23379 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.008797 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:09.224805 23695 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:09.193507 23624 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.269762 23624 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.269953 23695 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.271417 23695 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.268224 23379 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.194213 22576 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.238847 21921 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:09.089365 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 401) took 1251 ms. Trace:
I20260709 12:10:09.239712 23702 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:09.284652 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.286789 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 92539us
I20260709 12:10:09.287529 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:09.288002 21995 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.288393 23719 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.289428 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:09.289973 21995 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.290609 23716 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:09.240589 23721 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:09.243423 22584 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.294595 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:09.199980 23604 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.248114 23609 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:09.255169 23533 consensus_meta.cc:287] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.001s
W20260709 12:10:09.241014 23694 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.000s
I20260709 12:10:09.307121 23694 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.308246 23604 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.194100 23577 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.260221 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:09.231269 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:09.265317 21998 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.051534 23485 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:09.266798 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 49823us
I20260709 12:10:09.260216 23705 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.269212 21919 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:09.275082 23624 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.275662 23379 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.277034 23642 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:09.277132 23614 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.002s
I20260709 12:10:09.283273 23520 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.289891 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:09.051995 23686 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.298691 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:09.300647 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:09.302904 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:09.364094 21921 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.366185 21998 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:09.209219 23711 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.304036 22001 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:09.262521 23645 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.254204 23696 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.308420 21997 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:09.259397 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:09.384122 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 83579.5us
I20260709 12:10:09.304675 23607 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.285878 23702 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:09.395905 21850 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:09.299561 23707 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.346728 21996 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.290306 23719 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.313097 23627 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:09.308876 23721 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.348783 22581 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:09.354545 23698 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:09.354910 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 65082.1us
I20260709 12:10:09.355716 23715 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.355512 23718 consensus_queue.cc:1059] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:09.324909 23723 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:09.313467 23533 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.356851 23577 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:09.359298 23704 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 12:10:09.360037 23546 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.369493 21993 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.331579 23604 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.375965 21849 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:09.380671 23686 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:09.391165 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 88350.9us
I20260709 12:10:09.444768 23694 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.302145 21843 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.403745 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:09.401783 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:09.400710 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 1714) took 1504 ms. Trace:
W20260709 12:10:09.478837 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 75194.5us
I20260709 12:10:09.370086 23519 raft_consensus.cc:3055] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.425994 22583 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:09.413884 23684 consensus_meta.cc:287] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 12:10:09.398633 23541 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.442242 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:09.444497 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:09.371193 23614 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.428210 23702 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.292881 22578 rpcz_store.cc:276] 0709 12:10:07.838011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.851637 (+ 13626us) service_pool.cc:224] Handling call
0709 12:10:07.947227 (+ 95590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:08.105812 (+158585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:08.109232 (+  3420us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:08.240223 (+130991us) log.cc:844] Serialized 26 byte log entry
0709 12:10:08.399973 (+159750us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:08.534090 (+134117us) log.cc:844] Serialized 14 byte log entry
0709 12:10:08.581494 (+ 47404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.072306 (+490812us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b5400486054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:09.072354 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:09.072405 (+    51us) raft_consensus.cc:1685] finished
0709 12:10:09.089003 (+ 16598us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:09.089259 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53032,"prepare.queue_time_us":106301,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5849,"raft.queue_time_us":9234,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":27050,"spinlock_wait_cycles":217042176,"thread_start_us":140198,"threads_started":1,"wal-append.queue_time_us":180478}
I20260709 12:10:09.391956 23645 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.453306 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.462926 21921 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:09.431922 23607 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:09.465245 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:09.466722 21847 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.476445 23602 consensus_queue.cc:1059] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:10:09.425598 23707 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.471210 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:09.525767 21998 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:09.397253 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:09.465903 23397 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.443600 23627 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.477684 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:09.479216 22001 rpcz_store.cc:276] 0709 12:10:07.865124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.865235 (+   111us) service_pool.cc:224] Handling call
0709 12:10:09.071523 (+1206288us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:09.369877 (+298354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27790720}
I20260709 12:10:09.475580 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:09.465845 23555 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.465724 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:09.465734 23639 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.521993 22576 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:09.469107 23721 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.508827 21815 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:09.472618 23520 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.512879 23729 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.544054 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:09.513003 23728 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.509001 23718 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:09.524328 23715 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.480576 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1391) took 2152 ms. Trace:
I20260709 12:10:09.480387 23499 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.480581 23519 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:09.554427 23729 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.528898 23524 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:09.569522 23519 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.570815 23519 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.571125 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:09.571527 23729 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:09.574606 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.558910 23485 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.574810 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:09.574664 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1524) took 1042 ms. Trace:
I20260709 12:10:09.576388 21927 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.575736 21923 rpcz_store.cc:276] 0709 12:10:08.532013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.613821 (+ 81808us) service_pool.cc:224] Handling call
0709 12:10:08.614368 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:08.871691 (+257323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:08.871734 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:08.906840 (+ 35106us) log.cc:844] Serialized 26 byte log entry
0709 12:10:09.442047 (+535207us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:09.442088 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.442172 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:09.574426 (+132254us) raft_consensus.cc:1685] finished
0709 12:10:09.574449 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:09.574593 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10504,"raft.queue_time_us":70921,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":2921,"thread_start_us":684673,"threads_started":2,"wal-append.queue_time_us":572346}
I20260709 12:10:09.558980 21851 rpcz_store.cc:276] 0709 12:10:07.318152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.319083 (+   931us) service_pool.cc:224] Handling call
0709 12:10:07.432679 (+113596us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:08.033500 (+600821us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76e9c 00007f3be1c76a5b 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:08.033696 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:08.176511 (+142815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:08.180536 (+  4025us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:08.207537 (+ 27001us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:08.225582 (+ 18045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.451067 (+1225485us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400341cd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:09.453717 (+  2650us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:09.470572 (+ 16855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362223488}
I20260709 12:10:09.578475 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.580102 23539 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:09.581966 21843 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:09.584584 23645 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:09.584638 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:09.586735 23624 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.587257 23624 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:09.587697 23707 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.588295 23607 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.588248 23624 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.590809 23499 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.567216 23689 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.591841 23689 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:09.549489 23690 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.592442 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:09.592777 23690 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:09.593062 23732 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:10:09.520176 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 106572us
I20260709 12:10:09.439702 23698 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.593961 23698 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.593106 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:09.593829 23690 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.522861 21918 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:09.527287 21926 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.471608 23704 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.510960 23482 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.518103 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:09.515851 23696 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.451542 23730 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:09.477887 23604 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.537955 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:09.539070 23726 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:10:09.514139 23684 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.523216 23702 raft_consensus.cc:697] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:09.550978 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:09.611814 21998 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.612318 21994 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:09.539202 23737 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.551853 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:09.553898 23686 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.612970 23737 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.615118 23737 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.554061 23728 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.514776 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:09.531002 23541 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:09.616204 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 101548us
I20260709 12:10:09.616371 23541 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.616978 21966 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:09.543107 21845 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.540040 22575 raft_consensus.cc:1813] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Handling vote request from an unknown peer ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:09.617274 23728 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.618139 22575 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:09.618476 23728 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.537946 21924 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.618717 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:09.619153 23728 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.619195 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:09.620371 23707 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.521335 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 79201.1us
I20260709 12:10:09.580262 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.582082 21996 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:09.602224 22000 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
I20260709 12:10:09.634802 21998 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:09.531476 23627 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.607838 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:09.656392 21921 raft_consensus.cc:2393] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:09.608779 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:09.531136 23397 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.619928 21918 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:09.622443 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:09.544390 23520 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:09.538062 23555 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.635439 23737 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:09.667447 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:09.637365 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:09.639150 23499 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:09.601861 21925 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:09.640295 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.670967 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:09.620635 23730 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.641491 23736 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.642809 21992 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:09.643190 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.602007 23482 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:09.644767 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:09.676298 22000 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:09.677210 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:09.677768 22000 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:09.603060 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:09.647037 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:09.657610 21923 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:09.634061 23705 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.663786 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:09.669194 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:09.678601 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 75652.4us
I20260709 12:10:09.679029 21847 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.672273 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:09.679769 21922 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.674633 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:09.680413 21998 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:09.665364 23684 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:09.685226 23686 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.688033 23482 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.688629 23499 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.688863 23702 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.675683 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.621847 23715 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:09.716303 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1502) took 1045 ms. Trace:
I20260709 12:10:09.668893 23718 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.705792 23614 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.679831 21996 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:09.689677 23736 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.721750 22001 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:09.683892 23689 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.707278 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.723914 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.725091 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.707598 23499 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.709380 21844 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
W20260709 12:10:09.712838 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.691391 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:09.715077 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:09.729251 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:09.730356 22549 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:09.731500 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:09.679984 23579 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:09.682395 23723 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.682624 23696 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.716715 21850 rpcz_store.cc:276] 0709 12:10:08.670983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.671129 (+   146us) service_pool.cc:224] Handling call
0709 12:10:09.716062 (+1044933us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b540017fcd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:09.716245 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629454592}
I20260709 12:10:09.672101 23737 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.690716 23729 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.683775 23705 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:09.760187 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 68898.7us
I20260709 12:10:09.726882 23704 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:09.782714 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:09.732604 23499 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.752274 23579 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.716789 23520 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.714221 23711 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.748620 23706 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.748448 23624 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.748760 23668 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.789155 21850 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:09.794483 21892 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:09.752704 23639 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.798292 21847 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:09.803646 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:09.755360 23645 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.752586 23696 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.810319 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:09.812602 21892 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:09.749636 23686 consensus_queue.cc:1059] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:10:09.798007 23706 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.797492 23668 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.811281 23696 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.783495 23729 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.817943 23547 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.864063 21846 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
W20260709 12:10:09.865208 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 52722.4us
I20260709 12:10:09.866683 21892 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:09.868698 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:09.849776 23520 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.853717 23723 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.864745 23748 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:09.871690 23579 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.855731 23668 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.855851 23704 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.875439 23572 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.856031 23706 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.888692 21892 leader_election.cc:400] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 2. Current term is 3.
I20260709 12:10:09.889183 21892 leader_election.cc:403] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:09.847935 23750 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.813123 23711 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.895357 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 1730) took 1045 ms. Trace:
I20260709 12:10:09.815495 23718 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.878216 23627 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.885330 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.895849 21994 rpcz_store.cc:276] 0709 12:10:08.849534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.849658 (+   124us) service_pool.cc:224] Handling call
0709 12:10:09.895105 (+1045447us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400236ed4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:09.895286 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728401280}
W20260709 12:10:09.905340 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 154488us
I20260709 12:10:09.887558 23604 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:09.888019 23547 raft_consensus.cc:2764] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:09.815871 23645 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.911367 23718 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:09.912955 21926 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:09.931928 23604 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.933571 23604 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.933979 23604 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.947832 21844 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.890898 23704 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.930509 23572 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 2. Current term is 3.
I20260709 12:10:09.926025 21924 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:09.890398 23748 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.930680 21843 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:09.941984 23604 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:09.968866 21994 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:09.974336 21995 consensus_meta.cc:287] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.000s
I20260709 12:10:09.974910 21995 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:09.968176 23577 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:09.900276 23750 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:09.980777 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 1739) took 1075 ms. Trace:
I20260709 12:10:09.982887 23737 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:10.022980 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 136092us
I20260709 12:10:10.026279 23572 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.027619 23750 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:10.036427 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:10.036700 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:10.037268 23704 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.038151 23756 raft_consensus.cc:2764] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:10.038625 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:09.988209 23624 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:10.051744 21922 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:09.985282 23577 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:10.041749 21892 connection.cc:256] RPC call timeout handler was delayed by -1.3039332559999366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 12:10:10.067936 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.057521 23729 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.058740 23748 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:09.961683 23718 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.022194 23627 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:10.073484 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.019384 21995 rpcz_store.cc:276] 0709 12:10:08.902731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.289169 (+386438us) service_pool.cc:224] Handling call
0709 12:10:09.978360 (+689191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:10.072782 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.070274 23762 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.080322 21926 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.076053 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:10.076552 23604 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.076722 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:10.081869 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:10.100517 21999 raft_consensus.cc:1813] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Handling vote request from an unknown peer ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:10.101182 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:10.088176 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.084887 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.105937 21999 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:10.110968 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.114559 21926 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:10.073496 23759 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:10.117735 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:10.119361 21999 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:10.074712 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.109424 23715 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.106021 23762 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:10.126037 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 394613us
I20260709 12:10:10.128425 22547 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:10.113148 23645 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:10.133471 23698 consensus_meta.cc:287] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.000s
I20260709 12:10:10.133941 23698 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.128933 21892 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:10.131788 23577 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:10.144460 21848 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:10.132302 23707 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.132193 23604 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:10.132927 23605 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:10.125618 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:10.097843 23627 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.117871 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.150084 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.135262 23762 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.137857 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.139708 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.125082 23759 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.113775 23696 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.137142 22547 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:10.116863 23711 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:10.129245 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1704) took 1598 ms. Trace:
I20260709 12:10:10.122773 23721 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:10.155831 21844 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.146138 23715 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.159071 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:10.160781 21999 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:10.159225 21925 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:10.167073 23758 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:10.167788 23605 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:10.167639 23758 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.168216 23605 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.168569 23605 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.169811 23758 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.170626 21996 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:10.157910 21919 rpcz_store.cc:276] 0709 12:10:08.524294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.527360 (+  3066us) service_pool.cc:224] Handling call
0709 12:10:09.212019 (+684659us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76e9c 00007f3be1c76a5b 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:10.118372 (+906353us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b540014b754. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:10.122726 (+  4354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18124416}
I20260709 12:10:10.179759 23499 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.181120 23706 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.198611 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:10.199487 21999 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.200029 22580 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:10.202195 21846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 234) took 1960 ms (client timeout 1630 ms). Trace:
W20260709 12:10:10.202606 21846 rpcz_store.cc:269] 0709 12:10:08.241544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.241723 (+   179us) service_pool.cc:224] Handling call
0709 12:10:10.202030 (+1960307us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400049a54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:10.202119 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3725129600}
I20260709 12:10:10.203629 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.204692 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.208127 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.160228 23698 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.186554 23499 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.210816 21851 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:10.227252 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1418) took 1533 ms. Trace:
I20260709 12:10:10.127729 23624 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.230103 23759 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.218135 23715 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.215799 23696 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:10.217131 23731 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.698s	user 0.007s	sys 0.000s
W20260709 12:10:10.208308 23695 consensus_meta.cc:287] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.934s	user 0.013s	sys 0.002s
I20260709 12:10:10.218570 23707 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:10.233332 23707 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.219980 23605 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.221336 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1740) took 1318 ms. Trace:
I20260709 12:10:10.234154 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 1728) took 1385 ms. Trace:
I20260709 12:10:10.213860 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.170327 23758 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.227655 21845 rpcz_store.cc:276] 0709 12:10:08.693882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.134534 (+440652us) service_pool.cc:224] Handling call
0709 12:10:09.241056 (+106522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.617675 (+376619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.227003 (+609328us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54003813d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:10.227180 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661958528}
I20260709 12:10:10.235371 21992 rpcz_store.cc:276] 0709 12:10:08.848894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.850495 (+  1601us) service_pool.cc:224] Handling call
0709 12:10:10.233948 (+1383453us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54002d0ad4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:10.234090 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798462848}
I20260709 12:10:10.234995 21993 rpcz_store.cc:276] 0709 12:10:08.903051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.330364 (+427313us) service_pool.cc:224] Handling call
0709 12:10:09.369083 (+ 38719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.465083 (+ 96000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.221087 (+756004us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b54000d3c50. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:10.221262 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85062016}
I20260709 12:10:10.240990 21999 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:10.248910 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:10.249784 21999 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.276024 21846 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:10:10.277431 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 127025us
I20260709 12:10:10.287014 21999 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:10.288892 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:10.289579 21999 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.246776 23499 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:10.247383 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.291606 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:10.239265 23668 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.240564 23758 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.306625 21922 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:10.313865 23766 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.319465 23766 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.315286 23605 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.322996 23605 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.323176 23706 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.323534 23605 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.323776 23706 consensus_queue.cc:1059] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:10.323917 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:10.324553 21997 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.325495 23605 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:10.326026 23605 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:10.326320 23668 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.326931 23668 raft_consensus.cc:3055] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.323019 23707 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.299170 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.328008 21996 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:10.318625 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:10.304592 23499 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.330835 21992 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:10.331997 21992 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:10.332059 23499 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:10.333076 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:10.327270 23668 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:10.317773 23758 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.333716 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:10.334182 23668 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.334842 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:10.335374 23467 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.335680 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:10.335930 23467 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.336334 23467 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.336226 21964 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:10.335438 23668 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.337661 23642 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.338140 23642 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:10.338400 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:10.338824 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.339051 23642 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.339614 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.334471 23766 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.340066 23379 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.340263 22584 raft_consensus.cc:2368] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5.
I20260709 12:10:10.340548 23379 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:10.340955 23740 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.341364 23379 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.341866 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.342541 22579 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:10.342762 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.343330 23607 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.343556 22576 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:10.343839 23607 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:10.344525 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.344730 23607 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.345803 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.345741 23467 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.340812 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.347867 21967 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:10.348132 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:10.345147 22578 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:10.351156 21999 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:10.358613 22580 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:10.354214 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.355973 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:10.359900 22583 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:10:10.356067 21967 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:10.361591 21967 leader_election.cc:400] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5.
I20260709 12:10:10.362094 21967 leader_election.cc:403] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:10.364845 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.351747 23702 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.368368 23702 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.351480 23605 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.368028 22575 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:10.368749 23702 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.371555 23767 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:10.372115 23467 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.372385 23759 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:10.372951 23759 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.375775 23759 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.376151 23740 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.358773 23748 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.377599 21997 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:10.381007 23555 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:10.382581 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 99622.1us
W20260709 12:10:10.389824 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.358076 23695 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.389007 21817 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:10.404130 21817 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:10.406320 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.364121 23729 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.364285 23747 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.420909 21967 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:10.405179 21817 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:10.417497 21918 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:10.422209 21918 pending_rounds.cc:85] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 2
I20260709 12:10:10.432472 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.433133 21926 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.437196 22582 raft_consensus.cc:2410] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:10.437062 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.437758 21919 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.437914 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:10.438315 23695 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.438520 23645 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.428395 23740 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.439141 23645 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:10.439647 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.440222 21925 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.441291 23736 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:10.428440 23723 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.019s
W20260709 12:10:10.442680 23723 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.005s	sys 0.019s
I20260709 12:10:10.442934 23723 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:10.443827 23723 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.444299 23705 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:10.439594 23645 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.438630 21996 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.372047 23767 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.422621 21918 pending_rounds.cc:107] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:10.414580 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.416061 23614 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.419469 23690 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:10.456555 23554 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.460363 21918 raft_consensus.cc:2889] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:10.416566 23467 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:10.462275 22576 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:10:10.468874 23605 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:10.461241 23698 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.432060 23748 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.418818 23639 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:10:10.439496 23740 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.430189 23555 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:10.459966 23695 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:10.485581 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 203775us
I20260709 12:10:10.468935 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.473453 23614 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:10.479401 23690 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:10.500336 21996 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:10.500710 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:10.500993 23690 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.480217 23554 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.503047 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.503520 21845 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:10.504191 23554 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.504684 23554 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:10.505178 23554 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.505687 23747 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5.
I20260709 12:10:10.497572 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.506562 21850 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:10.506631 23614 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.507447 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.507884 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.508574 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.487157 23698 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.492202 23748 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:10.499631 23740 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:10.496753 23774 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:10.508759 23614 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.593211 23555 consensus_queue.cc:1243] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:10:10.628994 23734 log.cc:927] Time spent T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 1.033s	user 0.000s	sys 0.003s
I20260709 12:10:10.629508 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:10.630473 22581 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:10.630669 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1717) took 1991 ms. Trace:
I20260709 12:10:10.511831 23645 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.636143 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.652577 21850 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:10.637171 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.637960 21926 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:10.656642 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.657742 21926 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:10.643272 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 506178us
I20260709 12:10:10.600292 23767 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.664381 23555 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:10.680402 23554 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.680616 23783 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.681181 23783 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.683295 23783 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.684121 21919 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:10.684813 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:10.685145 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.687131 23645 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.688798 23604 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:10.691251 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.691761 23555 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:10.633246 23639 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.692684 23639 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:10.692777 23555 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.693958 23555 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.693593 23639 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.496464 23702 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.663151 23605 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:10.508942 23695 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:10.689718 23604 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.698666 23695 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.675369 23781 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:10.699645 23781 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.700492 23604 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.701756 23781 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.702286 21925 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:10.663534 23711 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.703076 23711 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.703473 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.704133 21925 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.705106 23698 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.631230 21920 rpcz_store.cc:276] 0709 12:10:08.639610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.680791 (+ 41181us) service_pool.cc:224] Handling call
0709 12:10:09.218182 (+537391us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:09.218448 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:09.310040 (+ 91592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:09.310087 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:09.321106 (+ 11019us) log.cc:844] Serialized 26 byte log entry
0709 12:10:09.458631 (+137525us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:09.458687 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.459682 (+   995us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:10.496396 (+1036714us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:10.630344 (+133948us) raft_consensus.cc:1685] finished
0709 12:10:10.630375 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:10.630568 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91096,"raft.queue_time_us":92533,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":9259,"spinlock_wait_cycles":10706048,"thread_start_us":117754,"threads_started":1,"wal-append.queue_time_us":192506}
I20260709 12:10:10.705814 21918 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:10.706485 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.706990 21920 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.707171 23668 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.707654 23668 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:10.709645 23668 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:10.710561 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:10.711412 22547 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.571s (SENT) [suppressed 15 similar messages]
I20260709 12:10:10.686335 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:10.719926 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1753) took 1207 ms. Trace:
I20260709 12:10:10.720363 21994 rpcz_store.cc:276] 0709 12:10:09.512420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.928318 (+415898us) service_pool.cc:224] Handling call
0709 12:10:09.928713 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.970717 (+ 42004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.719689 (+748972us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b54002364d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:10.719865 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89001344}
I20260709 12:10:10.722070 23748 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:10.732614 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.749030 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:10.757210 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.758527 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 249) took 1189 ms. Trace:
I20260709 12:10:10.758961 21844 rpcz_store.cc:276] 0709 12:10:09.569563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.948943 (+379380us) service_pool.cc:224] Handling call
0709 12:10:09.949302 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.161351 (+212049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.758256 (+596905us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54003e17d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:10.758466 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474543872}
I20260709 12:10:10.762835 21920 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:10.763479 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.786639 21927 raft_consensus.cc:2368] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4.
W20260709 12:10:10.795668 21849 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1401) took 3434 ms (client timeout 1765 ms). Trace:
W20260709 12:10:10.808581 21849 rpcz_store.cc:269] 0709 12:10:07.352382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.394702 (+ 42320us) service_pool.cc:224] Handling call
0709 12:10:07.856472 (+461770us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76eee 000000000036eb39 00007f3be9cea1e0 00007f3be9db30c4 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:09.349146 (+1492674us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b54000e9aa0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d12dc0 00007f3be4d9ee18 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:10.757920 (+1408774us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000933d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:10.786268 (+ 28348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523261312}
I20260709 12:10:10.779230 23533 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:10.764818 23719 raft_consensus.cc:3055] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.810765 22584 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:10.873390 21967 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:11.005968 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.994988 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.857079 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.873591 22579 raft_consensus.cc:1240] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:10.982529 23723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.019s
I20260709 12:10:11.016479 21926 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
W20260709 12:10:10.889425 21924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.001s	sys 0.012s
W20260709 12:10:11.007449 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 134184us
I20260709 12:10:11.020795 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:10.810309 23702 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:10.803663 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:11.030026 22584 raft_consensus.cc:3055] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:11.004065 23767 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.000308 23781 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:11.004302 23777 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:11.035581 21925 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:11.057368 23777 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.058530 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:11.058593 21925 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:11.059481 22582 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:10.997673 23719 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:11.058723 22575 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.060694 21925 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:11.060885 23719 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.061530 22582 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:11.015300 23723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.006s	sys 0.020s
W20260709 12:10:11.038471 21924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.002s	sys 0.012s
I20260709 12:10:11.039433 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.040395 21967 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:11.063548 23781 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.064827 23740 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.065230 23740 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:11.065618 23740 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.065825 23781 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:11.067514 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:11.044703 21817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.025s
I20260709 12:10:11.052250 22584 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:10:11.068959 21817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.009s	sys 0.025s
I20260709 12:10:11.015545 23645 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.055233 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.034091 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:11.098001 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 247) took 1529 ms. Trace:
I20260709 12:10:11.059947 23777 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:11.099102 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.099504 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:11.068570 23767 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:11.102216 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 697049us
I20260709 12:10:11.103315 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.103588 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.103219 22584 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.104578 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.122961 21850 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:11.101145 23748 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.197968 21918 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:10:11.107901 21818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.000s	sys 0.021s
I20260709 12:10:11.112200 21847 rpcz_store.cc:276] 0709 12:10:09.569031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.097185 (+1528154us) service_pool.cc:224] Handling call
0709 12:10:11.097492 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.097662 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.097696 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.097749 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:11.097779 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.097831 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.097945 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.070361 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.123241 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 334) took 1663 ms. Trace:
W20260709 12:10:11.216192 21818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.021s
I20260709 12:10:11.123863 22582 raft_consensus.cc:1217] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 12:10:11.218348 22582 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:11.124069 22584 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:11.127890 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 416480us
I20260709 12:10:11.197270 21748 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 4 to 5, term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to <none>, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 3 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:10:11.218624 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 739372us
I20260709 12:10:11.235939 22584 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:10:11.236635 22584 pending_rounds.cc:85] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 4
I20260709 12:10:11.237012 22584 pending_rounds.cc:107] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:11.110853 23645 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:11.219892 23696 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:11.172080 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 49452us
I20260709 12:10:11.172596 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.243078 21993 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:11.244349 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.246068 21993 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:11.171622 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.121364 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:11.173664 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.124437 23668 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:11.174911 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:11.175310 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:11.249827 22001 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.175519 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:11.253098 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:11.176237 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:11.254644 21992 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:11.177197 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.179152 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:11.256193 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 77125.5us
I20260709 12:10:11.256844 21966 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:11.101742 23747 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:11.184574 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 201) took 1112 ms. Trace:
I20260709 12:10:11.261030 21923 rpcz_store.cc:276] 0709 12:10:10.072288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.073212 (+   924us) service_pool.cc:224] Handling call
0709 12:10:11.184404 (+1111192us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54002e6654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:11.184521 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266073344}
I20260709 12:10:11.185546 23730 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:11.187743 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:11.187891 23767 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:11.191102 23777 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:11.215996 21998 rpcz_store.cc:276] 0709 12:10:09.456344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.680972 (+224628us) service_pool.cc:224] Handling call
0709 12:10:09.681254 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.796051 (+114797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:09.796086 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:09.796132 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:09.796158 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.119359 (+1323201us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54002c6d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:11.119435 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.119573 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263589632}
I20260709 12:10:11.123274 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.276223 21920 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
W20260709 12:10:11.276549 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.216002 21926 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
W20260709 12:10:11.106093 23773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.010s	sys 0.033s
I20260709 12:10:11.221282 22547 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:11.229055 21748 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 3 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:11.221684 21749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58722 (request call id 270) took 3358 ms. Trace:
I20260709 12:10:11.270942 21817 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:11.198151 23748 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:11.231431 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.237397 22584 raft_consensus.cc:2889] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:11.221977 23801 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:11.254482 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.182917 22575 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:11.183205 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 196) took 1116 ms. Trace:
I20260709 12:10:11.258301 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:11.259860 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.263288 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.301280 21848 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:11.263450 21997 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
W20260709 12:10:11.302134 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.269913 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 82273.2us
I20260709 12:10:11.274837 22001 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:11.269819 23668 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:11.278580 23379 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:11.250579 23645 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.285161 21893 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:11.283914 23772 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.296005 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.269469 23684 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:11.279403 23773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.011s	sys 0.033s
I20260709 12:10:11.274492 23607 raft_consensus.cc:2764] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:10:11.278003 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56801.6us
I20260709 12:10:11.275359 21995 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
W20260709 12:10:11.296294 23756 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:10:11.255112 23696 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.291055 23776 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.290377 23748 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.287134 23730 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.284368 21817 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:11.358441 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 74132.3us
I20260709 12:10:11.312600 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.313077 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.314065 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.360450 21923 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:11.292742 21849 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:11.321748 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:11.323396 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.275530 23781 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:10:11.324577 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:11.366762 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:11.338513 23762 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.327154 23379 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:11.334340 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.376861 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.336158 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.277797 21749 rpcz_store.cc:276] 0709 12:10:07.863272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.866689 (+  3417us) service_pool.cc:224] Handling call
0709 12:10:11.221624 (+3354935us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:08.863330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:08.864006 (+   676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:08.864051 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:10:08.864063 (+    12us) tablet.cc:662] Decoding operations
0709 12:10:09.094051 (+229988us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.094164 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.094206 (+    42us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:09.095214 (+  1008us) tablet.cc:701] Row locks acquired
0709 12:10:09.095270 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:10:09.095505 (+   235us) write_op.cc:270] Start()
0709 12:10:09.095691 (+   186us) write_op.cc:276] Timestamp: P: 1783599009095434 usec, L: 0
0709 12:10:09.095736 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.096660 (+   924us) log.cc:844] Serialized 3257 byte log entry
0709 12:10:09.635369 (+538709us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.810792 (+175423us) write_op.cc:301] APPLY: starting
0709 12:10:09.810892 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.811137 (+   245us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.817907 (+  6770us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:09.933573 (+115666us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:09.933890 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:09.933948 (+    58us) write_op.cc:312] APPLY: finished
0709 12:10:09.934319 (+   371us) log.cc:844] Serialized 65 byte log entry
0709 12:10:09.934532 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.934689 (+   157us) write_op.cc:454] Released schema lock
0709 12:10:09.934760 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:09.935179 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.935207 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":153772,"apply.run_cpu_time_us":4706,"apply.run_wall_time_us":124377,"num_ops":8,"prepare.queue_time_us":169704,"prepare.run_cpu_time_us":31415,"prepare.run_wall_time_us":577792,"raft.queue_time_us":40703,"raft.run_cpu_time_us":40653,"raft.run_wall_time_us":82722,"replication_time_us":539463,"thread_start_us":552601,"threads_started":4,"wal-append.queue_time_us":345992,"wal-append.run_cpu_time_us":16053,"wal-append.run_wall_time_us":1490835}]]}
I20260709 12:10:11.336566 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:11.379390 22547 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:11.300444 23702 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.319603 23555 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.386623 23555 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.387029 23555 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.387876 23721 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:11.388839 23796 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:10:11.376062 23379 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.346261 23541 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:11.347880 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.286057 23777 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.325881 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:11.362552 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:11.335129 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:11.344769 23642 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:11.410562 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:11.408623 22584 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:11.411324 21921 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:11.301836 23801 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.355564 23776 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.349741 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.382820 23689 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:11.382928 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:11.383773 23397 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:11.383664 23702 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:11.385222 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 126973us
I20260709 12:10:11.299655 21924 rpcz_store.cc:276] 0709 12:10:10.067197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.070014 (+  2817us) service_pool.cc:224] Handling call
0709 12:10:10.073314 (+  3300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.166520 (+ 93206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:10.303736 (+137216us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.062838 (+759102us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.062893 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:11.062934 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.182905 (+119971us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b54001a4d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:11.182960 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.183125 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155683,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":58,"raft.queue_time_us":99,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":209835648,"thread_start_us":856895,"threads_started":2,"wal-append.queue_time_us":789615}
I20260709 12:10:11.385860 23554 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:11.359104 21845 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:11.396108 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:11.483208 21926 raft_consensus.cc:2393] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:11.319977 23684 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:11.487177 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 120546us
I20260709 12:10:11.402585 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1747) took 1929 ms. Trace:
I20260709 12:10:11.396327 23624 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.396662 23706 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.437018 23777 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:11.391484 23772 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:11.435302 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 150698us
I20260709 12:10:11.442869 21893 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:11.396662 23767 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:11.512420 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 69639.6us
I20260709 12:10:11.366325 23730 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.385440 23627 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:11.446851 21966 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:11.437776 23784 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 12:10:11.453119 23795 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.272s	user 0.003s	sys 0.000s
W20260709 12:10:11.485952 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 121173us
I20260709 12:10:11.439190 23776 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.453472 23702 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:11.489859 22000 rpcz_store.cc:276] 0709 12:10:09.472762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.761164 (+288402us) service_pool.cc:224] Handling call
0709 12:10:09.761518 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:09.956316 (+194798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:09.956346 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:09.956833 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:10:10.098063 (+141230us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:10.098103 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.395070 (+1296967us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000d2854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:11.395112 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.395158 (+    46us) raft_consensus.cc:1685] finished
0709 12:10:11.395171 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.402521 (+  7350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":615,"raft.queue_time_us":731,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2493,"spinlock_wait_cycles":447119232,"thread_start_us":125448,"threads_started":1,"wal-append.queue_time_us":195943,"wal-append.run_cpu_time_us":1817,"wal-append.run_wall_time_us":1010754}
I20260709 12:10:11.399519 23607 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:11.443131 23762 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:11.422767 23642 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.516976 21815 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:11.554145 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 107394us
I20260709 12:10:11.396502 23668 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.568092 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:11.488492 23809 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.493054 23684 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.614457 23807 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:11.499966 23624 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.610474 21966 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:11.611235 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 228372us
I20260709 12:10:11.618091 22547 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:11.622786 23696 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:11.623399 23747 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.617240 21966 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:11.624414 23730 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:11.624946 23730 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.625181 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:11.626592 21964 leader_election.cc:400] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4.
I20260709 12:10:11.497056 23808 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.515455 23813 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.571010 23689 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:11.612540 23397 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.566731 23706 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:11.617344 23624 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:11.518870 23777 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:11.612999 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 44966.5us
I20260709 12:10:11.562563 23728 raft_consensus.cc:3055] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:11.568555 23627 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.635469 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:11.569979 23740 consensus_meta.cc:287] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.000s
I20260709 12:10:11.635654 23817 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:11.636382 23808 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.636499 23813 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.640992 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:11.663169 21848 raft_consensus.cc:2376] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3. Re-sending same reply.
I20260709 12:10:11.643090 23747 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.665508 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:11.626191 23702 consensus_queue.cc:1059] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:10:11.648591 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 131730us
I20260709 12:10:11.613234 23762 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.637436 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:11.659387 23379 consensus_queue.cc:1059] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:10:11.609086 23607 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.671722 23607 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:11.655202 23706 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:11.653403 23772 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.652346 23819 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:11.673169 23555 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.656358 23728 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:11.674593 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:11.667937 23773 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.657410 23804 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:11.668936 23806 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:10:11.623457 23809 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.656714 23777 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.665881 23747 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.666662 23397 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:11.705179 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.666370 23813 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.703819 23627 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:11.711714 23802 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:10:11.731663 21992 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.709556 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.706151 23706 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.677989 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:11.712278 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.708738 23814 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.714598 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.658255 23740 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.722523 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:11.666484 23541 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:11.727535 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:11.707445 21922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 195) took 1640 ms (client timeout 1571 ms). Trace:
I20260709 12:10:11.708067 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:11.730542 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.713811 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.708739 23819 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:11.699334 23689 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.728564 23747 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:11.736873 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 59002.1us
I20260709 12:10:11.771335 21998 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:11.736199 23728 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.772785 23825 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:11.772948 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50513.2us
I20260709 12:10:11.774196 23830 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:11.770427 21922 rpcz_store.cc:269] 0709 12:10:10.066827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.084557 (+ 17730us) service_pool.cc:224] Handling call
0709 12:10:11.707237 (+1622680us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54002e7054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:11.707386 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238791552}
W20260709 12:10:11.733011 21851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1511) took 2224 ms (client timeout 2289 ms). Trace:
W20260709 12:10:11.777351 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 75867.1us
I20260709 12:10:11.702592 23801 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:11.720300 23702 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.786737 21964 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:11.765739 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.780489 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.701556 23772 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.770547 23814 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.787277 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:11.734493 23816 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:11.766819 21845 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:11.777292 21993 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:11.724972 23773 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.786507 23799 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:11.834601 23803 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.310s	user 0.000s	sys 0.005s
W20260709 12:10:11.844000 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 57341.6us
I20260709 12:10:11.842635 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.766016 23397 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.828238 23642 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:11.848076 23814 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.850638 23816 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.718619 23804 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.830317 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:11.788362 23825 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:11.839686 23728 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.870851 21844 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
I20260709 12:10:11.819911 23730 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:11.840056 23702 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:11.872749 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.843986 23817 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:11.877130 21964 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:11.868916 21995 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:11.849581 23801 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:11.885733 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 55502.7us
I20260709 12:10:11.833740 23820 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:11.845885 23627 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:10:11.852176 21849 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:11.895676 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.896202 22000 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:11.886384 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 428) took 1535 ms. Trace:
I20260709 12:10:11.886463 23825 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.898097 23702 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.898480 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.888782 23624 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.889736 23819 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.878491 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.907212 23833 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.913036 23839 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.913443 23607 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:11.871624 23397 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:11.840209 21851 rpcz_store.cc:269] 0709 12:10:09.508835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.724859 (+216024us) service_pool.cc:224] Handling call
0709 12:10:11.720002 (+1995143us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b540011dfd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:11.729439 (+  9437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070333184}
I20260709 12:10:11.916464 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:11.919134 23831 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:10:11.919612 23777 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:11.848325 23830 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.922578 23555 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:11.972332 23829 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:11.950578 23624 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:11.972676 23684 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:11.973445 23624 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:11.977476 23826 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:10:11.978009 23772 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:11.962687 23756 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.978327 23684 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:11.929888 23817 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.979858 23624 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:11.932773 23836 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.963079 23397 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.982935 23836 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:11.984894 23773 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:11.985153 23836 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:11.988104 23711 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:11.962953 23762 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:12.004119 23830 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:11.922946 22577 rpcz_store.cc:276] 0709 12:10:10.350533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.351971 (+  1438us) service_pool.cc:224] Handling call
0709 12:10:11.786249 (+1434278us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76eee 000000000036eb39 00007f3be9cea1e0 00007f3be9db30c4 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:11.824211 (+ 37962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.846660 (+ 22449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.849106 (+  2446us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.852368 (+  3262us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:11.869169 (+ 16801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.876348 (+  7179us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.883393 (+  7045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5932928}
I20260709 12:10:11.992617 23740 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:12.019002 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:11.991596 23816 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:11.966440 23833 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:12.014390 23809 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:12.051120 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 437) took 1395 ms. Trace:
I20260709 12:10:12.002286 23808 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:12.051678 22580 rpcz_store.cc:276] 0709 12:10:10.655370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.655536 (+   166us) service_pool.cc:224] Handling call
0709 12:10:12.050116 (+1394580us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:12.050428 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.050670 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.050709 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.050769 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:12.050813 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.050891 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.051043 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70159104}
I20260709 12:10:12.131846 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 436) took 1492 ms. Trace:
I20260709 12:10:12.155843 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:12.156221 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:12.156826 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:12.158273 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:12.132462 22581 rpcz_store.cc:276] 0709 12:10:10.639039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.651032 (+ 11993us) service_pool.cc:224] Handling call
0709 12:10:12.131015 (+1479983us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:12.131239 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.131458 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.131493 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.131541 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:12.131589 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.131659 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.131779 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67956992}
I20260709 12:10:12.166558 21926 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:12.168618 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:12.169637 21926 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:12.160593 23804 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:12.178798 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:12.183598 21926 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:12.069932 23776 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:12.207346 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 251332us
I20260709 12:10:12.177943 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:12.219362 23804 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:12.229212 23804 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:12.231524 23790 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 1.050s	user 0.005s	sys 0.005s
I20260709 12:10:12.169384 23814 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:12.253532 23783 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:12.254112 23783 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:12.256524 23783 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:12.484377 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:12.348627 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 140564us
I20260709 12:10:12.406263 23533 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.340238 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:12.343052 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:12.437886 21748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42850 (request call id 204) took 4919 ms. Trace:
I20260709 12:10:12.539440 21926 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:12.339771 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 462721us
W20260709 12:10:12.347966 23748 consensus_meta.cc:287] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.983s	user 0.010s	sys 0.001s
I20260709 12:10:12.350461 22000 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:12.505223 21966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.022s	sys 0.070s
I20260709 12:10:12.465443 21999 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.533601 22547 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:12.534844 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:12.342741 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:12.336107 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.400712 23747 consensus_meta.cc:287] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
W20260709 12:10:12.402911 23813 consensus_meta.cc:287] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 12:10:12.575388 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:12.356510 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:12.316148 22579 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:12.326373 23719 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.365238 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:12.563927 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:12.373255 23577 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.539744 21921 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.697902 21921 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:12.616989 23817 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.378531 23804 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:12.619396 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 84630.2us
I20260709 12:10:12.701808 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:12.584511 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 51001.1us
W20260709 12:10:12.583217 21966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.022s	sys 0.077s
W20260709 12:10:12.703256 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 802920us
I20260709 12:10:12.388384 23639 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.706642 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:12.317273 23844 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.497076 23781 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.344112 23809 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.378242 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:12.319689 23833 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:12.344556 23816 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:12.662509 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.340817 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:12.386499 23547 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:12.660756 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:12.659771 22000 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:12.680950 22582 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:12.340560 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:12.373090 23814 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:12.560457 21748 rpcz_store.cc:276] 0709 12:10:07.518698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.613781 (+ 95083us) service_pool.cc:224] Handling call
0709 12:10:12.437779 (+4823998us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:11.431760 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:11.432498 (+   738us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:11.432538 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:10:11.432563 (+    25us) tablet.cc:662] Decoding operations
0709 12:10:11.432982 (+   419us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:11.433061 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:11.433096 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:11.433428 (+   332us) tablet.cc:701] Row locks acquired
0709 12:10:11.433445 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:11.433584 (+   139us) write_op.cc:270] Start()
0709 12:10:11.433707 (+   123us) write_op.cc:276] Timestamp: P: 1783599011433542 usec, L: 0
0709 12:10:11.433729 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:11.434375 (+   646us) log.cc:844] Serialized 879 byte log entry
0709 12:10:11.668300 (+233925us) op_driver.cc:464] REPLICATION: finished
0709 12:10:11.819874 (+151574us) write_op.cc:301] APPLY: starting
0709 12:10:11.828495 (+  8621us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:11.845711 (+ 17216us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:11.851568 (+  5857us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:11.874148 (+ 22580us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:11.874343 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:11.874427 (+    84us) write_op.cc:312] APPLY: finished
0709 12:10:11.874706 (+   279us) log.cc:844] Serialized 29 byte log entry
0709 12:10:11.874913 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:11.875028 (+   115us) write_op.cc:454] Released schema lock
0709 12:10:11.875081 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:11.875538 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:11.875580 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1012344,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":65958,"apply.run_cpu_time_us":2538,"apply.run_wall_time_us":88422,"num_ops":2,"prepare.queue_time_us":126806,"prepare.run_cpu_time_us":21160,"prepare.run_wall_time_us":65964,"raft.queue_time_us":64025,"raft.run_cpu_time_us":3362,"raft.run_wall_time_us":53575,"replication_time_us":234457,"thread_start_us":238465,"threads_started":4,"wal-append.queue_time_us":63179}]]}
I20260709 12:10:12.331439 23695 raft_consensus.cc:3055] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:12.538224 23819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.013s	sys 0.102s
W20260709 12:10:12.615254 21736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d50c36e857cb4e33997aee7e5dd39447 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cffb5c192e144f7caa7b94271976ed42 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:12.454960 21747 catalog_manager.cc:5697] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 2 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:12.536273 23706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.020s	sys 0.047s
I20260709 12:10:12.273645 21924 raft_consensus.cc:2376] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4. Re-sending same reply.
I20260709 12:10:12.305495 23835 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:12.539558 21920 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:12.639449 23668 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:12.693835 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:12.574534 23776 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:12.767261 23706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.022s	sys 0.059s
W20260709 12:10:12.695724 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 131931us
I20260709 12:10:12.857494 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:12.862012 22583 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.862068 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:12.826783 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:12.617946 23824 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:12.864161 23848 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.556s	user 0.007s	sys 0.002s
I20260709 12:10:12.864272 23824 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.332175 23702 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:12.870364 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:12.710181 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:12.495940 23397 consensus_meta.cc:287] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.005s
I20260709 12:10:12.444474 23721 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:12.701838 23645 consensus_meta.cc:287] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.377s	user 0.009s	sys 0.004s
I20260709 12:10:12.651871 23748 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.697559 23831 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:12.699124 23730 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.717499 21921 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.885174 21921 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.382887 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:12.739295 21998 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:12.759346 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.873436 21996 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.016s	sys 0.050s
I20260709 12:10:12.757771 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:12.887091 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:12.887742 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 130048us
I20260709 12:10:12.888553 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:12.887902 21998 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:12.803217 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:12.890763 22582 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:12.766078 21747 catalog_manager.cc:5697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 4 to 5, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 5 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:12.575600 23533 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:12.763964 23819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.023s	sys 0.103s
I20260709 12:10:12.824787 22580 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 2: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:12.690721 21926 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:12.895485 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:12.804658 21736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 300638us
I20260709 12:10:12.826771 23668 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:12.767431 23820 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:10:12.764263 23695 raft_consensus.cc:740] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:12.717027 23813 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.827282 23835 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:12.717187 23747 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:12.828750 23740 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:12.829774 23843 log.cc:927] Time spent T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:10:12.830569 23853 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:10:12.738046 23547 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.882635 23645 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.899611 23776 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.758860 23844 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.756192 23817 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.930675 21925 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 4. Ops: [2.5-2.5]
I20260709 12:10:12.838575 22575 raft_consensus.cc:2410] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:12.764602 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:12.804235 23849 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:12.803221 23816 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.910099 23706 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.701524 23577 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:12.863400 21920 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.871301 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:12.734859 23781 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:12.845366 23728 consensus_meta.cc:287] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.956s	user 0.008s	sys 0.001s
I20260709 12:10:12.851826 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:12.851048 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:12.884392 21997 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:12.893908 22001 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.898898 21998 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:12.889099 21996 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.016s	sys 0.050s
I20260709 12:10:12.880056 23397 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:12.830821 23845 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:10:12.897044 23804 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:12.719882 23809 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:12.930658 21921 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:12.886834 23721 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.886049 23831 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:12.938644 21992 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.920058 23776 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.035452 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:12.991822 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:12.914345 23740 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.036525 21852 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
W20260709 12:10:13.040495 21993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.017s	sys 0.026s
W20260709 12:10:13.041034 21993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.017s	sys 0.026s
W20260709 12:10:13.041095 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 462725us
I20260709 12:10:13.013661 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.042627 23804 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:12.939803 23807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.018s	sys 0.028s
I20260709 12:10:13.036650 21847 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.050034 21921 pending_rounds.cc:85] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 5
I20260709 12:10:13.050362 21921 pending_rounds.cc:107] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:13.053105 21921 raft_consensus.cc:2889] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:12.934077 23762 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.033s	sys 0.052s
I20260709 12:10:12.940490 23730 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.946559 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 442) took 1619 ms. Trace:
W20260709 12:10:13.044134 23846 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:10:12.963877 23824 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:13.052986 23807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.020s	sys 0.028s
I20260709 12:10:13.040755 23776 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.095214 21994 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:13.044363 23728 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.991132 22578 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
W20260709 12:10:13.086794 23762 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.040s	sys 0.061s
I20260709 12:10:13.099184 21920 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
W20260709 12:10:13.099936 21815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.019s	sys 0.015s
I20260709 12:10:13.085415 23793 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.087574 23730 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.108444 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:13.112071 21815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.019s	sys 0.015s
W20260709 12:10:13.125140 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.941267 23849 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.095575 23833 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:13.149850 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62765.5us
I20260709 12:10:13.098794 23577 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.091012 23852 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:13.170760 23852 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.107601 23533 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.173044 23852 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.100853 23824 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.173666 23747 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.173754 23824 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.091171 22575 rpcz_store.cc:276] 0709 12:10:11.321091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.324063 (+  2972us) service_pool.cc:224] Handling call
0709 12:10:12.378037 (+1053974us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:12.940299 (+562262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13416320}
I20260709 12:10:13.175982 23824 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.095707 23847 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:13.153442 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.176672 23847 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.145895 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1353) took 1432 ms. Trace:
I20260709 12:10:13.178647 23847 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:13.179610 23825 consensus_meta.cc:287] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 1.226s	user 0.013s	sys 0.000s
I20260709 12:10:13.180150 23825 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.180826 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 214) took 1025 ms. Trace:
I20260709 12:10:13.181223 21925 rpcz_store.cc:276] 0709 12:10:12.155097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.155241 (+   144us) service_pool.cc:224] Handling call
0709 12:10:12.169983 (+ 14742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.931472 (+761489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.180596 (+249124us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54003e62d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:13.180768 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748694784}
I20260709 12:10:13.182674 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 262) took 1341 ms. Trace:
I20260709 12:10:13.183043 21848 rpcz_store.cc:276] 0709 12:10:11.841732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.841938 (+   206us) service_pool.cc:224] Handling call
0709 12:10:11.842351 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:11.843163 (+   812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.843197 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:11.843725 (+   528us) log.cc:844] Serialized 52 byte log entry
0709 12:10:12.163930 (+320205us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:12.163966 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.164029 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.182477 (+1018448us) raft_consensus.cc:1685] finished
0709 12:10:13.182498 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.182620 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":376,"raft.queue_time_us":487,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":30113,"thread_start_us":284150,"threads_started":1,"wal-append.queue_time_us":498267}
I20260709 12:10:13.187168 23793 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.189962 23793 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.153223 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:13.194329 22547 leader_election.cc:336] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.571s (SENT)
W20260709 12:10:13.196138 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 125854us
I20260709 12:10:13.198303 21920 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:13.198495 23554 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:13.199332 23840 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.637s	user 0.002s	sys 0.000s
I20260709 12:10:13.201692 23740 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.202328 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:13.202342 23833 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.203610 23804 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.204547 23813 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.204687 22577 raft_consensus.cc:1240] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.205346 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1358) took 1486 ms. Trace:
I20260709 12:10:13.207305 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1541) took 1477 ms. Trace:
I20260709 12:10:13.177852 21996 rpcz_store.cc:276] 0709 12:10:11.713081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.719530 (+  6449us) service_pool.cc:224] Handling call
0709 12:10:11.765676 (+ 46146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.766152 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.766185 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.766853 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.203202 (+436349us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:13.022506 (+819304us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.088862 (+ 66356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.095497 (+  6635us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.096239 (+   742us) raft_consensus.cc:1685] finished
0709 12:10:13.100091 (+  3852us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.109096 (+  9005us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2166,"prepare.queue_time_us":884861,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":34272,"raft.queue_time_us":1624,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6499,"thread_start_us":1067547,"threads_started":2,"wal-append.queue_time_us":926268}
I20260709 12:10:13.207649 21846 rpcz_store.cc:276] 0709 12:10:11.729563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.729732 (+   169us) service_pool.cc:224] Handling call
0709 12:10:11.767268 (+ 37536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.767503 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.767539 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.768047 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.169017 (+400970us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:12.169052 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.169119 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.198733 (+1029614us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:13.207035 (+  8302us) raft_consensus.cc:1685] finished
0709 12:10:13.207056 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.207252 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245832576,"thread_start_us":328965,"threads_started":1,"wal-append.queue_time_us":575138}
I20260709 12:10:13.170755 23721 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.210069 22575 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.211380 23831 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.212694 21995 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:13.214288 23781 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.215664 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 446) took 1553 ms. Trace:
I20260709 12:10:13.216012 22584 rpcz_store.cc:276] 0709 12:10:11.662612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.663038 (+   426us) service_pool.cc:224] Handling call
0709 12:10:11.674182 (+ 11144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.725214 (+ 51032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.725250 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.730005 (+  4755us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.176537 (+446532us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:12.176581 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.176699 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.865267 (+688568us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:13.215399 (+350132us) raft_consensus.cc:1685] finished
0709 12:10:13.215418 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.215602 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60351,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":41989,"spinlock_wait_cycles":15518464,"thread_start_us":440180,"threads_started":2,"wal-append.queue_time_us":916548}
I20260709 12:10:13.219168 23833 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:12.966143 23695 consensus_queue.cc:260] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.166772 21921 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:13.168242 23547 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:13.233438 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 363171us
I20260709 12:10:13.219357 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.142015 23817 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:12.966055 23668 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.223009 22584 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.206118 22001 rpcz_store.cc:276] 0709 12:10:11.719270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.720177 (+   907us) service_pool.cc:224] Handling call
0709 12:10:11.733463 (+ 13286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.989043 (+1255580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.205152 (+216109us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002d0fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:13.205296 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668278016}
I20260709 12:10:13.225765 21847 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:13.224740 22583 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
W20260709 12:10:13.144861 23843 log.cc:927] Time spent T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:13.229815 21924 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:13.240283 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 378283us
W20260709 12:10:13.231173 22549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.015s	sys 0.037s
W20260709 12:10:13.253535 22549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.015s	sys 0.037s
W20260709 12:10:13.254280 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 552522us
I20260709 12:10:13.254485 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:13.255053 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:13.241334 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 527429us
I20260709 12:10:13.234262 23702 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.150569 23748 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.144464 23730 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.247736 21967 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:13.220782 23825 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:13.208854 23719 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 12:10:13.204715 23777 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:13.256839 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:13.239622 21818 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:13.250667 23740 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:13.260949 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.261260 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:13.283627 21997 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
I20260709 12:10:13.284456 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:13.232003 23711 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.279557 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:13.246941 23695 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.198328 23482 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:10:13.244354 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 445) took 1917 ms. Trace:
I20260709 12:10:13.253785 22576 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:13.259269 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.251816 23785 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.290459 22001 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.292178 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.306838 21997 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:13.295264 22577 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.259886 23831 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.272961 23645 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.282907 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1762) took 1015 ms. Trace:
I20260709 12:10:13.303380 21918 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:13.250013 23817 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.282538 23748 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.289322 23816 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.287949 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.319559 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.327888 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.334829 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.308025 23831 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:13.302495 23690 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.293473 23862 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.367362 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.290992 23777 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.334676 23772 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.382066 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:13.383814 21919 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.384665 23728 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.387084 23706 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:13.387663 23706 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.388146 23772 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:13.388672 23772 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.291522 23740 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.391203 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 216) took 1235 ms. Trace:
I20260709 12:10:13.391687 21918 rpcz_store.cc:276] 0709 12:10:12.155728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.155894 (+   166us) service_pool.cc:224] Handling call
0709 12:10:13.391002 (+1235108us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540013abd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:13.391133 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2608662912}
I20260709 12:10:13.392244 23740 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.301182 23711 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:13.394968 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.381274 23816 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.396972 23816 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:13.397439 23816 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.377370 23825 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:13.399798 23825 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:13.400434 23859 log.cc:927] Time spent T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:10:13.368079 23645 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.406577 21992 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.413692 22001 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:13.425477 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.428337 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.432132 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.434986 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.435321 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.437378 21850 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:13.439743 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.379130 23831 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.334250 23785 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.379299 23809 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.402403 23825 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.333870 21924 rpcz_store.cc:276] 0709 12:10:12.265088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.036645 (+771557us) service_pool.cc:224] Handling call
0709 12:10:13.095456 (+ 58811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.253111 (+157655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.280621 (+ 27510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:13.406170 23748 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.384657 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1757) took 1123 ms. Trace:
I20260709 12:10:13.403872 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 598) took 2851 ms. Trace:
I20260709 12:10:13.379527 21995 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:13.450771 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.402707 21845 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:13.419057 23835 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.437403 23719 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.302096 22579 rpcz_store.cc:276] 0709 12:10:11.325397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.337817 (+ 12420us) service_pool.cc:224] Handling call
0709 12:10:13.229039 (+1891222us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b5400451854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:13.242378 (+ 13339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894541184}
I20260709 12:10:13.404960 23645 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:13.470225 22582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.020s	sys 0.030s
W20260709 12:10:13.470806 22582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.020s	sys 0.030s
I20260709 12:10:13.415786 23690 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:13.336439 21843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "032f8014213a49d395c150ebc9f55752"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:13.461062 23547 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:13.460047 23748 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:13.496856 21892 leader_election.cc:336] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.765s (SENT)
I20260709 12:10:13.461267 23825 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:10:13.516687 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.481532 21818 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:13.543547 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62119.1us
I20260709 12:10:13.497447 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:13.596060 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 436752us
I20260709 12:10:13.597448 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:13.600289 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 103461us
I20260709 12:10:13.601632 23852 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.601799 23833 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:13.601653 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.602541 23833 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.604097 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:13.604848 23833 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.605378 23833 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.475382 23719 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.606690 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:13.496775 21843 raft_consensus.cc:606] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:13.458346 22576 rpcz_store.cc:276] 0709 12:10:10.552117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.571140 (+ 19023us) service_pool.cc:224] Handling call
0709 12:10:12.000293 (+1429153us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:13.231176 (+1230883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.309960 (+ 78784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.403580 (+ 93620us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400451850. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:13.403771 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2839589504}
W20260709 12:10:13.615060 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 367381us
I20260709 12:10:13.611658 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:13.617475 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:13.612936 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:13.619202 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:13.550840 23832 log.cc:927] Time spent T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.082s	user 0.003s	sys 0.006s
I20260709 12:10:13.495051 23748 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.620375 21923 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:13.542600 23835 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.596127 23861 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:13.623257 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.459385 21919 rpcz_store.cc:276] 0709 12:10:12.260913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.268435 (+  7522us) service_pool.cc:224] Handling call
0709 12:10:13.383322 (+1114887us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:13.383567 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.384344 (+   777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.384593 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48334720}
W20260709 12:10:13.626684 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.626784 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 430000us
I20260709 12:10:13.630862 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:13.631954 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:13.633038 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:13.494552 23547 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.615653 21843 raft_consensus.cc:614] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:13.633625 21817 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:13.635396 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 349537us
I20260709 12:10:13.621224 23533 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:13.639045 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 382274us
I20260709 12:10:13.639771 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:13.643510 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:13.644068 21844 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.645669 23698 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:13.646692 23614 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.630071 23852 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:13.646849 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.647416 23852 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.638185 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:13.648764 23690 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.649303 23690 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.649426 23730 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:13.649698 21736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d50c36e857cb4e33997aee7e5dd39447 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cffb5c192e144f7caa7b94271976ed42 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:13.650646 23781 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:13.651455 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:13.651772 23645 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.651914 23868 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.653237 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.647699 23821 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.655433 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:13.645130 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:13.657562 23777 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.658041 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.659835 23547 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.660162 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:13.661738 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:13.693668 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 48609.6us
I20260709 12:10:13.694180 21850 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:13.662480 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:13.695015 21964 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:13.695740 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.696718 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:13.649312 23852 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.662762 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 224) took 1480 ms. Trace:
I20260709 12:10:13.646981 23533 raft_consensus.cc:697] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:13.664038 21998 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:10:13.664896 23776 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.000s
I20260709 12:10:13.664844 23706 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.666162 23785 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:13.667162 23730 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.672125 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 449) took 1265 ms. Trace:
I20260709 12:10:13.676640 21844 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:13.677340 23868 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:13.688537 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.691088 21999 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:13.685722 23762 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:13.643343 23817 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.663542 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.716413 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.715368 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.724356 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.724013 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.704600 23547 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:13.726421 23547 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:13.716143 23776 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.726835 23547 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.728283 23776 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.728421 23844 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:13.729743 23858 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.527s	user 0.002s	sys 0.000s
I20260709 12:10:13.729945 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.715529 23698 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:13.731246 23698 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.732380 23397 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:13.733251 23698 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.733929 22001 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:13.734503 22580 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.734937 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.735626 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 450) took 1324 ms. Trace:
I20260709 12:10:13.736070 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.735975 22580 rpcz_store.cc:276] 0709 12:10:12.410990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.907921 (+496931us) service_pool.cc:224] Handling call
0709 12:10:12.918913 (+ 10992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.734881 (+815968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.735425 (+   544us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b5400548b54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:13.735575 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875252480}
I20260709 12:10:13.736994 22001 raft_consensus.cc:2393] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:13.737337 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1770) took 1386 ms. Trace:
I20260709 12:10:13.737754 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.737691 21993 rpcz_store.cc:276] 0709 12:10:12.351439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.351570 (+   131us) service_pool.cc:224] Handling call
0709 12:10:12.351976 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.373787 (+ 21811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.373846 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.374456 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.041663 (+667207us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.041734 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.041825 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.729188 (+687363us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:13.737063 (+  7875us) raft_consensus.cc:1685] finished
0709 12:10:13.737086 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.737282 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21340,"raft.queue_time_us":21477,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":1437,"spinlock_wait_cycles":43907968,"thread_start_us":638229,"threads_started":1,"wal-append.queue_time_us":799252}
I20260709 12:10:13.751292 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:13.698807 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 65250.9us
I20260709 12:10:13.707099 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 609) took 1090 ms. Trace:
I20260709 12:10:13.683154 23833 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.631393 23835 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.700991 21927 rpcz_store.cc:276] 0709 12:10:12.182013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.182176 (+   163us) service_pool.cc:224] Handling call
0709 12:10:12.182581 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.182974 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.183013 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.895712 (+712699us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b2c00000e98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:10:12.896088 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.314865 (+418777us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.314922 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.315014 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.662474 (+347460us) raft_consensus.cc:1685] finished
0709 12:10:13.662496 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.662706 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3726,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":19194,"spinlock_wait_cycles":8614784,"thread_start_us":418432,"threads_started":1,"wal-append.queue_time_us":724308}
I20260709 12:10:13.677291 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.693091 23690 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.695011 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:13.712837 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.715807 22582 rpcz_store.cc:276] 0709 12:10:12.406907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.906781 (+499874us) service_pool.cc:224] Handling call
0709 12:10:12.915185 (+  8404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.915471 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.915497 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.915950 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.471332 (+555382us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:13.471392 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.471485 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.671902 (+200417us) raft_consensus.cc:1685] finished
0709 12:10:13.671929 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.672068 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30549,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":17984,"thread_start_us":554990,"threads_started":1,"wal-append.queue_time_us":754476}
I20260709 12:10:13.746577 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.738770 21844 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:13.740196 23868 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.744552 23533 consensus_queue.cc:237] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.739347 22001 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:13.702940 21964 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:13.752763 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.752249 22584 rpcz_store.cc:276] 0709 12:10:12.616393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.286310 (+669917us) service_pool.cc:224] Handling call
0709 12:10:13.290633 (+  4323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.292705 (+  2072us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:13.644657 (+351952us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.706629 (+ 61972us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.706705 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.706775 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.706880 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.707030 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2440,"raft.queue_time_us":24871,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":364349,"threads_started":2}
I20260709 12:10:13.758173 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:13.886041 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 133681us
I20260709 12:10:13.903234 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:13.894874 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 176468us
I20260709 12:10:13.702960 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1760) took 1441 ms. Trace:
I20260709 12:10:13.748231 23719 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.915058 21994 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:13.910181 21920 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:13.910584 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:13.901665 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:13.916749 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.918557 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.916555 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:13.918618 22580 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:13.759325 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:13.921005 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 218130us
I20260709 12:10:13.919250 21999 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:13.922080 21964 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:13.911659 21926 rpcz_store.cc:276] 0709 12:10:12.261730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.905516 (+643786us) service_pool.cc:224] Handling call
0709 12:10:12.914401 (+  8885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.914635 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:13.308531 (+393896us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.702472 (+393941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.702568 (+    96us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.702632 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.702755 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.702890 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10437,"prepare.queue_time_us":715963,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":12695,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6757,"thread_start_us":756618,"threads_started":2}
I20260709 12:10:13.713768 23809 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.929769 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:13.931141 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:13.932489 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 210713us
I20260709 12:10:13.919436 21852 raft_consensus.cc:606] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:13.933501 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:13.934676 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:13.935516 22001 raft_consensus.cc:2393] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 2: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:13.938064 21817 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:13.865684 23831 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.931393 23809 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:13.783000 23867 log.cc:927] Time spent T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:10:13.748517 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:13.756135 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:13.782827 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet 279111025ee54aba83c27bba63339332 with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60614
I20260709 12:10:13.941346 23835 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:13.859310 23397 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.870313 23824 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:13.873745 22577 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.750556 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:13.951990 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:13.958246 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:13.957399 21817 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:13.961432 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:13.962278 21993 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:13.956103 23807 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.962098 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:13.971757 21999 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:13.973651 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 321544us
I20260709 12:10:13.986150 22580 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.987574 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:13.902774 23706 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:14.002048 22582 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:13.992461 21920 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:13.926152 23747 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.994086 21993 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.999776 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:13.967522 23645 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.936947 23819 consensus_queue.cc:1059] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:10:13.995193 23874 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.051880 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1786) took 1352 ms. Trace:
W20260709 12:10:14.029452 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 67450.7us
I20260709 12:10:14.036197 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.036607 21964 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:14.052309 22000 rpcz_store.cc:276] 0709 12:10:12.699384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.765749 (+ 66365us) service_pool.cc:224] Handling call
0709 12:10:12.766063 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.807199 (+ 41136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.807224 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.807648 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.264291 (+456643us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.264329 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.264393 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.051691 (+787298us) raft_consensus.cc:1685] finished
0709 12:10:14.051710 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.051826 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40783,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11640,"thread_start_us":437409,"threads_started":1,"wal-append.queue_time_us":811232}
I20260709 12:10:14.053634 21966 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:14.053954 21920 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:14.038160 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:13.756364 23762 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:13.761054 23772 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.995398 21919 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
W20260709 12:10:14.046738 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59257.1us
W20260709 12:10:14.048664 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 48961.1us
I20260709 12:10:13.998999 23689 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.029315 23837 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.046720 23695 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.074783 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.029726 23881 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.991044 23824 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.068420 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:14.081668 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:14.075477 21993 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:13.999192 23808 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:10:14.082248 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:14.070369 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.069185 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.063490 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1546) took 1350 ms. Trace:
I20260709 12:10:14.029440 23880 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.984926 23397 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.072489 22584 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.001617 23698 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:14.056584 23852 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.084879 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:14.064034 23577 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.063848 23728 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.087863 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.086982 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.063948 21843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:14.095710 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:14.074951 23837 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.069046 23875 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.067494 23885 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:14.038722 23614 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:10:14.067130 23844 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:14.067039 23730 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.098126 21999 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:14.102049 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.076853 23883 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.096690 23706 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.104020 22001 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.079909 23877 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.071825 23866 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:14.089956 23816 consensus_meta.cc:287] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.003s
I20260709 12:10:14.078572 23881 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:14.114774 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.115351 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:14.115803 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.115999 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1763) took 1850 ms. Trace:
I20260709 12:10:14.095139 23577 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:14.168139 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 52437.8us
I20260709 12:10:14.032590 23860 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.180s
I20260709 12:10:14.096613 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:14.077543 23781 consensus_queue.cc:1059] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:14.124290 21892 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:14.064862 23874 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.085865 23895 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.100425 23864 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.106840 23837 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:14.128937 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.080960 23695 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:13.894486 23814 raft_consensus.cc:2955] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:14.111888 21843 raft_consensus.cc:606] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:14.121251 23883 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.094533 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 420) took 1220 ms. Trace:
I20260709 12:10:14.112528 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.163439 21921 rpcz_store.cc:276] 0709 12:10:12.265384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.090987 (+825603us) service_pool.cc:224] Handling call
0709 12:10:13.091294 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.231644 (+140350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.115767 (+884123us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b54003606d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:14.115939 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172070144}
W20260709 12:10:14.178699 23899 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:14.147151 23877 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:14.085865 21851 rpcz_store.cc:276] 0709 12:10:12.713216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.725434 (+ 12218us) service_pool.cc:224] Handling call
0709 12:10:13.491999 (+766565us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:13.951839 (+459840us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76e9c 00007f3be1c76a5b 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:14.056162 (+104323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11593472}
I20260709 12:10:14.179121 23777 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.173560 23577 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.083148 23862 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:14.029526 23892 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 12:10:14.251058 23820 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.117274 23776 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.100129 23819 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:10:14.276338 23820 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.118194 23885 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:14.278004 23885 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:14.269448 23877 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.257715 22578 rpcz_store.cc:276] 0709 12:10:12.868348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.386923 (+518575us) service_pool.cc:224] Handling call
0709 12:10:13.387296 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.387540 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:13.702040 (+314500us) log.cc:844] Serialized 14 byte log entry
0709 12:10:14.049520 (+347480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.063259 (+ 13739us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:14.065148 (+  1889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.074435 (+  9287us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.088313 (+ 13878us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":555180,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":12604,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":13785,"thread_start_us":538227,"threads_started":2,"wal-append.queue_time_us":416259}
W20260709 12:10:14.261560 23879 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:10:14.281450 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1769) took 1837 ms. Trace:
I20260709 12:10:14.119143 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:14.281819 21925 rpcz_store.cc:276] 0709 12:10:12.443872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.182201 (+738329us) service_pool.cc:224] Handling call
0709 12:10:13.222557 (+ 40356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.232076 (+  9519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.232118 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:13.232536 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.674178 (+441642us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:13.674205 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.674254 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.281249 (+606995us) raft_consensus.cc:1685] finished
0709 12:10:14.281269 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.281395 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9324,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10987,"thread_start_us":422029,"threads_started":1,"wal-append.queue_time_us":825947}
I20260709 12:10:14.282869 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:14.283285 23711 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:14.283505 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:14.283953 23777 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.284284 21925 raft_consensus.cc:2393] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:14.284060 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.284762 21919 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:14.284989 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.285615 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:14.215806 23896 log.cc:927] Time spent T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:10:14.287370 23820 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:14.287595 23874 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.288802 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:14.289477 23695 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.289865 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:14.217031 23857 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 1.048s	user 0.005s	sys 0.000s
W20260709 12:10:14.216645 23893 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 12:10:14.217670 23898 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:14.267705 23772 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:14.216423 23809 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:14.224720 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.226331 23547 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.293573 23903 tablet_replica.cc:333] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:10:14.294565 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.295091 23547 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.163956 23881 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.295619 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.297062 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.297631 21996 raft_consensus.cc:1813] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Handling vote request from an unknown peer ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:14.298199 21996 raft_consensus.cc:2410] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:14.228299 23397 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:14.228421 23861 consensus_meta.cc:287] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.597s	user 0.005s	sys 0.002s
I20260709 12:10:14.311132 23861 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:14.228963 23900 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:14.311480 23877 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.121215 23844 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:14.313719 23877 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.313793 23844 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:14.121413 23730 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:14.315541 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:14.316138 23748 consensus_meta.cc:287] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.685s	user 0.011s	sys 0.000s
I20260709 12:10:14.316304 23730 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:14.215860 23894 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 12:10:14.238080 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 142528us
I20260709 12:10:14.317073 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:14.317924 23877 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:14.319269 23877 consensus_queue.cc:1059] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:14.239624 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 115416us
I20260709 12:10:14.305860 22547 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:14.322835 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.323580 22547 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.225241 23762 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:14.245486 21893 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:14.327280 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 81905.5us
I20260709 12:10:14.107738 23817 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:14.253401 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:14.328706 21848 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:14.264935 23849 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.242496 23719 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.164942 23835 consensus_queue.cc:1059] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:10:14.244055 23895 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.253985 23860 raft_consensus.cc:3055] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.285543 21964 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:14.340138 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 54680us
I20260709 12:10:14.258067 23883 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.165172 23816 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.114967 23875 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.226943 23824 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.285540 21925 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:14.292331 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.263512 21924 raft_consensus.cc:2368] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:14.292686 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.286288 21919 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.293334 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 414) took 1954 ms. Trace:
I20260709 12:10:14.296454 21921 raft_consensus.cc:2410] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:14.316704 23748 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:14.173238 23866 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:14.316190 21920 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:14.371137 21920 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:14.326700 21850 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:14.328644 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.266891 23864 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.325546 23772 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:14.342867 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 173788us
I20260709 12:10:14.333186 23820 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.257432 23831 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:14.340072 23895 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.356921 23849 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.378846 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:14.379841 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:14.380363 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:14.381327 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:14.342036 23860 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:14.341743 23689 raft_consensus.cc:3055] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.339823 23783 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.382133 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:14.362574 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:14.331885 23577 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:14.387516 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.378001 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:14.387451 21920 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:14.395105 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.395337 23748 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:14.396005 23902 log.cc:927] Time spent T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 12:10:14.396561 23901 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:10:14.386309 23820 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.386952 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 453) took 1952 ms. Trace:
I20260709 12:10:14.398989 23881 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.408331 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:14.387184 23711 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:14.409538 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 47049.4us
I20260709 12:10:14.414376 23866 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:14.415663 23816 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.416491 23860 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.389096 23849 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.420156 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.518782 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.370208 23719 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:14.426637 21997 raft_consensus.cc:2393] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:14.406450 23783 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.406527 23689 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:14.406857 23874 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.426860 21893 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.411441 23885 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.360821 22581 rpcz_store.cc:276] 0709 12:10:12.339451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.375907 (+ 36456us) service_pool.cc:224] Handling call
0709 12:10:12.388215 (+ 12308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.388730 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.388776 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.389447 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.899305 (+509858us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:12.899548 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.909779 (+ 10231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.216491 (+1306712us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:14.291807 (+ 75316us) raft_consensus.cc:1685] finished
0709 12:10:14.291829 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.293272 (+  1443us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1613,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":1680,"spinlock_wait_cycles":144924416,"thread_start_us":495131,"threads_started":1,"wal-append.queue_time_us":715258}
I20260709 12:10:14.407582 23837 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:14.504287 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 128503us
I20260709 12:10:14.515117 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:14.515781 23577 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:14.516949 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 188396us
W20260709 12:10:14.542887 23910 log.cc:927] Time spent T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:10:14.543421 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.432328 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:14.544029 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.545135 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.545812 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.546074 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.554168 21927 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:14.426960 23820 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.530584 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.532502 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:14.533571 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:14.387138 23864 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.532588 23730 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.520664 23849 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.436910 22582 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:14.546392 21993 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:14.547914 23837 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:14.548521 23844 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.537398 23711 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:14.549152 21918 raft_consensus.cc:2368] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:14.470817 23748 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.533916 23783 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.562755 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.564023 23885 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:14.569029 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 142239us
I20260709 12:10:14.535748 23874 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.656242 23874 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.656481 21893 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.535408 23702 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.658756 23702 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.570046 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:14.660616 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:14.661911 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:14.537087 23860 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.571394 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.577646 22576 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 1.
W20260709 12:10:14.578630 23914 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:14.427122 22575 rpcz_store.cc:276] 0709 12:10:12.432493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.175702 (+743209us) service_pool.cc:224] Handling call
0709 12:10:13.176078 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.210835 (+ 34757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.360635 (+1149800us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b5400790254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:14.384645 (+ 24010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77536000}
I20260709 12:10:14.582499 23852 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.583338 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1361) took 1325 ms. Trace:
I20260709 12:10:14.564826 21964 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:14.669144 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 104422us
I20260709 12:10:14.668836 21992 rpcz_store.cc:276] 0709 12:10:13.258425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.258547 (+   122us) service_pool.cc:224] Handling call
0709 12:10:13.406331 (+147784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.408453 (+  2122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.583085 (+1174632us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400221350. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:14.583264 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292107008}
I20260709 12:10:14.670323 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:14.670583 23702 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.670849 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.671250 21964 leader_election.cc:400] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:14.654872 23711 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.671554 23702 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.672169 23702 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.672564 23702 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.671563 21964 leader_election.cc:403] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:14.679191 23762 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.569188 23821 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.598325 22000 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:14.698298 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:14.699172 22000 raft_consensus.cc:2410] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:14.699426 23816 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.699908 23816 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:14.701061 22000 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:14.701902 23816 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:14.669243 23885 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.702569 23885 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.702986 23885 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.655191 23883 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:14.728264 23883 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:14.731076 23762 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:14.731882 23821 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.568437 23730 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:14.735034 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 78681.8us
I20260709 12:10:14.599661 23881 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.584571 23844 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.738430 23785 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.738855 23785 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:14.739346 23844 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.739637 23785 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.740664 23785 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:14.741382 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 170074us
I20260709 12:10:14.742535 23835 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.743149 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.744251 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.744661 23730 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.745249 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:14.734254 23689 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:14.745615 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1556) took 1044 ms. Trace:
I20260709 12:10:14.745999 21844 rpcz_store.cc:276] 0709 12:10:13.700883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.724111 (+ 23228us) service_pool.cc:224] Handling call
0709 12:10:14.745445 (+1021334us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b54003e0dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:14.745537 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31375232}
I20260709 12:10:14.746344 23689 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.599164 23748 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.741954 23852 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.738404 21992 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 1.
I20260709 12:10:14.575094 23912 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.750402 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:14.751081 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:14.757179 22583 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:14.757469 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:14.757967 21993 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.752588 21992 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.752920 23918 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.760217 23918 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.760558 23918 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.753770 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.762476 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.762657 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:14.763947 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.751827 23748 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.774085 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.768267 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:14.795982 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:14.752779 23837 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.760485 23864 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:14.752727 23912 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.742076 23849 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:14.753049 23852 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.831563 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:14.768373 23645 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.835434 23807 raft_consensus.cc:3055] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.837126 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 460) took 1533 ms. Trace:
I20260709 12:10:14.856964 22584 rpcz_store.cc:276] 0709 12:10:13.303778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.930936 (+627158us) service_pool.cc:224] Handling call
0709 12:10:13.942142 (+ 11206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.084237 (+142095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.836796 (+752559us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400763ed4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:14.837040 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299269888}
I20260709 12:10:14.857633 21966 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:14.857972 23864 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.858461 23730 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.858595 23864 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.767570 23719 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.860168 23719 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.848531 21852 raft_consensus.cc:606] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:14.861002 23864 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:14.851856 21993 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:14.860517 23719 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:14.863736 23719 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.865135 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:14.865707 21852 raft_consensus.cc:606] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:14.752468 23875 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.905663 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:14.843580 23877 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:14.908151 23923 log.cc:927] Time spent T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:10:14.795408 23482 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:10:14.927505 23916 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.928503 23878 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.868189 23645 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:14.913486 21919 consensus_meta.cc:287] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 12:10:14.915577 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1783) took 1128 ms. Trace:
I20260709 12:10:14.935680 21925 rpcz_store.cc:276] 0709 12:10:13.787697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.552928 (+765231us) service_pool.cc:224] Handling call
0709 12:10:14.553255 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.575466 (+ 22211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.575515 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.606421 (+ 30906us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.732852 (+126431us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:14.732890 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.732962 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.915367 (+182405us) raft_consensus.cc:1685] finished
0709 12:10:14.915387 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.915520 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31655,"raft.queue_time_us":21332,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":2279,"thread_start_us":57112,"threads_started":1,"wal-append.queue_time_us":176810}
I20260709 12:10:14.795872 23874 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.916157 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1565) took 1284 ms. Trace:
I20260709 12:10:14.939534 21923 rpcz_store.cc:276] 0709 12:10:13.631806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.320640 (+688834us) service_pool.cc:224] Handling call
0709 12:10:14.320905 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.321214 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.321240 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.321652 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.584096 (+262444us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:14.584133 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.584196 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.915942 (+331746us) raft_consensus.cc:1685] finished
0709 12:10:14.915964 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.916103 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1808,"raft.queue_time_us":904,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8740,"thread_start_us":255094,"threads_started":1,"wal-append.queue_time_us":588008}
I20260709 12:10:14.847154 23912 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.889760 23807 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:14.910553 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1578) took 1043 ms. Trace:
I20260709 12:10:14.944562 21922 rpcz_store.cc:276] 0709 12:10:13.866697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.560593 (+693896us) service_pool.cc:224] Handling call
0709 12:10:14.560982 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.561270 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.561308 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.561843 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.800672 (+238829us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:14.800719 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.800808 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.910249 (+109441us) raft_consensus.cc:1685] finished
0709 12:10:14.910276 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.910476 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":227805,"threads_started":1,"wal-append.queue_time_us":335290}
I20260709 12:10:14.843907 23533 consensus_queue.cc:1059] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:10:14.904352 23864 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:14.949230 23864 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.921241 23877 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.929397 23881 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.928939 23878 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:14.935377 23645 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.951794 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1547) took 1309 ms. Trace:
I20260709 12:10:14.956959 21849 rpcz_store.cc:276] 0709 12:10:13.642577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.642686 (+   109us) service_pool.cc:224] Handling call
0709 12:10:14.951525 (+1308839us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400217854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:14.951716 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619977984}
I20260709 12:10:14.952351 21927 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:14.938203 21919 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:14.964345 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:14.956444 23877 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.956089 23881 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:14.965382 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1572) took 1321 ms. Trace:
I20260709 12:10:14.944007 23820 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:14.971438 23895 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.001s
I20260709 12:10:14.978229 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:14.979058 21922 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:14.984236 23820 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:14.989243 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1789) took 2157 ms. Trace:
I20260709 12:10:14.989787 21998 rpcz_store.cc:276] 0709 12:10:12.832080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.990991 (+158911us) service_pool.cc:224] Handling call
0709 12:10:12.991257 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.704346 (+713089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.988921 (+1284575us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54003f4654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:14.989168 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534089600}
I20260709 12:10:14.974370 23702 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:14.992880 23702 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:14.993742 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:14.994282 21923 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.001683 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1563) took 1370 ms. Trace:
I20260709 12:10:14.975329 23849 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:15.002152 21918 rpcz_store.cc:276] 0709 12:10:13.631332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.224370 (+593038us) service_pool.cc:224] Handling call
0709 12:10:15.001487 (+777117us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54001a3e54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:15.001623 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589641600}
I20260709 12:10:15.004150 23874 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.004771 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:15.005841 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:15.006716 23690 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:15.007872 23690 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.008342 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1582) took 1023 ms. Trace:
I20260709 12:10:15.008275 23690 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:15.008906 21926 rpcz_store.cc:276] 0709 12:10:13.985459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.748206 (+762747us) service_pool.cc:224] Handling call
0709 12:10:14.748498 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.748695 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.748717 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.749120 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.814546 (+ 65426us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:14.814596 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.814696 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.008149 (+193453us) raft_consensus.cc:1685] finished
0709 12:10:15.008167 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.008290 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":65016,"threads_started":1,"wal-append.queue_time_us":197094}
I20260709 12:10:15.009608 23690 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.011488 23690 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.014390 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1368) took 1322 ms. Trace:
I20260709 12:10:15.014779 22001 rpcz_store.cc:276] 0709 12:10:13.691799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.936044 (+244245us) service_pool.cc:224] Handling call
0709 12:10:13.960870 (+ 24826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.117786 (+156916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.014151 (+896365us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54003f3254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:15.014329 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328773376}
W20260709 12:10:15.018115 23772 consensus_meta.cc:287] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.001s
I20260709 12:10:14.973522 23881 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.008224 21993 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:15.008931 21850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 271) took 1324 ms (client timeout 1720 ms). Trace:
W20260709 12:10:15.024783 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.040263 21850 rpcz_store.cc:269] 0709 12:10:13.684796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.694792 (+  9996us) service_pool.cc:224] Handling call
0709 12:10:15.008742 (+1313950us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54001bce54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:15.008879 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954520448}
I20260709 12:10:15.022717 21846 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.038293 21918 raft_consensus.cc:2410] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:15.044592 21918 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.041409 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:15.047751 21926 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:15.048418 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.050185 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.052241 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:15.056725 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 260820us
I20260709 12:10:15.057574 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:14.973647 21919 rpcz_store.cc:276] 0709 12:10:13.643763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.285374 (+641611us) service_pool.cc:224] Handling call
0709 12:10:14.965314 (+679940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.061520 21926 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:15.062829 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.062734 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.064960 21850 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:15.065225 21964 leader_election.cc:400] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:15.063793 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.065160 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:15.066532 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:15.074640 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:15.041798 23772 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.973964 23807 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.023532 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 613) took 2127 ms. Trace:
I20260709 12:10:15.049657 23880 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:14.979033 23895 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.084232 21923 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:15.064404 23554 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:15.075639 23748 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.086357 23903 raft_consensus.cc:2243] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:15.049275 23614 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:15.064639 21996 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:14.978706 23885 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.089111 21926 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.063557 23906 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:15.067463 23835 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:15.095964 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.021382 23821 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.080401 23482 raft_consensus.cc:2764] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:15.080861 23874 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.111665 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.111780 21964 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:15.086659 23690 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:10:15.110384 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:15.092922 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.093490 23864 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.076428 23719 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.121840 21926 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:15.125201 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.129175 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.098726 23748 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:15.153110 23748 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.153739 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.153955 23719 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.154340 23820 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.154861 23820 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.155539 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.156200 23895 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:15.157326 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.157577 23820 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.154120 23825 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.149770 21926 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.158758 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:15.158846 23825 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.087309 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.136758 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.161262 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.161477 23825 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.083889 22577 rpcz_store.cc:276] 0709 12:10:12.895991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.415599 (+519608us) service_pool.cc:224] Handling call
0709 12:10:13.464094 (+ 48495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.995690 (+531596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.023306 (+1027616us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400655254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:15.023474 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736284416}
I20260709 12:10:15.132547 23711 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:15.162760 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:15.162436 23711 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.164358 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.164930 22577 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:15.165194 23645 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.165071 23711 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.115461 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1781) took 1360 ms. Trace:
I20260709 12:10:15.167343 23833 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:15.167814 23833 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.159044 21926 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.161832 22001 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:15.138525 21998 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.142140 23874 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:15.168759 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.169042 23874 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.169565 22576 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:15.166604 22577 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEARNER]: Advancing to term 4
I20260709 12:10:15.171324 21998 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:15.168797 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.174631 22001 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
I20260709 12:10:15.167716 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.175489 22575 raft_consensus.cc:2393] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 2: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:15.177086 23916 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.120541 23554 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.109784 23807 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.152112 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.180367 22584 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.181331 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.181654 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.203532 22582 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:15.183224 23844 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.184252 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:15.184690 23554 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:15.143334 23903 raft_consensus.cc:2272] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:15.187114 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.188140 23689 consensus_queue.cc:1059] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:15.188948 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:15.191615 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.193413 22577 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:15.121065 23816 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:10:15.096700 23880 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.117815 23614 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.133790 23906 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.195544 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1791) took 1490 ms. Trace:
I20260709 12:10:15.196009 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:15.196741 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1784) took 1331 ms. Trace:
I20260709 12:10:15.196576 23877 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.198182 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:15.269562 21920 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:15.205080 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:15.213075 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.213529 21926 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:10:15.270593 21926 pending_rounds.cc:85] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 6
I20260709 12:10:15.270869 21926 pending_rounds.cc:107] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:10:15.271090 21926 raft_consensus.cc:2889] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:15.271718 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:15.272130 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:15.272887 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:15.273195 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:15.273605 21923 raft_consensus.cc:2393] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:15.201445 23783 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.234421 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1382) took 1142 ms. Trace:
W20260709 12:10:15.274566 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 69607.1us
I20260709 12:10:15.274827 21892 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:15.236238 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:15.275822 21999 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.225960 23533 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:15.276588 23554 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.276535 21750 catalog_manager.cc:5697] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:15.277725 23554 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.218103 23711 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:15.278565 23932 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:10:15.278740 23711 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.280107 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:15.280664 21992 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.281351 23711 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.178318 23874 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.250203 21893 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:15.283540 23931 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.283928 23874 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.284585 23931 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:15.228184 23860 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:15.284929 23931 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:15.285307 23931 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.256759 23698 raft_consensus.cc:3055] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:15.286486 23698 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:15.287281 23698 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.274050 21997 rpcz_store.cc:276] 0709 12:10:14.092175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.292122 (+199947us) service_pool.cc:224] Handling call
0709 12:10:15.234159 (+942037us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b540018ecd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:15.234332 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157982080}
I20260709 12:10:15.288417 23698 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.289168 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.289906 21997 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:15.290849 23783 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.291652 21925 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:15.256554 21994 rpcz_store.cc:276] 0709 12:10:13.705307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.942854 (+237547us) service_pool.cc:224] Handling call
0709 12:10:13.943101 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.076702 (+133601us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:14.121947 (+ 45245us) log.cc:844] Serialized 14 byte log entry
0709 12:10:14.229757 (+107810us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.229813 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:14.229859 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.299476 (+ 69617us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18000385c0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:15.195259 (+895783us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54000d2854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:15.195325 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.195480 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":157343,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":3918,"raft.queue_time_us":83,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":313854976,"thread_start_us":130878,"threads_started":2,"wal-append.queue_time_us":221665}
I20260709 12:10:15.293725 21994 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:15.257584 21995 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:15.295030 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 356) took 1607 ms. Trace:
I20260709 12:10:15.295353 21995 rpcz_store.cc:276] 0709 12:10:13.687794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.693610 (+  5816us) service_pool.cc:224] Handling call
0709 12:10:15.191440 (+1497830us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76e9c 00007f3be1c76a5b 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:15.294972 (+103532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20971776}
I20260709 12:10:15.227959 23844 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:15.250895 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.252657 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:15.297827 22582 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:15.297935 22584 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.254454 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.300771 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:15.222543 23916 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.260705 21927 rpcz_store.cc:276] 0709 12:10:13.865746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.554904 (+689158us) service_pool.cc:224] Handling call
0709 12:10:14.555265 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.960163 (+404898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.196470 (+236307us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54001711d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:15.196676 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":912657664}
I20260709 12:10:15.258251 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:15.303815 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 45696.2us
I20260709 12:10:15.303997 21999 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:15.305235 21999 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:15.307862 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 230613us
I20260709 12:10:15.311219 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:15.315951 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:15.316280 21999 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.317538 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:15.319932 21999 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:10:15.321744 21992 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:15.261267 23824 raft_consensus.cc:3055] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:15.315246 21892 raft_consensus.cc:2686] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:15.325186 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:15.326030 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:15.328925 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 55077.2us
I20260709 12:10:15.327900 21999 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.330673 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:15.331470 21999 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.333529 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:15.335049 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:15.335708 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 223984us
I20260709 12:10:15.337914 21922 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.338922 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.340287 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:15.341765 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:15.343721 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 213384us
I20260709 12:10:15.339958 21999 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:15.346765 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:15.347489 21999 raft_consensus.cc:2368] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4.
I20260709 12:10:15.285266 23882 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.354444 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:15.293725 23835 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:15.356127 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.306638 23614 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.365864 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:15.344866 23711 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.339663 23895 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.346215 23821 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.357014 21967 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:15.391173 21921 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:15.289191 23912 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.328660 23824 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:15.404060 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:15.328285 23772 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.354171 23730 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.324625 23916 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.404986 21999 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:15.356060 23860 raft_consensus.cc:993] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
W20260709 12:10:15.405597 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.407353 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 50446.4us
I20260709 12:10:15.361423 23940 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:15.365367 23835 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.416926 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.417383 23645 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:15.365559 23911 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.325752 23820 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.365830 23850 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:15.403398 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 178311us
I20260709 12:10:15.166577 21924 rpcz_store.cc:276] 0709 12:10:13.755605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.390733 (+635128us) service_pool.cc:224] Handling call
0709 12:10:14.426125 (+ 35392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.527784 (+101659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.533218 (+  5434us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.584319 (+ 51101us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.046676 (+462357us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.047210 (+   534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.064341 (+ 17131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.096597 (+ 32256us) raft_consensus.cc:1685] finished
0709 12:10:15.098213 (+  1616us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.111873 (+ 13660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32803,"raft.queue_time_us":3085,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":9161,"thread_start_us":196744,"threads_started":1,"wal-append.queue_time_us":327390}
I20260709 12:10:15.467820 23821 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.382951 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:15.386319 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:15.364988 23740 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:10:15.394151 23895 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.472113 23482 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.419327 23554 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:15.412092 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 77101.7us
I20260709 12:10:15.435518 23668 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:10:15.404934 23614 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.418327 23814 raft_consensus.cc:3055] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.346370 23864 consensus_queue.cc:1059] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 12:10:15.474118 21999 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:15.419519 23719 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.428596 23607 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.420310 23772 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:15.499171 21967 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:15.427485 22584 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
W20260709 12:10:15.502305 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.477222 23940 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.400344 23881 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.394963 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.517230 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:15.519405 23951 raft_consensus.cc:1081] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:10:15.516155 23945 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:15.527489 23880 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:15.570724 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 53566.4us
I20260709 12:10:15.500013 23824 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.531028 23482 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:15.478863 23911 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:15.533699 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:15.536832 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 175461us
I20260709 12:10:15.502497 23820 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:15.601749 23740 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.509684 23885 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:15.509322 23821 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.479228 23860 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
W20260709 12:10:15.546756 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 204394us
I20260709 12:10:15.615710 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:15.617270 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.551234 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1810) took 1139 ms. Trace:
I20260709 12:10:15.618134 21993 rpcz_store.cc:276] 0709 12:10:14.411577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.060131 (+648554us) service_pool.cc:224] Handling call
0709 12:10:15.082225 (+ 22094us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.097518 (+ 15293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.097547 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.097951 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.343465 (+245514us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.541759 (+198294us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.542104 (+   345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.542199 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.542251 (+    52us) raft_consensus.cc:1685] finished
0709 12:10:15.542269 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.551157 (+  8888us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24671,"prepare.queue_time_us":132252,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2333,"raft.queue_time_us":28926,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":23070,"thread_start_us":360034,"threads_started":2,"wal-append.queue_time_us":302677}
I20260709 12:10:15.465409 23730 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:15.553577 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.464466 23844 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.518762 23895 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.563709 21999 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:15.566138 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 67062.8us
I20260709 12:10:15.634048 23730 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.524905 22576 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:10:15.528475 23939 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:15.524645 23912 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.536459 23614 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:15.606102 23911 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:15.599062 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 243531us
I20260709 12:10:15.640654 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.641255 21967 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:15.540433 23814 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:15.600440 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.558066 23772 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.548930 23607 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:15.606567 22001 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:15.609509 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 75953.7us
I20260709 12:10:15.522094 23931 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.521222 23950 consensus_queue.cc:1059] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:10:15.677399 23950 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:15.679642 21995 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:15.681232 21995 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:15.681767 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 375) took 1119 ms. Trace:
I20260709 12:10:15.568985 23877 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.600636 23689 consensus_queue.cc:1243] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:15.596673 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.638854 21852 raft_consensus.cc:2368] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:15.645927 21993 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.607215 23864 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:15.608202 23906 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.613086 23825 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:15.615173 23821 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.613277 23719 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.651376 21967 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:15.658002 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:15.628168 23909 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.674523 23959 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:15.676561 23833 consensus_meta.cc:287] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.508s	user 0.001s	sys 0.008s
I20260709 12:10:15.635362 23740 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.633639 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.639236 23824 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.601043 23945 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.639384 23554 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.682143 21994 rpcz_store.cc:276] 0709 12:10:14.562536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.294423 (+731887us) service_pool.cc:224] Handling call
0709 12:10:15.294732 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.294922 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.294945 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.295383 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.596819 (+301436us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:15.596873 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.596971 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.681540 (+ 84569us) raft_consensus.cc:1685] finished
0709 12:10:15.681563 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.681706 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":272237,"threads_started":1,"wal-append.queue_time_us":349496}
I20260709 12:10:15.700037 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:15.705489 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.730067 23711 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.713794 23730 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:15.724421 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 66493.7us
W20260709 12:10:15.724953 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 73664.4us
I20260709 12:10:15.758520 21967 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:15.657428 23607 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.659888 23943 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.685004 23940 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.742836 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.764007 21847 raft_consensus.cc:2368] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:15.635782 23820 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.753566 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:15.712203 23953 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:15.784415 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.785293 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1815) took 1045 ms. Trace:
I20260709 12:10:15.785660 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.786017 23881 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.785698 21997 rpcz_store.cc:276] 0709 12:10:14.740005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.294690 (+554685us) service_pool.cc:224] Handling call
0709 12:10:15.295035 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.295419 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.295461 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.295956 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.480077 (+184121us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.480129 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.480213 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.785071 (+304858us) raft_consensus.cc:1685] finished
0709 12:10:15.785090 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.785235 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3366,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":18039,"thread_start_us":183149,"threads_started":1,"wal-append.queue_time_us":299653}
I20260709 12:10:15.736825 23482 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.733144 23880 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.685042 23948 consensus_queue.cc:1059] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:10:15.743043 23906 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:15.754551 23918 consensus_meta.cc:287] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.990s	user 0.010s	sys 0.003s
I20260709 12:10:15.715770 23689 consensus_queue.cc:1059] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:10:15.769388 22583 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:15.725741 23614 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.745464 23916 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.776485 23945 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:15.744365 23740 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.777456 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.777817 23931 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.778013 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.780839 23878 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.781337 23970 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:15.781373 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 77804.4us
I20260709 12:10:15.788343 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:15.828702 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:15.829222 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.829949 21892 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:15.833312 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:15.791649 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.784415 23976 raft_consensus.cc:993] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:10:15.834247 23874 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.834709 23975 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:15.725361 23955 consensus_queue.cc:1059] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:15.835712 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:15.737280 23959 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.836066 23955 raft_consensus.cc:3055] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.740689 23833 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.836580 23719 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.837020 23719 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:15.837406 23719 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.837710 23959 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.790681 23482 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:15.803515 23881 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.714318 23864 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.817212 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:15.822041 23614 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.830613 23916 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.813017 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.792918 23903 ts_tablet_manager.cc:1916] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:15.834959 23874 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:15.834709 21846 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:15.801048 23906 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:15.769536 23645 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.839073 21892 leader_election.cc:400] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4.
I20260709 12:10:15.830247 21851 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:15.830303 23931 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.842361 23833 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:15.839056 23730 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:15.855881 21892 leader_election.cc:403] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:15.864251 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:15.866578 23711 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.857164 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.867400 21846 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:15.868603 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.868495 23905 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:15.849730 23740 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.850677 22576 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.871743 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:15.872123 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:15.872545 21921 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.872871 21922 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:15.813344 23918 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.836575 23955 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:15.874516 23969 raft_consensus.cc:3055] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:15.875156 23955 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.876513 23955 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.877092 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.864905 23916 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.840457 23881 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.882727 23881 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.877890 23912 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:15.853547 23482 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.890188 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1807) took 1527 ms. Trace:
I20260709 12:10:15.883001 23906 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.890933 21996 rpcz_store.cc:276] 0709 12:10:14.363023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.004338 (+641315us) service_pool.cc:224] Handling call
0709 12:10:15.039836 (+ 35498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.119986 (+ 80150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.889966 (+769980us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b54003f3750. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:15.890120 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48998784}
I20260709 12:10:15.891901 23906 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.893103 21893 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:15.859150 23878 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.894635 21893 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:15.889256 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1812) took 1371 ms. Trace:
I20260709 12:10:15.896097 21998 rpcz_store.cc:276] 0709 12:10:14.517904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.172021 (+654117us) service_pool.cc:224] Handling call
0709 12:10:15.172271 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.306820 (+134549us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:15.539238 (+232418us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.703854 (+164616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.704132 (+   278us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:15.704716 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.888953 (+184237us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000d3c54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:15.889011 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.889176 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13936,"prepare.queue_time_us":94689,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":9803,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":308946688,"thread_start_us":343302,"threads_started":2,"wal-append.queue_time_us":270866}
W20260709 12:10:15.855701 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 97242.4us
W20260709 12:10:15.913163 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 68192.8us
I20260709 12:10:15.875083 23969 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:15.909543 23931 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:15.928056 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:15.928810 21998 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:15.929795 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 229854us
I20260709 12:10:15.929749 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.930568 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:15.906656 23482 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.928634 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:15.931758 21999 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.906929 23833 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.923506 23860 raft_consensus.cc:1081] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:10:15.920622 23940 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:15.950202 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 44951.7us
I20260709 12:10:15.952044 21966 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:15.956432 22549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.859s (SENT) [suppressed 7 similar messages]
I20260709 12:10:15.961503 21966 leader_election.cc:400] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:15.961869 21966 leader_election.cc:403] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:15.956920 21846 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:15.909269 23645 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:15.965147 21966 leader_election.cc:400] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:15.965837 21966 leader_election.cc:403] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:15.967765 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:15.958205 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 61532.2us
I20260709 12:10:15.883490 23874 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:15.944784 23931 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:15.970536 21999 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:15.971782 21846 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:15.921401 23783 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:15.959231 23940 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:15.957547 23981 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.965551 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:15.977912 23945 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:16.143915 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.986321 23533 raft_consensus.cc:3055] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.135250 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 372) took 1593 ms. Trace:
I20260709 12:10:16.186213 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:15.965688 23740 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.191216 22001 rpcz_store.cc:276] 0709 12:10:14.541694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.175204 (+633510us) service_pool.cc:224] Handling call
0709 12:10:15.175451 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.657637 (+482186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.134998 (+477361us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54002c6d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:16.135177 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990915456}
W20260709 12:10:16.043926 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 64535us
I20260709 12:10:16.144923 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:15.974427 21966 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:16.145408 21967 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:15.969516 23730 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:15.969872 23668 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:16.081678 23807 consensus_meta.cc:287] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.862s	user 0.005s	sys 0.004s
I20260709 12:10:16.139338 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:16.141659 21892 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:16.209273 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 234909us
W20260709 12:10:16.138136 23983 log.cc:927] Time spent T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:10:16.172163 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:15.976214 21921 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:16.208593 21964 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:16.183730 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:16.185776 23982 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.212s	user 0.004s	sys 0.000s
I20260709 12:10:16.182919 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:16.204658 21849 raft_consensus.cc:2393] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:16.204774 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 59496.6us
I20260709 12:10:16.192535 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:16.219825 21926 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.205771 21996 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:16.022934 23965 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:10:16.134912 23918 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.209995 21966 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:16.035636 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.210130 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 68627.7us
W20260709 12:10:16.040691 23748 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.887s	user 0.006s	sys 0.005s
W20260709 12:10:16.284916 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 299550us
I20260709 12:10:16.213158 22000 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:16.287700 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.192994 21818 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:16.157969 23908 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.972095 23979 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3.
I20260709 12:10:16.137673 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:16.143594 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:16.301386 22549 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:16.068840 23864 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.303157 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:16.304610 23864 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:16.305339 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:16.156201 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:16.283878 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:16.088990 23835 consensus_meta.cc:287] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.000s
I20260709 12:10:16.306399 21845 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:16.306356 23835 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:16.154801 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:16.289032 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 80507.2us
I20260709 12:10:16.308954 23835 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.194036 23950 raft_consensus.cc:3055] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.309207 21843 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:16.309484 23950 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:16.025290 23877 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.310145 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:16.310549 23877 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.312743 23877 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:15.981861 23905 consensus_queue.cc:1059] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.244s
I20260709 12:10:16.312992 21923 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:16.136066 22576 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:16.226614 23943 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.295471 22001 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.315361 23966 raft_consensus.cc:3055] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.190793 23861 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.191632 23533 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:16.216704 23833 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.315373 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1801) took 1990 ms. Trace:
I20260709 12:10:16.316326 22000 rpcz_store.cc:276] 0709 12:10:14.325347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.726166 (+400819us) service_pool.cc:224] Handling call
0709 12:10:15.234286 (+508120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.287491 (+1053205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.314165 (+ 26674us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b540018ecd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:16.315197 (+  1032us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b540018ecd0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:16.315316 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3418482816}
I20260709 12:10:15.986858 23975 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.296s
I20260709 12:10:16.040884 23719 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.318516 21892 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:16.093998 23911 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.305140 23864 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:15.980299 23976 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.244s
I20260709 12:10:16.054231 23821 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:16.318753 21923 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:16.097164 23895 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.319747 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:16.283238 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:16.286388 23807 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:16.216871 23980 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.282711 23847 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.331422 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:16.331414 23874 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.012665 23967 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.311s
I20260709 12:10:16.295816 23816 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.976876 23969 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:16.160588 23814 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.315961 23966 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:16.320911 23987 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.225891 23668 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.436694 21893 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:16.385650 22547 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:16.329257 23877 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.393055 21926 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
W20260709 12:10:16.464397 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 78838.3us
I20260709 12:10:16.393785 21852 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.297000 23748 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:16.382555 23953 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:16.374153 21925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60628
I20260709 12:10:16.318205 23908 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.466776 21925 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:16.467274 21925 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.468441 23908 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.328603 23861 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.381734 23986 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:16.409034 23807 raft_consensus.cc:697] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:16.471602 23807 consensus_queue.cc:237] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.473240 23861 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:16.473960 21850 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:16.419009 21924 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:16.420234 23881 consensus_meta.cc:287] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 12:10:16.475611 23881 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.476951 23748 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:16.420482 23719 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:16.421193 23614 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.001s
W20260709 12:10:16.424886 23772 consensus_meta.cc:287] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.765s	user 0.006s	sys 0.005s
I20260709 12:10:16.479046 23772 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.481207 23772 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.415211 23847 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:16.483497 23847 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.426940 23864 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.428223 23821 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.063975 23931 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.382000 23912 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:16.484637 23912 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.486811 23912 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:16.486848 23908 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:16.487572 23908 raft_consensus.cc:697] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:16.488533 23908 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.429783 23835 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.428051 22577 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:16.470659 21997 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.403189 23905 raft_consensus.cc:3055] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:16.479238 21851 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:16.478080 23881 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:16.498823 23905 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:16.499943 23905 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.387480 23825 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.501298 23825 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:16.501823 23825 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.510923 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:16.512050 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:16.463056 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 161757us
I20260709 12:10:16.513314 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:16.514142 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:16.515946 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.519024 22001 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.523769 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:16.491078 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:16.523257 21925 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:16.535494 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:16.494886 23918 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:10:16.506487 23824 consensus_meta.cc:287] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.758s	user 0.008s	sys 0.004s
I20260709 12:10:16.538789 21848 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.548152 21925 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.495736 23814 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.555881 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:16.623656 22001 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:16.496989 23719 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:16.560487 23986 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.562695 23918 raft_consensus.cc:697] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:16.631919 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:16.563476 24007 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:16.533324 23955 consensus_meta.cc:287] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.004s
W20260709 12:10:16.533634 23906 consensus_meta.cc:287] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.000s
W20260709 12:10:16.526588 23916 consensus_meta.cc:287] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260709 12:10:16.516527 23850 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.570760 24002 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.627728 23874 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:16.571170 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 57151.5us
I20260709 12:10:16.575610 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:16.662114 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:16.526973 22577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 438) took 1167 ms (client timeout 1508 ms). Trace:
I20260709 12:10:16.576496 23911 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.491076 23966 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:16.584295 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:16.588570 23895 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:16.592517 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 382564us
I20260709 12:10:16.593225 23762 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:16.593775 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 284441us
I20260709 12:10:16.568830 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:16.507439 23835 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:16.679308 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 486411us
I20260709 12:10:16.603582 23668 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.549464 21848 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
W20260709 12:10:16.562978 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49774.3us
I20260709 12:10:16.568663 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:16.615454 23607 consensus_meta.cc:287] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.000s
I20260709 12:10:16.607409 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:16.581732 23533 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.646130 23918 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.636904 23986 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.650617 23916 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4.
I20260709 12:10:16.651643 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:16.651584 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:16.567948 23950 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.651041 23850 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:16.655987 21817 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:16.640995 23877 consensus_queue.cc:1059] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:16.662046 22000 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:16.668993 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:16.674937 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:16.671350 21966 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:16.680693 21964 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:16.599915 23878 consensus_meta.cc:287] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.001s
W20260709 12:10:16.719551 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 48287.1us
I20260709 12:10:16.720770 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:16.722748 21966 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:16.679299 23909 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.684175 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:16.726894 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46265.4us
W20260709 12:10:16.727783 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 43700.9us
I20260709 12:10:16.729704 21844 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:16.635557 23719 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.691591 23607 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.692585 21924 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:16.693032 23533 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.707093 23668 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:16.707224 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 51307.2us
I20260709 12:10:16.628285 23989 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:10:16.690548 21843 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:16.683648 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:16.667750 23861 consensus_queue.cc:1059] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:10:16.739239 22548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.034s	sys 0.054s
I20260709 12:10:16.740005 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:16.758212 22548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.034s	sys 0.054s
W20260709 12:10:16.667285 22577 rpcz_store.cc:269] 0709 12:10:15.351029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.143285 (+792256us) service_pool.cc:224] Handling call
0709 12:10:16.517962 (+374677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.677783 23940 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.747514 23950 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.673709 23874 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:16.718451 24002 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.718214 23689 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:16.728652 23730 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.727380 23877 consensus_queue.cc:1243] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:16.756222 21996 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.738102 23881 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.743810 23482 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.741611 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:16.743983 23762 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.760229 22584 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:16.761337 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:16.762025 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:16.700533 21920 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:16.765971 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:16.894201 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 152703us
W20260709 12:10:16.879463 21967 leader_election.cc:336] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Timed out: RequestConsensusVote RPC to 127.20.56.68:40043 timed out after 1.508s (SENT)
I20260709 12:10:16.897073 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:16.770046 21927 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:16.765394 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:16.766831 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:16.899096 21997 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:16.771497 22580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:33654
I20260709 12:10:16.771588 23971 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.771873 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:16.772671 23607 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:16.773922 23874 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:16.752905 23945 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.777271 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:16.977298 21992 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.778108 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:16.769065 22576 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:16.840788 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:16.841694 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:16.688899 23959 consensus_queue.cc:1175] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73070a828b23480e9c3588e376bce2ab" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:16.752686 23748 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:16.902793 23824 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.923125 23912 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:16.783730 23689 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.752939 23847 consensus_queue.cc:1059] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:16.774874 23948 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.015062 23948 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.010026 23748 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.900197 22580 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:17.015863 22580 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:16.940876 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 61463.1us
I20260709 12:10:16.764572 24012 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.952261 21920 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.755089 23668 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.984671 21926 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:16.982731 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.991981 22578 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.983014 21998 raft_consensus.cc:2393] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:16.902850 23987 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.848160 23911 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:17.026352 24011 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:10:16.846783 23850 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.038335 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:17.035486 23945 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:17.038865 23850 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.977653 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.039608 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:17.040262 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:17.005214 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 239286us
I20260709 12:10:17.040701 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.041369 22000 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:16.942945 23762 raft_consensus.cc:697] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:17.048089 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:17.004828 23992 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.005043 23860 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:16.936323 21923 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.058s	sys 0.086s
W20260709 12:10:17.049407 21923 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.058s	sys 0.086s
I20260709 12:10:17.015533 21818 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:16.942468 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.054581 21993 raft_consensus.cc:2393] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:16.849790 23878 consensus_queue.cc:1059] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.200s
W20260709 12:10:17.019178 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.757375 23972 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:10:16.995417 22581 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.025322 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.030025 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1474) took 1385 ms. Trace:
I20260709 12:10:16.900157 23931 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:17.031337 24017 log.cc:927] Time spent T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:10:17.010299 23689 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.033802 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:17.011559 23903 ts_tablet_manager.cc:1929] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:17.039378 23945 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:16.941790 23979 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.940053 23730 raft_consensus.cc:697] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:17.080466 21993 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:17.042559 21736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d50c36e857cb4e33997aee7e5dd39447 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cffb5c192e144f7caa7b94271976ed42 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:17.019886 23912 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.050715 21843 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:17.052060 23748 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.052990 23762 consensus_queue.cc:237] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.015511 23948 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.059845 21850 rpcz_store.cc:276] 0709 12:10:15.644206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.644844 (+   638us) service_pool.cc:224] Handling call
0709 12:10:16.171954 (+527110us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:17.029813 (+857859us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400049a54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.029954 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615768064}
I20260709 12:10:17.107455 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:17.034546 24009 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:10:17.060698 21992 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:17.063362 21998 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:17.065135 23993 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:17.067960 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.068599 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.028836 23807 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.070068 23719 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.069785 23931 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:16.971182 23971 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.024434 24012 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:17.084421 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 368052us
I20260709 12:10:17.056565 23989 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.026477 23911 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.104728 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:17.026716 23987 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.117375 22000 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:17.098377 22580 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.118221 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:17.084484 23835 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.091251 23975 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.108258 23903 log.cc:1199] T 279111025ee54aba83c27bba63339332 P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/279111025ee54aba83c27bba63339332
I20260709 12:10:17.122061 23807 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:17.119136 23861 raft_consensus.cc:3055] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:17.147634 23833 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.824s	user 0.008s	sys 0.004s
I20260709 12:10:17.074957 23992 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.174865 22584 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.179452 22580 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:17.146662 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:17.149776 23989 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:17.187137 23814 consensus_meta.cc:287] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.003s
I20260709 12:10:17.171279 23861 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:17.173900 23668 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:17.177827 22579 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.180619 23833 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.186877 22578 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:17.182228 23908 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.202893 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.205253 22580 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:17.148761 23993 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.172492 23730 consensus_queue.cc:237] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.198963 23895 consensus_queue.cc:1059] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:10:17.087814 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.108902 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 211384us
I20260709 12:10:17.197237 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.210388 22584 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:17.300505 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:17.303892 23533 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.552s	user 0.003s	sys 0.019s
I20260709 12:10:17.287614 22577 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.274505 21846 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
W20260709 12:10:17.273350 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.313812 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.298166 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:17.315444 21919 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.288241 22000 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:17.299517 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.355475 21992 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:17.355923 22580 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:17.357290 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.357672 23533 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.358556 23533 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:17.361584 23533 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.364068 23482 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.364877 23482 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.371124 21848 raft_consensus.cc:2410] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:17.373497 23482 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.373651 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.287000 22578 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:17.357290 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.376278 22580 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:17.376361 22578 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.377748 22580 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.358193 21992 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:17.381218 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.382073 21992 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
W20260709 12:10:17.388279 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.389287 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:17.389469 23668 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.390210 23668 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.390589 21817 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:17.392882 23668 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.395785 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.282655 21921 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:17.228384 24019 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:10:17.430933 21998 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:17.296690 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:17.437362 21923 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:17.436966 23614 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:17.438761 23690 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.439262 23690 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.439625 23690 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.439694 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1803) took 1100 ms. Trace:
I20260709 12:10:17.440160 21921 rpcz_store.cc:276] 0709 12:10:16.339449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.383727 (+ 44278us) service_pool.cc:224] Handling call
0709 12:10:16.383999 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.438605 (+1054606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.439411 (+   806us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54003e5dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:17.439622 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065238784}
I20260709 12:10:17.279316 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1605) took 1096 ms. Trace:
I20260709 12:10:17.464767 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.276393 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.485280 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:17.485221 23835 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.492527 23835 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:17.493163 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 477561us
I20260709 12:10:17.200939 23807 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.231238 23945 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.495623 21921 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:17.495927 23807 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:17.498148 21890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.041s	sys 0.065s
W20260709 12:10:17.498636 21890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.042s	sys 0.065s
I20260709 12:10:17.498757 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1572) took 1823 ms. Trace:
W20260709 12:10:17.499768 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.238365 23989 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.504397 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.476302 23908 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:17.499179 21852 rpcz_store.cc:276] 0709 12:10:15.675173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.887355 (+212182us) service_pool.cc:224] Handling call
0709 12:10:16.173112 (+285757us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:16.173372 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.465576 (+292204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.498225 (+1032649us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54002909d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:17.498543 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538699776}
W20260709 12:10:17.512162 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.235677 23931 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.441715 21922 rpcz_store.cc:276] 0709 12:10:16.183056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.183972 (+   916us) service_pool.cc:224] Handling call
0709 12:10:16.184249 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.184590 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:16.184617 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:16.233405 (+ 48788us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.636477 (+403072us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:16.636512 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.636572 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:17.278681 (+642109us) raft_consensus.cc:1685] finished
0709 12:10:17.278731 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.279048 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9412,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4809,"thread_start_us":294451,"threads_started":1,"wal-append.queue_time_us":425789}
I20260709 12:10:17.227530 23912 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.237816 23971 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:17.506731 23482 consensus_queue.cc:1175] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73070a828b23480e9c3588e376bce2ab" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 5 index: 4 } }
I20260709 12:10:17.524166 23614 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:17.532459 24004 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:17.532819 23614 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.533510 24004 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.534162 23908 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.535708 23614 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.219646 23861 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.536293 24004 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.537081 24027 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.526198 23814 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.538538 23814 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.538951 23814 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.539633 21818 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:17.540988 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 46664.4us
I20260709 12:10:17.541153 23950 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:17.542611 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.543414 21849 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:17.544703 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.545089 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.546967 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1603) took 1364 ms. Trace:
I20260709 12:10:17.231170 23987 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.232086 24012 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.235519 23992 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.556823 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 290) took 1045 ms. Trace:
I20260709 12:10:17.537169 23908 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.528244 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.230298 23903 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60614 (request call id 82) took 3616 ms. Trace:
I20260709 12:10:17.546036 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.547367 21927 rpcz_store.cc:276] 0709 12:10:16.182357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.182550 (+   193us) service_pool.cc:224] Handling call
0709 12:10:17.546593 (+1364043us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400360bd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.546734 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082234752}
I20260709 12:10:17.557489 21846 rpcz_store.cc:276] 0709 12:10:16.511353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.511832 (+   479us) service_pool.cc:224] Handling call
0709 12:10:17.556471 (+1044639us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54003809d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.556675 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750745472}
I20260709 12:10:17.237138 23993 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.569936 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.571570 23835 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.571976 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.573288 21846 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.573599 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:17.567422 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.556919 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.574499 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 640) took 1063 ms. Trace:
I20260709 12:10:17.576582 22576 rpcz_store.cc:276] 0709 12:10:16.512744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.515599 (+  2855us) service_pool.cc:224] Handling call
0709 12:10:17.573893 (+1058294us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b540046fd54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.574202 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117093760}
I20260709 12:10:17.543331 23911 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.579795 21750 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.541968 23950 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.590449 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:17.591470 23950 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.592260 23975 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.578338 23821 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.593643 23821 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:17.571645 21747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58738 (request call id 281) took 9018 ms. Trace:
I20260709 12:10:17.596055 23909 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.596531 23909 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:17.596911 21750 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.597255 23903 rpcz_store.cc:276] 0709 12:10:13.673854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.719868 (+ 46014us) service_pool.cc:224] Handling call
0709 12:10:14.293151 (+573283us) ts_tablet_manager.cc:1151] Deleting tablet 279111025ee54aba83c27bba63339332
0709 12:10:14.293263 (+   112us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:16.590032 (+2296769us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:16.996824 (+406792us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:17.230226 (+233402us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":762549,"tablet-delete.queue_time_us":282895,"thread_start_us":81235,"threads_started":1}
I20260709 12:10:17.610441 21818 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:17.612202 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62649.4us
I20260709 12:10:17.614013 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.614739 23993 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.615110 21999 raft_consensus.cc:2368] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
W20260709 12:10:17.582015 23825 consensus_meta.cc:287] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 1.080s	user 0.010s	sys 0.005s
W20260709 12:10:17.606904 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 115257us
W20260709 12:10:17.617962 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.611702 21750 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 3, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.581941 23690 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:17.622689 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.628248 23690 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.597661 23909 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.630131 23824 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:17.643565 23909 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.643306 23824 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.645717 23824 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:17.646286 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.631072 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.649070 21999 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:10:17.649971 21966 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:17.652601 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.654911 23762 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.660890 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:17.654204 23880 consensus_queue.cc:1059] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:10:17.661614 21999 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.601279 23689 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.639372 23814 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.641186 23833 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.641937 23912 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:17.633358 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.635070 22580 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:17.595233 23821 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.603823 21919 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:17.596282 21747 rpcz_store.cc:276] 0709 12:10:08.553011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.553294 (+   283us) service_pool.cc:224] Handling call
0709 12:10:17.571427 (+9018133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:13.681291 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:13.783288 (+101997us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:13.783325 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:13.858983 (+ 75658us) tablet.cc:662] Decoding operations
0709 12:10:13.899401 (+ 40418us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:13.899477 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:13.899515 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:13.899898 (+   383us) tablet.cc:701] Row locks acquired
0709 12:10:13.899926 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:10:13.900097 (+   171us) write_op.cc:270] Start()
0709 12:10:13.900239 (+   142us) write_op.cc:276] Timestamp: P: 1783599013900044 usec, L: 0
0709 12:10:13.900269 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:10:13.901005 (+   736us) log.cc:844] Serialized 923 byte log entry
0709 12:10:14.397121 (+496116us) op_driver.cc:464] REPLICATION: finished
0709 12:10:14.577028 (+179907us) write_op.cc:301] APPLY: starting
0709 12:10:14.577131 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:14.577263 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:14.577410 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:14.577858 (+   448us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:14.578090 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:14.578166 (+    76us) write_op.cc:312] APPLY: finished
0709 12:10:14.578443 (+   277us) log.cc:844] Serialized 29 byte log entry
0709 12:10:14.578635 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:14.578722 (+    87us) write_op.cc:454] Released schema lock
0709 12:10:14.578759 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:14.579097 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:14.579134 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39860,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":177533,"apply.run_cpu_time_us":2053,"apply.run_wall_time_us":4170,"num_ops":2,"prepare.queue_time_us":734645,"prepare.run_cpu_time_us":17646,"prepare.run_wall_time_us":328297,"raft.queue_time_us":91635,"raft.run_cpu_time_us":12014,"raft.run_wall_time_us":151263,"replication_time_us":491562,"thread_start_us":648176,"threads_started":4,"wal-append.queue_time_us":194280,"wal-append.run_cpu_time_us":35061,"wal-append.run_wall_time_us":1481373}]]}
I20260709 12:10:17.666816 21849 raft_consensus.cc:3055] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.682979 21850 raft_consensus.cc:2368] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:17.685315 23948 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.686177 23833 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.686607 22579 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:17.687956 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.690125 23912 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.690793 23969 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.692687 23912 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.694329 23821 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.694936 22576 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.698173 23689 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.701917 23986 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.704527 24001 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.705029 24001 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:10:17.709204 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.689442 23833 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.675732 21849 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:17.665036 23825 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.723143 23976 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:17.706238 24001 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.725193 23821 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.756073 21999 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:17.759637 22584 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:17.761341 23976 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.783082 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:17.782320 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:17.782793 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.789474 24041 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:17.790235 24041 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:17.795140 21844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 279) took 2721 ms (client timeout 1653 ms). Trace:
W20260709 12:10:17.795683 21844 rpcz_store.cc:269] 0709 12:10:15.051839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.051962 (+   123us) service_pool.cc:224] Handling call
0709 12:10:17.746659 (+2694697us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400292054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.773074 (+ 26415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3856136448}
I20260709 12:10:17.796916 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.797511 23906 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.797959 23906 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:17.789005 23972 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.799131 23906 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.800009 23972 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:17.801466 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.798273 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.783963 21919 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.808986 21846 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:17.777485 23821 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.810715 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:17.812376 21922 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:17.817571 21849 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.786391 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.819991 21999 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.820925 21852 raft_consensus.cc:2410] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:17.822686 22576 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:17.823637 23814 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.806599 23911 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:17.823925 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:17.824415 23825 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:17.824898 22575 raft_consensus.cc:2393] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:17.824664 23911 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.825394 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 476) took 1064 ms. Trace:
I20260709 12:10:17.788419 24042 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.827890 23911 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.828423 24042 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.833092 24042 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.833353 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 481) took 1062 ms. Trace:
I20260709 12:10:17.825814 22575 rpcz_store.cc:276] 0709 12:10:16.761225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.765096 (+  3871us) service_pool.cc:224] Handling call
0709 12:10:17.823689 (+1058593us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76eee 000000000036eb39 00007f3be9cea1e0 00007f3be9db30c4 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:17.825337 (+  1648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5256576}
I20260709 12:10:17.837601 23885 raft_consensus.cc:3055] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.838776 23885 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:17.839808 23821 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:17.840917 22577 rpcz_store.cc:276] 0709 12:10:16.779303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.283332 (+504029us) service_pool.cc:224] Handling call
0709 12:10:17.287077 (+  3745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.312073 (+ 24996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.833142 (+521069us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b540057c6d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.833286 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6530432}
I20260709 12:10:17.842559 23825 consensus_queue.cc:1059] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:17.844099 23825 raft_consensus.cc:3055] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.844519 23825 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:17.835703 23993 consensus_queue.cc:1059] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:17.823963 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:17.844599 24038 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.277s	user 0.002s	sys 0.000s
I20260709 12:10:17.836258 21849 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.858484 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.859378 22577 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:17.859498 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1806) took 1346 ms. Trace:
I20260709 12:10:17.850564 23877 raft_consensus.cc:3055] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.859880 21926 rpcz_store.cc:276] 0709 12:10:16.512700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.700817 (+188117us) service_pool.cc:224] Handling call
0709 12:10:16.701140 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.019452 (+318312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.859044 (+839592us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54003e6cd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:17.859319 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651557248}
I20260709 12:10:17.860417 23877 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:17.861521 23877 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.850533 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:17.851162 23976 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.851483 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 385) took 1073 ms. Trace:
I20260709 12:10:17.851617 22000 raft_consensus.cc:2393] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:17.852074 23918 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:17.856802 23972 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.839845 23885 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.867007 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.867198 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.867616 23885 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.868211 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.869045 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.877624 23730 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.878124 22584 raft_consensus.cc:2410] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:17.870229 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.878337 23730 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.879408 22576 raft_consensus.cc:2393] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:17.870530 22581 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:17.881188 23730 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:17.865352 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:17.871501 23877 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.871984 23918 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.872663 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1482) took 1182 ms. Trace:
I20260709 12:10:17.882634 21850 rpcz_store.cc:276] 0709 12:10:16.689822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.107185 (+417363us) service_pool.cc:224] Handling call
0709 12:10:17.872435 (+765250us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54000901d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.872587 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1317634432}
I20260709 12:10:17.883829 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.864717 21997 rpcz_store.cc:276] 0709 12:10:16.777829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.899813 (+121984us) service_pool.cc:224] Handling call
0709 12:10:17.823666 (+923853us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:17.851396 (+ 27730us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3619584}
W20260709 12:10:17.872565 23850 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.833s	user 0.004s	sys 0.011s
I20260709 12:10:17.884316 23918 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.875800 24041 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:17.878775 23972 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.847713 23825 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.890681 21846 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:17.911319 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.912108 21846 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:17.912974 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.913169 21967 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:17.914536 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.892153 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1584) took 2206 ms. Trace:
I20260709 12:10:17.915227 21851 rpcz_store.cc:276] 0709 12:10:15.685626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.876751 (+191125us) service_pool.cc:224] Handling call
0709 12:10:17.891788 (+2015037us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b540024c554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.891953 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382767360}
I20260709 12:10:17.892269 21849 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:17.916538 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1488) took 1205 ms. Trace:
I20260709 12:10:17.916647 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.916941 21849 rpcz_store.cc:276] 0709 12:10:16.710758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.545711 (+834953us) service_pool.cc:224] Handling call
0709 12:10:17.817033 (+271322us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b54002768a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d1906f 00007f3be4d91f60 00007f3be4d937de 00007f3be4d9f27c 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2
0709 12:10:17.916482 (+ 99449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3303680}
I20260709 12:10:17.917814 21851 raft_consensus.cc:2410] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:17.918123 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.918792 21849 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:17.919219 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1841) took 1369 ms. Trace:
I20260709 12:10:17.919747 24001 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.919791 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.920745 21849 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.922430 23940 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.923481 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.924295 21847 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:17.925981 23979 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.896518 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.929878 22581 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:17.897660 21818 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:17.898033 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.897354 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.899816 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.930751 22584 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:17.919593 21996 rpcz_store.cc:276] 0709 12:10:16.549755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.549988 (+   233us) service_pool.cc:224] Handling call
0709 12:10:16.550377 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.783642 (+233265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.918768 (+1135126us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54002df5d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:17.919049 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472959360}
I20260709 12:10:17.902282 23877 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:17.902904 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet 279111025ee54aba83c27bba63339332 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:10:17.903941 23931 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:17.932061 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:17.932343 23979 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.932821 23979 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.933139 22577 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 2: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:17.898650 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 291) took 1387 ms. Trace:
I20260709 12:10:17.904171 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1479) took 1221 ms. Trace:
I20260709 12:10:17.933681 21848 rpcz_store.cc:276] 0709 12:10:16.511572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.683330 (+171758us) service_pool.cc:224] Handling call
0709 12:10:17.898375 (+1215045us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b540017e8d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.898580 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413285760}
I20260709 12:10:17.934202 21852 rpcz_store.cc:276] 0709 12:10:16.688804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.527698 (+838894us) service_pool.cc:224] Handling call
0709 12:10:17.903950 (+376252us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540011dfd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:17.904082 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588426112}
I20260709 12:10:17.934823 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.935277 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.935468 23689 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.936044 23689 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.936345 21846 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:17.908108 23966 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.936779 23689 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.908737 23905 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.950685 21966 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:17.909610 24037 log.cc:927] Time spent T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 12:10:17.951885 23689 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.926918 24021 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:17.952833 23730 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.953199 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 384) took 1175 ms. Trace:
I20260709 12:10:17.893443 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1846) took 1118 ms. Trace:
I20260709 12:10:17.899839 23847 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:17.935994 23533 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:17.936014 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.902148 23861 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.952234 21966 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:17.929942 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:17.925480 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:17.884876 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.909916 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:17.906276 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:17.954118 22001 rpcz_store.cc:276] 0709 12:10:16.774826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.774979 (+   153us) service_pool.cc:224] Handling call
0709 12:10:16.775243 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.018861 (+243618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.018888 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:17.018922 (+    34us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:17.018948 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.892969 (+874021us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54002d23d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:17.893030 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.893249 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559865088}
I20260709 12:10:17.953074 24021 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:17.961828 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 55624.2us
I20260709 12:10:17.958276 21818 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:17.966554 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:17.966738 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.967725 21848 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
W20260709 12:10:17.969611 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 59888.6us
I20260709 12:10:17.971776 23850 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.972307 23850 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.972745 23850 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.973129 21852 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.973483 21852 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:17.974386 21852 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:17.978961 21849 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:17.978708 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.979897 21846 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:17.980563 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.981367 23980 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.982249 24041 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:17.982848 24041 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:17.985493 21999 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:17.932682 23931 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:17.986722 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 56852.4us
I20260709 12:10:17.988931 23880 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.968390 23909 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.996114 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.996615 21849 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:17.997789 21847 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:17.997869 21818 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:18.001016 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.000698 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:18.002328 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50198.8us
I20260709 12:10:17.953670 21995 rpcz_store.cc:276] 0709 12:10:16.777532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.074259 (+296727us) service_pool.cc:224] Handling call
0709 12:10:17.115933 (+ 41674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:17.174142 (+ 58209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.178083 (+  3941us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:17.277822 (+ 99739us) log.cc:844] Serialized 26 byte log entry
0709 12:10:17.559216 (+281394us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:17.576326 (+ 17110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.603241 (+ 26915us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:17.908797 (+305556us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:17.952710 (+ 43913us) raft_consensus.cc:1685] finished
0709 12:10:17.952732 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.953005 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7533,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":16821,"spinlock_wait_cycles":50958592,"thread_start_us":211239,"threads_started":1,"wal-append.queue_time_us":237297}
I20260709 12:10:17.993829 23877 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.002453 23730 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.989533 23880 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:17.999287 23748 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:17.989957 23980 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:17.994058 23909 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.005944 21852 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.000721 23918 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:18.008121 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:17.999668 23689 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:18.007128 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.011945 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:18.013671 21851 raft_consensus.cc:2393] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:18.014213 23878 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.003078 21843 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:18.014582 23951 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.012567 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:18.016256 21849 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.017726 21848 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:18.017097 23820 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:18.020579 23748 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.021457 23820 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:18.021327 23951 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.021777 23880 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:18.007562 23730 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:18.010644 23877 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:18.024575 23748 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.024398 23877 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.020728 23554 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.025746 23554 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.013154 23909 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.017452 23878 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.027127 23878 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.024324 23980 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.010095 23972 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.020480 23945 consensus_queue.cc:1059] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:18.029104 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 288) took 1509 ms. Trace:
I20260709 12:10:18.031478 22549 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:18.030987 21849 rpcz_store.cc:276] 0709 12:10:16.510844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.000450 (+1489606us) service_pool.cc:224] Handling call
0709 12:10:18.016085 (+ 15635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.019619 (+  3534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.019796 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.028650 24041 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:18.028669 23730 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.030876 23972 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.030465 24021 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:18.036203 23918 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.046243 23918 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:18.039463 23911 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.047405 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1489) took 1318 ms. Trace:
I20260709 12:10:18.047820 21848 rpcz_store.cc:276] 0709 12:10:16.729181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.032331 (+1303150us) service_pool.cc:224] Handling call
0709 12:10:18.043621 (+ 11290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.047015 (+  3394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.047049 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.047093 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:18.047141 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.047206 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.047335 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.049041 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:18.050529 24042 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.050859 24042 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:18.051092 24042 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.038256 21967 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:18.054371 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1487) took 1347 ms. Trace:
W20260709 12:10:18.054868 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 51836.7us
I20260709 12:10:18.054793 21851 rpcz_store.cc:276] 0709 12:10:16.706702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.032069 (+1325367us) service_pool.cc:224] Handling call
0709 12:10:18.053791 (+ 21722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.054010 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.054035 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.054075 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:18.054144 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.054197 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.054311 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.055632 21966 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:18.057376 23945 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.057406 23748 raft_consensus.cc:3055] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:18.057917 23945 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:18.058034 23748 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:18.058455 23945 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.059083 23748 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.060590 23748 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.062201 23866 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.062695 23866 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:18.063125 23866 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.056393 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.070233 21818 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:18.074167 23816 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.042210 23972 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.022492 23820 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:18.081662 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 72021.1us
I20260709 12:10:18.056967 24042 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.075454 23906 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:18.083874 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 45711.1us
I20260709 12:10:18.074904 23816 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:18.085508 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:18.087558 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.090487 23762 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.090909 23762 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.091259 23762 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.079196 23689 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:10:18.093760 23689 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.094139 23689 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:18.092792 21845 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:18.073336 24031 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:18.090065 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.102705 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.105995 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.099238 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1490) took 1349 ms. Trace:
I20260709 12:10:18.079551 23533 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.108047 22001 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:18.109162 21849 rpcz_store.cc:276] 0709 12:10:16.738369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.039000 (+1300631us) service_pool.cc:224] Handling call
0709 12:10:18.069677 (+ 30677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.077230 (+  7553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.077271 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.081059 (+  3788us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:18.087706 (+  6647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.087795 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.087935 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:18.107491 23975 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.119022 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.117755 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:18.119712 22001 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:18.110359 23533 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.124516 23911 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.127264 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.106804 23979 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.129302 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.121318 23931 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.127067 23533 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.127410 23911 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.123562 23951 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.142975 21893 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:18.147603 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 71768.5us
I20260709 12:10:18.125808 23975 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.154874 21852 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:18.146631 23966 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.149303 23931 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.156307 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.156020 23816 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.149585 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.159744 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:18.164347 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.147228 23911 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:18.149238 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 53944.7us
I20260709 12:10:18.163125 23931 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.169355 23931 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.165344 23966 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.171126 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 286) took 1661 ms. Trace:
I20260709 12:10:18.171540 21845 rpcz_store.cc:276] 0709 12:10:16.510128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.515881 (+  5753us) service_pool.cc:224] Handling call
0709 12:10:18.170880 (+1654999us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400208d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:18.171052 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3235864960}
I20260709 12:10:18.172909 23966 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.173326 21845 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:18.174777 24054 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.168948 21849 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:18.181216 24031 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.181658 24031 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.181998 24031 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.191519 23895 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:18.192549 21843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1484) took 1494 ms (client timeout 1619 ms). Trace:
I20260709 12:10:18.192682 24042 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.195592 21844 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:18.199729 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.197949 23966 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.202273 23966 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:18.205063 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 77962.8us
W20260709 12:10:18.206528 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.193128 21843 rpcz_store.cc:269] 0709 12:10:16.698594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.275469 (+576875us) service_pool.cc:224] Handling call
0709 12:10:18.192356 (+916887us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54003e3fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:18.192482 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869406976}
I20260709 12:10:18.231752 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.231377 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:18.158885 23689 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.249400 21922 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.229895 21995 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:18.229265 23825 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.253670 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.175469 24054 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.234949 23979 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:18.259811 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.261293 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.264684 22549 leader_election.cc:400] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:18.265201 22549 leader_election.cc:403] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:18.265918 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 69117.2us
W20260709 12:10:18.267391 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 116714us
I20260709 12:10:18.270107 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:18.272615 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.269992 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:18.275810 21997 raft_consensus.cc:2393] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:18.277840 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.278615 21919 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:18.279721 23762 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.280922 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.281095 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.281703 21919 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:18.281806 23762 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:18.283280 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.283924 21919 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
W20260709 12:10:18.286186 24052 log.cc:927] Time spent T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:18.273500 23820 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:18.286401 21919 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:18.287319 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.287947 21996 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:18.289335 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.292523 23966 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:18.294821 24051 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:10:18.294766 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.295482 21927 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:18.296345 23908 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.296765 23908 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.297117 23908 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.298592 21849 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:18.300495 23690 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.301007 23690 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.302017 22583 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
W20260709 12:10:18.304517 24053 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.096s	user 0.003s	sys 0.000s
I20260709 12:10:18.305452 23820 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.306007 23820 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:18.306672 23820 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.312445 21846 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:10:18.312590 23554 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:18.313506 23847 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.314011 23847 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:18.316057 23909 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.312898 21846 pending_rounds.cc:85] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 5
I20260709 12:10:18.322031 21846 pending_rounds.cc:107] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:18.322258 21851 raft_consensus.cc:2410] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:18.322399 21846 raft_consensus.cc:2889] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:18.324244 21846 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:18.321607 21849 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:18.327872 21849 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:18.329033 23975 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.332387 21851 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:18.336665 23847 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.329174 23850 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.339720 21844 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:18.340104 21844 pending_rounds.cc:85] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 2
I20260709 12:10:18.340327 21844 pending_rounds.cc:107] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:18.340716 23850 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:18.346774 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 76856.4us
I20260709 12:10:18.347000 23945 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.348914 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.349362 23945 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:18.350274 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.350589 22001 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.351128 21999 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:18.341917 23690 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:18.340728 21844 raft_consensus.cc:2889] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:18.243391 23878 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.341375 21851 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:18.342576 21852 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.354182 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:18.354341 23878 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.355284 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:18.355968 21852 raft_consensus.cc:2368] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:18.356739 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.357765 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.261664 24042 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 12:10:18.355368 23689 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.358695 23820 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.360301 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.373757 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:18.350310 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.374552 21844 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.342072 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.358278 21852 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:18.367318 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:18.368727 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1485) took 1667 ms. Trace:
I20260709 12:10:18.360301 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.269838 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.381583 21922 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:18.383818 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:18.384788 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 116173us
I20260709 12:10:18.389622 21817 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:18.392297 21846 raft_consensus.cc:2393] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:18.318356 23909 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:18.390403 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:18.345916 23972 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.393781 22584 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.368846 23945 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.400264 21850 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
W20260709 12:10:18.394160 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.403003 21892 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:18.376180 21847 rpcz_store.cc:276] 0709 12:10:16.698871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.004410 (+1305539us) service_pool.cc:224] Handling call
0709 12:10:18.034973 (+ 30563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.070090 (+ 35117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.070118 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:18.088563 (+ 18445us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.198988 (+110425us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:18.199032 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.199122 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:18.362119 (+162997us) raft_consensus.cc:1685] finished
0709 12:10:18.362138 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.365971 (+  3833us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1945,"raft.queue_time_us":3002,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":133,"thread_start_us":86670,"threads_started":1,"wal-append.queue_time_us":163519}
I20260709 12:10:18.396585 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:18.411430 21851 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.411669 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:18.397234 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.412451 21999 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.412985 21852 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 7 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:10:18.414235 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.423416 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.424124 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.424518 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.427686 21848 raft_consensus.cc:2368] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:18.394940 23719 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.429766 21997 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:18.424819 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.435753 22001 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.424816 21843 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:18.415303 23905 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:18.450069 21996 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:18.449074 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:18.428885 24061 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:18.457858 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.449589 23909 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.439127 24021 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.407691 23945 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.443522 24041 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:18.473647 24062 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:18.478818 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.482389 21844 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:18.457410 23905 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:18.465201 24042 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.490159 21999 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:18.485400 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:18.500689 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.507946 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.481194 21845 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:18.522715 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.523401 21999 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
W20260709 12:10:18.518563 22549 leader_election.cc:336] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.859s (SENT)
I20260709 12:10:18.528718 22549 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:18.493332 24042 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:18.539294 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.483256 23909 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.527288 23820 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:18.492973 24058 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:10:18.535382 24042 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.493634 24041 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.476023 24061 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.551688 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.558916 22001 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:18.530943 23850 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.554391 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.560727 21999 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:18.546985 23825 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.548187 23719 raft_consensus.cc:697] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:18.557395 24054 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:18.578684 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 60161.9us
W20260709 12:10:18.584388 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.556589 23931 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.558403 23866 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:18.599673 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 114396us
I20260709 12:10:18.607712 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:18.565667 23850 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.624699 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:18.563637 23905 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.630383 21997 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
W20260709 12:10:18.629410 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 206426us
I20260709 12:10:18.607890 23972 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.607318 24057 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:18.678956 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 71316.4us
I20260709 12:10:18.679482 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.686383 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:18.686645 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.687207 21921 raft_consensus.cc:2393] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:18.691039 21851 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:18.677038 23825 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:18.693387 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 73589.4us
I20260709 12:10:18.678450 23918 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:18.697189 24068 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:18.697579 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.698770 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:18.699406 21924 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.699956 23866 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.708279 23885 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:18.708484 23850 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:18.709007 23885 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.710827 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:18.711006 24079 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:18.713083 23885 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.713265 24079 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.713841 24079 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:18.714358 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:18.715252 21851 raft_consensus.cc:2368] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
W20260709 12:10:18.715183 21736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d50c36e857cb4e33997aee7e5dd39447 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cffb5c192e144f7caa7b94271976ed42 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:18.716583 24061 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:18.716938 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.717342 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.719762 24063 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:10:18.720265 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:18.721844 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.723023 21844 raft_consensus.cc:2410] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:18.714201 24079 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.731076 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.732740 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:18.726468 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:18.735208 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:18.735842 21852 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:18.736006 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:18.736253 23820 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.737258 23820 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:18.737493 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.737887 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:18.738554 21918 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.739363 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:18.740844 24056 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.741350 24056 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.692799 23719 consensus_queue.cc:237] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.742522 24071 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.742838 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:18.743065 21817 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:18.743510 22576 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:18.710923 23945 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.745226 21849 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:18.740661 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:18.741093 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:18.679137 24031 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.737282 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:18.747031 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:18.749401 21918 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:18.744052 21817 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:18.760950 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1590) took 1131 ms. Trace:
I20260709 12:10:18.761417 21850 rpcz_store.cc:276] 0709 12:10:17.629923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.883506 (+253583us) service_pool.cc:224] Handling call
0709 12:10:18.760742 (+877236us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400401ad4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:18.760872 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046664448}
I20260709 12:10:18.761976 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:18.763437 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.741528 23847 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.744074 23972 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.694097 23911 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.751087 23820 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:18.770956 23690 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.771230 23820 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.771637 24054 raft_consensus.cc:1064] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:10:18.771598 23690 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.773759 23690 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.774385 23949 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.775077 23949 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.693038 24057 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.775535 23949 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.775864 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:18.776342 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:18.777292 24057 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:18.774899 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:18.756515 24061 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.757354 23909 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:18.721676 23918 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.756767 23878 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.778378 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:18.770967 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:18.795538 22582 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.779698 22583 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:18.796829 22001 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:18.782984 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.794749 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:18.782572 21918 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:18.785760 21817 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:18.756747 24058 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:18.802624 22584 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:18.798292 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:18.774641 24076 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:18.787241 24041 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.767201 21924 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:18.782529 23825 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.797729 22580 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:18.779524 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:18.789728 24071 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:18.888507 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 110166us
I20260709 12:10:18.892572 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:18.911352 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.911926 21921 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.912180 21922 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:18.786988 23979 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:18.810089 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 72912.1us
I20260709 12:10:18.778625 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:18.884621 23878 raft_consensus.cc:697] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:18.897902 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.898540 23931 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.899385 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:18.901738 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:18.903076 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 117422us
I20260709 12:10:18.890120 23825 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:18.906529 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.906888 24061 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:18.907505 23748 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.907999 23762 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:18.916338 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:18.794617 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:18.922705 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:10:18.804446 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 57545.5us
I20260709 12:10:18.804343 23866 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.779819 23969 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.135s
I20260709 12:10:18.968829 21818 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:18.988078 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 65498.8us
I20260709 12:10:18.896339 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:18.940277 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 142035us
I20260709 12:10:18.774070 24054 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:18.903594 23975 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:18.945407 21926 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.909600 24073 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.909700 23940 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:18.916811 23945 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:18.928548 22575 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.783933 23972 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:18.948956 23689 consensus_meta.cc:287] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.004s
I20260709 12:10:18.944876 24042 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:18.972752 22576 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.954905 23825 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.920909 24076 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.033329 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.034212 23918 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:18.968626 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:19.035189 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 66626.3us
W20260709 12:10:19.013355 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.016353 23975 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.953105 22578 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:18.960959 24041 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.919209 22581 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:18.963012 24056 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:18.973131 24021 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:19.027276 23931 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.027760 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:18.971547 23748 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:18.987229 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:19.032744 21851 raft_consensus.cc:2410] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:19.024611 23861 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.999699 22584 raft_consensus.cc:2368] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:19.040864 23980 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.039812 21927 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.963827 23979 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.042164 21966 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:18.973659 23866 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:19.039616 23908 consensus_meta.cc:287] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.006s
I20260709 12:10:19.023151 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:19.057641 23730 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.013s	user 0.013s	sys 0.000s
I20260709 12:10:19.036275 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:18.946138 24071 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.040288 23689 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.041793 23975 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.061581 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:19.063483 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 94737.7us
I20260709 12:10:19.020228 23945 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.068897 21920 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:19.057222 23533 consensus_meta.cc:287] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.898s	user 0.010s	sys 0.002s
I20260709 12:10:19.027201 23905 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:19.010766 23762 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.011080 23878 consensus_queue.cc:237] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.075345 21922 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:19.053632 24076 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.078398 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:19.094515 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.041357 23820 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.041709 24058 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:19.070403 23911 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.018561 24073 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.060370 23931 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.086388 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:19.062251 24062 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:19.085870 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 62856.5us
I20260709 12:10:19.059032 23861 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:19.062543 23980 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.076702 21818 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:19.098299 21925 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:19.104132 23866 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:19.105180 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 68978.1us
I20260709 12:10:19.075567 23816 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.076110 23689 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.080775 21924 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.115960 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:19.123443 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 45147.5us
I20260709 12:10:19.075595 23730 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.104172 23820 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.112941 24091 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.138897 23969 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:19.139540 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:19.160175 21927 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.114364 24068 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:19.141486 23748 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.059721 24061 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.112527 21923 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:19.148900 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:19.147327 21849 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:19.145529 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:19.171211 21922 raft_consensus.cc:2393] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:19.147202 21921 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
W20260709 12:10:19.147049 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 70460.4us
I20260709 12:10:19.150624 22582 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:19.152997 21926 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:19.153445 21918 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:19.172678 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.173267 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.155457 23689 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:19.153841 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.073748 23908 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.109962 23880 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.095152 23909 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.095907 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:19.140604 23945 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:19.104454 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:19.161628 24080 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:10:19.164813 21893 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:19.165364 23972 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.111696 24076 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.146601 23861 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.082245 23533 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.148597 23980 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.144608 24089 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.174902 21818 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:19.176608 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.155431 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:19.183606 21918 raft_consensus.cc:2393] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:19.187826 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.191591 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:19.179271 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.195721 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:19.248471 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:19.205715 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:19.249063 21967 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:19.210198 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 61379.3us
I20260709 12:10:19.229206 21924 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
W20260709 12:10:19.214643 24083 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:10:19.253269 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.254114 21924 raft_consensus.cc:2410] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:19.165858 23816 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.235929 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:19.175549 24090 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:19.256790 22583 raft_consensus.cc:2368] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:19.154140 24062 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.184082 23949 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.206846 21893 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:19.255425 22582 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:19.256515 21927 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
W20260709 12:10:19.266918 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 60176us
I20260709 12:10:19.267534 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:19.259337 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.263589 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.264750 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.256366 23906 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:19.245198 24042 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.266250 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:19.286798 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.291240 21918 raft_consensus.cc:2410] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:19.260453 24058 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.293099 24058 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:19.293529 24058 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.294880 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:19.288231 21997 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:19.267685 21893 leader_election.cc:400] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:19.298589 21893 leader_election.cc:403] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:19.268126 21999 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:19.215782 24021 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.235260 24041 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:19.265736 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:19.283174 21847 raft_consensus.cc:2368] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:19.323204 24021 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.173476 24068 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.265998 23945 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.252525 23880 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:19.345319 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47810.5us
W20260709 12:10:19.349484 24085 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:10:19.260224 22575 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
W20260709 12:10:19.329448 24087 log.cc:927] Time spent T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:10:19.282593 24076 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.350075 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:19.270314 24065 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:19.331568 24082 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:19.326987 24021 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.328176 23918 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:19.332034 23979 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:19.342941 24042 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:19.453896 23880 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.496755 24088 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:19.496861 24098 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.393793 24094 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:10:19.401505 24076 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:19.253453 24089 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.525614 23918 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:19.556226 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 381372us
W20260709 12:10:19.556447 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 206444us
I20260709 12:10:19.379944 23945 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.564800 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:10:19.564905 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 359265us
I20260709 12:10:19.558516 21927 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:19.568225 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:19.569065 22582 raft_consensus.cc:2410] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:19.515360 23762 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:19.575520 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:19.526567 23931 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.580080 21926 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.558454 24076 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.582787 21922 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:19.601562 21818 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:19.604013 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 77106.4us
I20260709 12:10:19.535914 24042 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.609397 23949 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:19.610443 24062 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:19.612670 23533 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:19.594013 23909 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.614933 23909 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.617214 23909 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.600069 23908 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.594090 23918 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:19.583724 24069 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.595590 24099 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.605502 23730 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:19.627349 24099 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.626650 23816 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:19.627782 24099 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.629861 22582 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:19.626694 24069 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:19.630936 24069 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.640612 23861 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.641790 21850 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:19.631568 23945 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:19.564266 24098 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.644299 23861 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.633209 24089 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:19.644541 24098 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.645888 24068 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:19.594345 24031 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:19.648293 23689 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:19.650583 21750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58736 (request call id 278) took 11525 ms (client timeout 15000 ms). Trace:
W20260709 12:10:19.651799 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 78062.6us
I20260709 12:10:19.733016 24069 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:19.734243 22549 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:19.588881 24070 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:10:19.632671 22582 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.589911 24088 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:19.670768 21922 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:19.658576 23825 consensus_meta.cc:287] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.613s	user 0.005s	sys 0.005s
W20260709 12:10:19.676910 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.762470 23825 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:19.765058 23825 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:19.765771 23825 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:19.770805 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 192704us
I20260709 12:10:19.723733 24089 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:19.746961 23909 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:19.783011 21892 leader_election.cc:400] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
W20260709 12:10:19.748085 21920 consensus_meta.cc:287] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.001s
I20260709 12:10:19.786985 21920 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:19.784221 21892 leader_election.cc:403] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:19.740257 23908 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:10:19.769526 22579 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:19.779007 23847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.022s	sys 0.034s
W20260709 12:10:19.911855 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.784631 23909 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:19.998438 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:19.730975 21750 rpcz_store.cc:269] 0709 12:10:08.125523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.125854 (+   331us) service_pool.cc:224] Handling call
0709 12:10:19.650503 (+11524649us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:17.832468 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:17.833205 (+   737us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:17.833257 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:10:17.833277 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:17.834022 (+   745us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:17.834093 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:17.834128 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:17.834635 (+   507us) tablet.cc:701] Row locks acquired
0709 12:10:17.834691 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:10:17.834887 (+   196us) write_op.cc:270] Start()
0709 12:10:17.835056 (+   169us) write_op.cc:276] Timestamp: P: 1783599017834824 usec, L: 0
0709 12:10:17.835091 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:10:17.838166 (+  3075us) log.cc:844] Serialized 1684 byte log entry
0709 12:10:18.202606 (+364440us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b18002de620. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:18.619232 (+416626us) op_driver.cc:464] REPLICATION: finished
0709 12:10:18.939079 (+319847us) write_op.cc:301] APPLY: starting
0709 12:10:18.939193 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:18.969423 (+ 30230us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:18.974950 (+  5527us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:19.048887 (+ 73937us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:19.049330 (+   443us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:19.049417 (+    87us) write_op.cc:312] APPLY: finished
0709 12:10:19.134999 (+ 85582us) log.cc:844] Serialized 41 byte log entry
0709 12:10:19.160804 (+ 25805us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:19.169437 (+  8633us) write_op.cc:454] Released schema lock
0709 12:10:19.174137 (+  4700us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:19.332371 (+158234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:19.342976 (+ 10605us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2523087,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":308731,"apply.run_cpu_time_us":4224,"apply.run_wall_time_us":343730,"num_ops":4,"prepare.queue_time_us":176240,"prepare.run_cpu_time_us":44456,"prepare.run_wall_time_us":176418,"raft.queue_time_us":266051,"raft.run_cpu_time_us":13784,"raft.run_wall_time_us":216183,"replication_time_us":742263,"spinlock_wait_cycles":4427136,"thread_start_us":461492,"threads_started":4,"wal-append.queue_time_us":139188}]]}
W20260709 12:10:20.017452 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 235833us
I20260709 12:10:20.021875 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:20.026604 21997 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:20.028005 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:20.028924 21851 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
W20260709 12:10:20.017452 23847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.023s	sys 0.034s
I20260709 12:10:20.031235 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:20.035635 21849 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:20.033169 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:20.022001 23909 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:20.038615 21846 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:20.042873 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:20.043466 21844 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
W20260709 12:10:20.032826 22576 consensus_meta.cc:287] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.991s	user 0.011s	sys 0.000s
I20260709 12:10:20.045338 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:20.021322 24105 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:20.025729 23880 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.047082 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:20.051928 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:20.052436 21849 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:20.052518 21844 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:19.785719 24089 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.050068 23931 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.060035 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:20.046656 22576 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:20.034909 23719 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:10:20.074991 21927 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:20.081107 23690 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.081709 23690 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:20.082573 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 481059us
I20260709 12:10:20.083261 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:20.085660 24099 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.086946 24103 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.087414 23949 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.087610 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:20.104646 22582 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:20.088032 23533 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.088446 24092 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:20.091497 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 323958us
I20260709 12:10:20.095491 24069 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:20.053237 24106 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.063476 23908 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.066658 23931 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:20.065550 24105 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:20.108109 24021 consensus_meta.cc:287] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.003s
I20260709 12:10:20.106071 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 502) took 1361 ms. Trace:
W20260709 12:10:20.127172 23980 consensus_meta.cc:287] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.867s	user 0.002s	sys 0.006s
W20260709 12:10:20.139036 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 82645.9us
I20260709 12:10:20.134788 23949 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:20.143698 23940 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.055094 23880 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.125486 23533 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.105635 24042 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:20.157699 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.160377 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 88317.4us
I20260709 12:10:20.184114 23949 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.136346 23931 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.189181 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:20.190721 22582 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.145056 24091 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:20.189723 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1616) took 1088 ms. Trace:
W20260709 12:10:20.162308 23975 consensus_meta.cc:287] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.077s	user 0.002s	sys 0.008s
W20260709 12:10:20.192950 21815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.012s	sys 0.010s
W20260709 12:10:20.192859 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 43764.3us
I20260709 12:10:20.195035 21892 leader_election.cc:400] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:20.126729 24103 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.195916 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:20.196659 21815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.012s	sys 0.010s
W20260709 12:10:20.200076 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.162930 23533 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.159302 23940 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:20.182729 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:20.132285 24092 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.148481 22576 rpcz_store.cc:276] 0709 12:10:18.744798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.756198 (+ 11400us) service_pool.cc:224] Handling call
0709 12:10:20.102134 (+1345936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.189651 23689 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.137437 23908 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:20.194080 24079 consensus_meta.cc:287] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.430s	user 0.011s	sys 0.002s
I20260709 12:10:20.156360 24021 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.226796 24105 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.232772 23880 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.234858 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 655) took 1455 ms. Trace:
I20260709 12:10:20.235214 24089 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:20.236850 24086 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.067s	user 0.014s	sys 0.010s
I20260709 12:10:20.236742 24099 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.201505 23972 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.209179 24091 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.159036 23980 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.201112 23975 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:20.429486 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.427234 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.242986 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47130.5us
I20260709 12:10:20.456692 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:20.407222 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:20.247459 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:20.457801 21846 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 1.
I20260709 12:10:20.191721 21848 rpcz_store.cc:276] 0709 12:10:19.097520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.109840 (+ 12320us) service_pool.cc:224] Handling call
0709 12:10:19.150095 (+ 40255us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:19.158283 (+  8188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.158333 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:19.174260 (+ 15927us) log.cc:844] Serialized 52 byte log entry
0709 12:10:19.526996 (+352736us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:19.573112 (+ 46116us) log.cc:844] Serialized 14 byte log entry
0709 12:10:20.078021 (+504909us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b1800174f40. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be4d93060 00007f3be4da5716 00007f3be4db6287 00007f3be4db6208
0709 12:10:20.185954 (+107933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.186021 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.186073 (+    52us) raft_consensus.cc:1685] finished
0709 12:10:20.186147 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.186288 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30204,"prepare.queue_time_us":45861,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2785,"raft.queue_time_us":526562,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":216,"spinlock_wait_cycles":19460480,"thread_start_us":187963,"threads_started":2,"wal-append.queue_time_us":449852}
W20260709 12:10:20.251948 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.312106 22549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.010s	sys 0.019s
W20260709 12:10:20.475242 22549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.010s	sys 0.025s
I20260709 12:10:20.238387 24103 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:20.475797 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 740313us
I20260709 12:10:20.476485 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:20.382547 22582 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:20.458444 21964 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:20.421121 24090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.076s	user 0.012s	sys 0.050s
W20260709 12:10:20.246392 24076 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
I20260709 12:10:20.575717 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:20.576566 22584 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.235273 22580 rpcz_store.cc:276] 0709 12:10:18.779327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.895920 (+116593us) service_pool.cc:224] Handling call
0709 12:10:19.039919 (+143999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.049634 (+  9715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.049680 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.061151 (+ 11471us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.257533 (+196382us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:19.257572 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.257641 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.614493 (+356852us) raft_consensus.cc:1685] finished
0709 12:10:19.614512 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.234564 (+620052us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b54006a45d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:20.234777 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4139,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7546,"spinlock_wait_cycles":226243328,"thread_start_us":110275,"threads_started":1,"wal-append.queue_time_us":347261}
I20260709 12:10:20.239737 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1607) took 1518 ms. Trace:
W20260709 12:10:20.357002 24086 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 12:10:20.243441 24113 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 12:10:20.252323 24058 consensus_meta.cc:287] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.958s	user 0.010s	sys 0.000s
I20260709 12:10:20.569325 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:20.241750 24111 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:10:20.401213 24089 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:20.240562 24092 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.300717 23689 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.249266 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:20.570866 24103 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.432164 22579 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:20.242671 23690 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.249598 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:20.238634 23972 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.591881 24068 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.249941 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:20.633090 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:20.582844 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:20.433540 24021 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.423367 24102 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:20.569113 24090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.012s	sys 0.050s
I20260709 12:10:20.599538 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:20.586740 23931 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.491357 23918 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.608179 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:20.252827 24079 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.619331 22576 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.425071 23909 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.620728 21923 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.585268 24041 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.328940 23908 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:20.630877 22549 leader_election.cc:400] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:20.656196 22549 leader_election.cc:403] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:20.423223 23980 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.239111 23940 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.588995 24042 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.589143 24091 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.631772 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:20.664098 21918 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:20.588069 24118 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.615773 24054 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.610548 24105 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:20.617132 22584 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:20.648989 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:20.652447 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 198292us
I20260709 12:10:20.677223 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:20.678975 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:20.652684 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.588268 23719 consensus_queue.cc:1059] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:10:20.619437 23816 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:20.681898 23816 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.660116 24021 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.682785 24021 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.683040 21815 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:20.684032 23816 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:20.684224 24091 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.684674 23816 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.685316 23816 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.586076 24076 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.668424 21921 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.615088 23866 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:20.670888 22582 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:20.674934 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:20.679531 21923 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.638353 24090 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:20.605615 24058 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.611711 24089 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.649655 23690 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:20.684806 24091 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:20.669124 24117 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:20.664538 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:20.637820 24068 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.635784 22581 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:20.619320 23689 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.684732 24021 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:20.619527 24103 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.688689 21924 raft_consensus.cc:2410] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:20.709185 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:20.689985 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:20.649330 24062 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:20.698339 21923 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:20.702316 23689 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.692338 24058 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:20.738991 24130 log.cc:927] Time spent T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:20.723718 24117 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.690831 24090 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.694077 23690 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.688063 24076 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.695652 23816 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:20.688998 23866 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.698047 23975 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:20.725502 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 451) took 1962 ms. Trace:
I20260709 12:10:20.696926 23972 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.732878 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:20.723114 23719 raft_consensus.cc:3055] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:20.698487 24068 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.694751 24091 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.659987 24092 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.686584 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:20.693780 24089 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:20.685468 24122 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:20.746735 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:20.826035 21817 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:20.650136 24102 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:20.756385 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 298031us
I20260709 12:10:20.705914 23980 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.708109 24106 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.696911 21919 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:20.740556 24117 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.835232 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:20.836031 22001 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:20.748209 24126 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:10:20.744475 23690 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:20.670135 24042 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.781447 23719 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:10:20.798825 24128 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:10:20.799930 24092 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.839120 23719 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.840353 23719 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.840621 24092 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.811480 23866 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.841105 24121 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.705341 24054 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.843343 24054 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.708324 24105 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.845429 24105 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.848156 22000 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:20.849345 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:20.850142 21992 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.854739 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:20.855655 21997 raft_consensus.cc:2410] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:20.857578 21964 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:20.859243 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:20.826830 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:20.830914 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 144409us
I20260709 12:10:20.816082 23931 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:20.862116 22001 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:20.884426 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:20.899343 21964 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:20.829187 22576 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:20.705824 24118 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.836352 24117 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:20.829643 23972 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.903503 23866 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.917969 23885 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:10:20.827769 24068 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:20.921695 24068 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:20.902571 22575 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:20.913952 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:20.861786 24042 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.910058 23980 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.916707 24058 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:20.581261 21843 rpcz_store.cc:276] 0709 12:10:18.721732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.726210 (+  4478us) service_pool.cc:224] Handling call
0709 12:10:18.736806 (+ 10596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.737226 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.737258 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:18.762889 (+ 25631us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.047186 (+284297us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:19.203407 (+156221us) log.cc:844] Serialized 14 byte log entry
0709 12:10:19.251123 (+ 47716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.256752 (+  5629us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.236547 (+979795us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b2400110768. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1b349c4 00007f3be1b32acb 00007f3be1ceddc9 00007f3be1ceda55 00007f3be1ced09d 00007f3be491f10e 00007f3be493688c 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221
0709 12:10:20.239402 (+  2855us) raft_consensus.cc:1685] finished
0709 12:10:20.239522 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.239659 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3960,"prepare.queue_time_us":164474,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":276671,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":20612,"spinlock_wait_cycles":107602176,"thread_start_us":223411,"threads_started":2,"wal-append.queue_time_us":272090}
I20260709 12:10:20.917513 24079 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:20.919373 24118 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:20.877771 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 294979us
I20260709 12:10:20.774243 22579 rpcz_store.cc:276] 0709 12:10:18.762988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.763865 (+   877us) service_pool.cc:224] Handling call
0709 12:10:18.899280 (+135415us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76eee 000000000036eb39 00007f3be9cea1e0 00007f3be9db30c4 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:20.725256 (+1825976us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54004ad3d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:20.725413 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891315456}
I20260709 12:10:20.905323 24054 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.930799 22584 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:20.932127 22549 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:20.933981 21736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d50c36e857cb4e33997aee7e5dd39447 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cffb5c192e144f7caa7b94271976ed42 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:20.923347 23972 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.933508 23690 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:20.937458 22001 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.938103 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:20.938521 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.939766 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1625) took 1860 ms. Trace:
W20260709 12:10:20.943581 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.942239 24133 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:10:20.944937 24133 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.945509 24133 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.931196 23885 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:10:20.946535 24073 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.947455 23885 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:20.947904 24079 consensus_queue.cc:1059] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:20.948603 24079 consensus_queue.cc:1243] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:20.949115 24079 raft_consensus.cc:3055] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:20.949283 24103 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.942580 23909 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:20.947947 23885 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:20.950927 24071 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.952489 23885 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:20.939376 23972 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:20.965590 21847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1611) took 2235 ms (client timeout 2026 ms). Trace:
I20260709 12:10:20.965015 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:20.966461 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 506390us
I20260709 12:10:20.940120 21926 rpcz_store.cc:276] 0709 12:10:19.079599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.596126 (+516527us) service_pool.cc:224] Handling call
0709 12:10:20.435627 (+839501us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:20.435870 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.436276 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:20.588463 (+152187us) log.cc:844] Serialized 14 byte log entry
0709 12:10:20.935133 (+346670us) log.cc:844] Serialized 14 byte log entry
0709 12:10:20.935323 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.935371 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:20.935550 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.935617 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.939700 (+  4083us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2970,"prepare.queue_time_us":232205,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":7327,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":198,"spinlock_wait_cycles":6548224,"thread_start_us":455597,"threads_started":2}
I20260709 12:10:20.969082 22001 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:20.970284 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:20.966046 21847 rpcz_store.cc:269] 0709 12:10:18.730376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.730594 (+   218us) service_pool.cc:224] Handling call
0709 12:10:20.965369 (+2234775us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400400954. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:20.965506 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164684672}
I20260709 12:10:20.940244 23825 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.873862 21992 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:20.976176 21966 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:20.953445 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:20.949482 24079 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:20.959668 24068 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:20.985713 21966 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:21.098441 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 112766us
I20260709 12:10:21.099293 21966 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:20.985641 21893 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:21.027822 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.983599 24054 consensus_queue.cc:1059] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:10:20.964641 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:20.984189 22584 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:21.120314 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:21.121243 22584 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.137235 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:21.138584 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 153025us
I20260709 12:10:21.141304 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.142118 21923 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:21.143428 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.144946 21966 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:21.001883 23885 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:21.154872 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.162673 22584 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:21.163751 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.168397 21923 raft_consensus.cc:2368] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5.
I20260709 12:10:21.163872 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.175158 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:21.166903 22576 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:21.146162 23931 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.152554 24089 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.159062 23719 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.152745 23980 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:21.179338 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 211421us
I20260709 12:10:21.167806 23885 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.180267 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.152032 24139 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.181372 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.149734 24137 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:21.181368 21966 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:21.299105 21923 raft_consensus.cc:2393] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:21.299582 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 118264us
I20260709 12:10:21.244786 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1613) took 2216 ms. Trace:
I20260709 12:10:21.300197 21921 rpcz_store.cc:276] 0709 12:10:19.028115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.538016 (+509901us) service_pool.cc:224] Handling call
0709 12:10:19.558281 (+ 20265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.688232 (+1129951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.244482 (+556250us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003f02d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:21.244709 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2552665984}
I20260709 12:10:21.204449 23866 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.255151 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.192304 22584 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:21.301332 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.248874 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.177812 22579 raft_consensus.cc:2393] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:10:21.256127 21920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 271) took 2568 ms (client timeout 2899 ms). Trace:
I20260709 12:10:21.256876 21925 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 6. Ops: []
I20260709 12:10:21.269104 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:21.267988 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.310942 22582 raft_consensus.cc:2393] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:21.181957 23931 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.178273 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.204799 23945 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:21.205343 23980 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:21.203760 24141 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.264134 23949 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:21.189237 23885 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.243510 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.180325 24089 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.189888 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.340453 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.341636 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.208916 23825 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:21.176502 24079 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:21.194157 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.203049 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.242048 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.350533 22000 raft_consensus.cc:2393] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:21.350356 21999 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:21.263506 21817 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:21.351235 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 87797.3us
I20260709 12:10:21.320680 23945 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:21.176095 23816 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:21.251582 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.215885 23940 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.289258 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.187397 23719 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.188362 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.360625 21926 raft_consensus.cc:2393] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:10:21.250651 22547 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.899s (SENT) [suppressed 31 similar messages]
I20260709 12:10:21.245781 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.188411 21992 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:21.181070 23533 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.890s	user 0.006s	sys 0.006s
I20260709 12:10:21.293781 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:21.293401 23906 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.299095 24137 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:21.306161 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.377975 21923 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:21.307385 21921 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:21.308733 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:21.379386 21846 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.379285 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:21.307438 21918 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:21.357316 24119 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:21.233865 24133 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:21.278199 24102 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:21.282390 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:21.307837 21920 rpcz_store.cc:269] 0709 12:10:18.687727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.695351 (+  7624us) service_pool.cc:224] Handling call
0709 12:10:18.775608 (+ 80257us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:21.255873 (+2480265us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540008f054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:21.256017 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683627136}
I20260709 12:10:21.315021 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.393239 22584 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
W20260709 12:10:21.299947 24041 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.000s
I20260709 12:10:21.310151 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.318858 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:21.298719 24139 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:21.326550 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:21.327921 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.330945 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.310871 24091 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.336525 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:21.413940 24091 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:21.336746 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.415606 23945 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:21.416410 24091 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:21.417021 23945 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.417239 21847 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:21.374573 24079 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.418527 23980 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.419487 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:21.419818 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 101032us
I20260709 12:10:21.420096 21847 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:21.337432 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.421018 21964 leader_election.cc:400] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5.
I20260709 12:10:21.421319 21964 leader_election.cc:403] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.421293 21850 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:21.337983 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.396128 21992 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:21.422610 21851 raft_consensus.cc:2410] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:21.422940 21852 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:21.318204 22581 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.320223 24090 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:21.378690 21919 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:21.429903 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.242794 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.208098 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1632) took 2043 ms. Trace:
I20260709 12:10:21.323462 24141 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.327521 23690 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.457944 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.458756 21993 raft_consensus.cc:2393] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:21.458472 23690 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.458763 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.459596 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.461179 23690 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:21.428642 24041 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.461797 24141 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.429775 22579 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:21.428328 24133 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.464298 24133 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:21.464779 24133 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.323729 24061 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.427239 24139 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.466624 24061 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:21.467463 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.468314 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:21.467742 24061 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.469151 24061 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.470265 24058 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:21.470714 24058 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:21.342785 22575 raft_consensus.cc:2393] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:21.471081 24058 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.461812 23885 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:21.472807 22575 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:21.473174 23885 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:21.339507 24089 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.475829 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.476632 21995 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.359727 21817 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:21.478768 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 120282us
I20260709 12:10:21.481891 21922 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:21.482318 21922 pending_rounds.cc:85] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 1
I20260709 12:10:21.482570 21922 pending_rounds.cc:107] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:21.482683 23690 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:21.339763 24147 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.372166 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 78473.1us
I20260709 12:10:21.483348 23931 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:21.357692 22577 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:21.485044 22577 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:21.341224 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:21.380645 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.491813 21918 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:21.306819 23880 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.378530 22578 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:21.382633 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.376560 23533 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.384766 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.495322 21921 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:21.385390 23719 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:21.379911 23906 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.385741 24071 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.390782 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.499449 21923 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:21.392439 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:21.394428 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.501375 22584 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:21.338583 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:21.502743 21848 raft_consensus.cc:2368] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:21.416437 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.503860 21844 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:21.421018 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.426311 21992 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: [3.5-6.6]
I20260709 12:10:21.415607 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:21.424471 21927 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:21.353977 23825 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.430011 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.508774 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:21.491397 24143 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.432791 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.433259 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.513554 22001 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:21.433605 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.514264 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.514932 22584 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:21.440708 22582 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:21.432255 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.515972 22000 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:21.432791 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:21.403491 24119 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:21.494633 23880 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:21.494355 22575 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:21.453698 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:21.434262 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:21.413686 24137 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.531030 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.531354 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:21.531765 21996 raft_consensus.cc:2368] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4.
I20260709 12:10:21.531890 21926 raft_consensus.cc:2376] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5. Re-sending same reply.
I20260709 12:10:21.532577 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.533142 21996 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:21.533922 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.534845 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.535427 21850 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:21.536299 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.537011 21850 raft_consensus.cc:2410] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:21.538519 23880 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.538646 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.539809 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.540194 24058 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:21.540803 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.541234 21999 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:21.541818 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.482815 21922 raft_consensus.cc:2889] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:21.319283 23866 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.353868 21845 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:21.545404 23533 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:21.452009 24090 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:21.454322 21924 rpcz_store.cc:276] 0709 12:10:19.164246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.264453 (+100207us) service_pool.cc:224] Handling call
0709 12:10:21.207862 (+1943409us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002e6654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:21.208033 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3264326528}
W20260709 12:10:21.492470 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 209136us
W20260709 12:10:21.555244 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.510560 23719 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.493251 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:21.559000 21918 raft_consensus.cc:2376] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4. Re-sending same reply.
I20260709 12:10:21.559958 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.560571 21918 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:21.561368 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:21.561851 21918 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.563294 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:21.564038 21924 raft_consensus.cc:2393] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:21.564770 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.565733 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.396696 21846 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:21.498258 21966 leader_election.cc:400] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:21.566533 21966 leader_election.cc:403] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.566738 21850 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:10:21.483311 24147 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.569916 24147 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:21.481812 24133 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.505115 21847 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:21.500664 22580 raft_consensus.cc:2376] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5. Re-sending same reply.
I20260709 12:10:21.483228 23690 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:21.314679 23972 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:21.522867 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.452589 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.523947 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.526211 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.528393 21920 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 2: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:21.529014 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:21.529096 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 96375us
I20260709 12:10:21.576643 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:21.585268 21851 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.551427 23885 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.529798 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.593541 21848 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:21.525537 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:21.499092 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.565492 22001 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.566977 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.489885 21993 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:21.369705 23816 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:21.582227 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 331588us
I20260709 12:10:21.496347 24065 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:21.586246 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:21.586843 21927 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:21.566951 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:21.590798 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:21.558741 23909 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:22.143034 21852 consensus_meta.cc:287] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.003s
I20260709 12:10:21.687916 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.143568 21852 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:21.644273 21994 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:22.144402 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:22.145036 21852 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.677349 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:22.150203 21966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.009s	sys 0.012s
I20260709 12:10:21.711352 21918 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:21.690124 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:22.164014 21847 raft_consensus.cc:2368] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:22.151348 21846 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:21.594465 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:22.159179 21815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.002s	sys 0.005s
W20260709 12:10:21.704636 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 358298us
W20260709 12:10:22.167531 21966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.010s	sys 0.012s
W20260709 12:10:22.132339 24089 consensus_meta.cc:287] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.003s
I20260709 12:10:22.169281 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.170351 21996 raft_consensus.cc:2368] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
W20260709 12:10:21.643138 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.171768 21815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.002s	sys 0.005s
I20260709 12:10:21.681429 21851 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
W20260709 12:10:22.168215 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 669990us
W20260709 12:10:22.172418 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 595851us
I20260709 12:10:22.174396 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:21.673230 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 69114.7us
I20260709 12:10:21.663178 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:21.623906 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 138375us
W20260709 12:10:22.180763 21816 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.008s	sys 0.011s
W20260709 12:10:22.001698 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 436905us
W20260709 12:10:22.181118 21816 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.008s	sys 0.011s
I20260709 12:10:22.171535 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.164207 21998 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:21.666745 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:22.182065 21918 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:22.172709 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:21.542276 24058 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:22.183842 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:22.184935 21918 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:22.185724 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.186271 21918 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:22.187310 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:21.582733 23533 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:21.705523 23880 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:21.580569 23719 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.668252 24133 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.190878 23533 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.579275 23940 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.192097 23940 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.192713 23880 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:22.193063 23719 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.193202 23533 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.193675 23719 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:22.193480 24065 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.663327 23866 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.182883 23909 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:22.137666 24139 consensus_meta.cc:287] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.005s
I20260709 12:10:22.194752 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:22.137414 22581 consensus_meta.cc:287] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.005s
I20260709 12:10:22.195586 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.202451 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:22.158957 24068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.006s
I20260709 12:10:22.203027 21927 raft_consensus.cc:2376] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5. Re-sending same reply.
I20260709 12:10:22.203835 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:22.182135 21818 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:22.197712 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:22.195261 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:22.205058 21993 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:22.206549 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:22.206729 21852 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:22.207837 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:22.209582 21852 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
W20260709 12:10:22.161841 24061 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.692s	user 0.004s	sys 0.009s
I20260709 12:10:21.705791 24062 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:22.199416 21846 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
W20260709 12:10:22.137547 24143 consensus_meta.cc:287] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 12:10:22.194708 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.230719 21920 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:22.231154 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1649) took 1010 ms. Trace:
I20260709 12:10:22.231482 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:22.231487 21920 rpcz_store.cc:276] 0709 12:10:21.220740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.168865 (+948125us) service_pool.cc:224] Handling call
0709 12:10:22.231093 (+ 62228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:22.159091 24149 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.000s
I20260709 12:10:21.581753 23949 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:22.217940 24068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.004s	sys 0.006s
I20260709 12:10:22.220407 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:22.140020 23945 consensus_meta.cc:287] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.000s
I20260709 12:10:22.194072 23940 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.154458 23825 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.039994 24090 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:21.668999 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.141405 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:21.782910 24102 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.222203 21966 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:22.307022 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 84904.1us
I20260709 12:10:22.223088 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.279325 23949 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:22.308574 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1645) took 1088 ms. Trace:
I20260709 12:10:22.309031 21927 rpcz_store.cc:276] 0709 12:10:21.219733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.222855 (+1003122us) service_pool.cc:224] Handling call
0709 12:10:22.308493 (+ 85638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.310168 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.311254 21927 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:22.061403 23906 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.312119 23949 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.313531 23906 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.314031 23906 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.314503 23906 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.039350 23972 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:21.756098 24079 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.224673 21967 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:22.319635 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 95055.7us
I20260709 12:10:22.319437 24079 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.320849 21967 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:22.321548 24079 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.321688 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:22.225155 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:22.322443 24062 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.322696 21852 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.322954 24062 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.323437 24062 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.324445 23945 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.324985 23945 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:22.325120 23980 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.325687 23980 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:22.326606 23980 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:21.703130 21995 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:22.328436 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:22.290517 21893 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:22.329031 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:22.330243 21893 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:22.332522 21964 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:22.226970 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:21.581528 24091 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:22.334252 24091 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.336303 24091 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.219285 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:22.266973 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1614) took 3238 ms. Trace:
I20260709 12:10:22.336977 21925 rpcz_store.cc:276] 0709 12:10:19.035270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.558660 (+523390us) service_pool.cc:224] Handling call
0709 12:10:21.256619 (+1697959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.308572 (+ 51953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.266625 (+958053us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540008f050. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:22.266848 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3852049152}
I20260709 12:10:22.232111 21993 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.663069 23885 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.560s
I20260709 12:10:22.338315 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:22.278540 21846 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:22.339387 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.339957 21925 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:22.340763 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.341379 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 277) took 1086 ms. Trace:
I20260709 12:10:22.194203 23719 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:22.239995 24149 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.000s
I20260709 12:10:22.341673 21925 rpcz_store.cc:276] 0709 12:10:21.255277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.340533 (+1085256us) service_pool.cc:224] Handling call
0709 12:10:22.341328 (+   795us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.665987 24141 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.269790 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.287883 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:22.238593 24058 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.289536 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:22.195304 24089 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.217103 24133 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:10:22.239185 24143 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5.
I20260709 12:10:22.354527 21918 raft_consensus.cc:2376] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6. Re-sending same reply.
I20260709 12:10:22.312281 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:22.287648 23940 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:22.288118 24163 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.216487 22581 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:22.216290 24139 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.344074 21998 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:22.305773 24090 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.348393 21850 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:22.364612 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1530) took 1019 ms. Trace:
I20260709 12:10:22.364776 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1529) took 1020 ms. Trace:
I20260709 12:10:22.365032 21850 rpcz_store.cc:276] 0709 12:10:21.344732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.363875 (+1019143us) service_pool.cc:224] Handling call
0709 12:10:22.364171 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.364335 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.364359 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.364397 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:22.364430 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.364479 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.364565 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.688179 24119 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.350773 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1641) took 1208 ms. Trace:
I20260709 12:10:22.367992 21922 rpcz_store.cc:276] 0709 12:10:21.151888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.178907 (+ 27019us) service_pool.cc:224] Handling call
0709 12:10:21.179133 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.542764 (+363631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.350540 (+807776us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001a3e54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:22.350722 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695517568}
I20260709 12:10:22.369765 21992 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:22.273206 22576 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:22.288830 21843 raft_consensus.cc:2368] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4.
I20260709 12:10:21.982972 23690 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.355618 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:22.371287 22584 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:22.352871 23880 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.358263 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:22.377758 21920 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.290498 23825 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:22.348028 21852 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:22.384496 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1536) took 1038 ms. Trace:
I20260709 12:10:22.356312 21964 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:22.392762 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:22.393587 22584 raft_consensus.cc:2376] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4. Re-sending same reply.
I20260709 12:10:22.384868 21852 rpcz_store.cc:276] 0709 12:10:21.346113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.383684 (+1037571us) service_pool.cc:224] Handling call
0709 12:10:22.384005 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.384192 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.384218 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.384259 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:22.384292 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.384343 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.384443 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.241072 22001 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:22.365190 21847 rpcz_store.cc:276] 0709 12:10:21.344502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.353477 (+1008975us) service_pool.cc:224] Handling call
0709 12:10:22.364368 (+ 10891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.364505 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.364525 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.364559 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:22.364586 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.364650 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.364732 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.367211 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1532) took 1022 ms. Trace:
I20260709 12:10:22.408893 21850 rpcz_store.cc:276] 0709 12:10:21.345183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.366521 (+1021338us) service_pool.cc:224] Handling call
0709 12:10:22.366772 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.366924 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.366945 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.366984 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:22.367017 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.367065 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.367163 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.348562 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.357405 21927 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.410766 21850 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.325961 23945 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.350198 24058 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:22.438493 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:22.359334 24117 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.358546 23885 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.343822 21919 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:22.385479 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:22.375844 24090 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:22.412559 21852 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:22.479374 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1634) took 1098 ms. Trace:
I20260709 12:10:22.479792 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:22.479746 21852 rpcz_store.cc:276] 0709 12:10:21.381511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.397939 (+1016428us) service_pool.cc:224] Handling call
0709 12:10:22.398323 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.479064 (+ 80741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.479290 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.372505 24065 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:22.460587 21995 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:22.398682 23908 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.586757 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1635) took 1183 ms. Trace:
I20260709 12:10:22.587186 21847 rpcz_store.cc:276] 0709 12:10:21.403650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.408494 (+1004844us) service_pool.cc:224] Handling call
0709 12:10:22.460518 (+ 52024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.470250 (+  9732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.470296 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.470376 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:22.586476 (+116100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.586549 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.586698 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":407,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":12657}
I20260709 12:10:22.413203 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 278) took 1157 ms. Trace:
I20260709 12:10:22.588917 21925 rpcz_store.cc:276] 0709 12:10:21.255526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.342305 (+1086779us) service_pool.cc:224] Handling call
0709 12:10:22.413121 (+ 70816us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.376269 21993 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:22.590588 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 402) took 1133 ms. Trace:
I20260709 12:10:22.444093 24147 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:22.422796 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 66556.2us
I20260709 12:10:22.436273 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1640) took 1018 ms. Trace:
I20260709 12:10:22.358453 23866 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:10:22.372123 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 668) took 1723 ms. Trace:
I20260709 12:10:22.600430 21847 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:22.601174 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 312) took 1044 ms. Trace:
I20260709 12:10:22.601552 21847 rpcz_store.cc:276] 0709 12:10:21.556929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.588309 (+1031380us) service_pool.cc:224] Handling call
0709 12:10:22.600040 (+ 11731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.600882 (+   842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.601111 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:22.442936 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 268635us
I20260709 12:10:22.395205 21845 raft_consensus.cc:2410] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:22.368953 23940 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.471397 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:22.471946 21927 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:22.612248 21922 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:22.466825 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.482944 21920 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:22.614996 21925 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:22.401665 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 228999us
I20260709 12:10:22.615597 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 276) took 1360 ms. Trace:
I20260709 12:10:22.615933 21925 rpcz_store.cc:276] 0709 12:10:21.255029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.596468 (+1341439us) service_pool.cc:224] Handling call
0709 12:10:22.614694 (+ 18226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.615373 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.615544 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:22.558039 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 351543us
I20260709 12:10:22.392343 23825 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.412747 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:22.452073 24058 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.590920 21993 rpcz_store.cc:276] 0709 12:10:21.458820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.205708 (+746888us) service_pool.cc:224] Handling call
0709 12:10:22.590532 (+384824us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.459941 23880 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.595702 21850 rpcz_store.cc:276] 0709 12:10:21.418093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.412028 (+993935us) service_pool.cc:224] Handling call
0709 12:10:22.433576 (+ 21548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.433761 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.433786 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.433828 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:22.433861 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.433915 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.436207 (+  2292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.603274 21815 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:22.657879 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 54699us
I20260709 12:10:22.604692 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:22.605897 24065 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.469111 24117 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:22.479513 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 282) took 1223 ms. Trace:
W20260709 12:10:22.596925 24156 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:10:22.593569 23748 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.643601 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 285) took 1354 ms. Trace:
W20260709 12:10:22.654636 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 59492.7us
I20260709 12:10:22.659029 21998 raft_consensus.cc:2393] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:22.680160 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 413) took 1217 ms. Trace:
I20260709 12:10:22.481278 23719 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.659425 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:22.660710 24089 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.665154 23909 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:22.697309 24167 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:22.697870 24183 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:22.698760 24159 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 12:10:22.698628 24183 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:22.699491 24164 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 12:10:22.658733 23816 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:22.595598 23908 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.679409 24065 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.717340 24090 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.763949 24065 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.716626 23719 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:22.679162 21927 rpcz_store.cc:276] 0709 12:10:21.257514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.610914 (+1353400us) service_pool.cc:224] Handling call
0709 12:10:22.611287 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.611513 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.611551 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.611606 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:22.611659 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.611731 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.611867 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.605800 24181 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.675650 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:22.764323 23908 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.680524 21998 rpcz_store.cc:276] 0709 12:10:21.463123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.593847 (+1130724us) service_pool.cc:224] Handling call
0709 12:10:22.680101 (+ 86254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.674217 24176 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.765643 24181 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.766959 24181 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.761556 24141 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:22.701433 24139 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:22.761121 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1528) took 1416 ms. Trace:
I20260709 12:10:22.599057 22581 rpcz_store.cc:276] 0709 12:10:20.648814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.699832 (+ 51018us) service_pool.cc:224] Handling call
0709 12:10:21.268914 (+569082us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:22.368328 (+1099414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15195520}
I20260709 12:10:22.769057 21846 rpcz_store.cc:276] 0709 12:10:21.344272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.339853 (+995581us) service_pool.cc:224] Handling call
0709 12:10:22.340235 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.340623 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.340668 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.341207 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.483243 (+142036us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:22.483748 (+   505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.483999 (+   251us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.760889 (+276890us) raft_consensus.cc:1685] finished
0709 12:10:22.760912 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.761053 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2156,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":8415,"thread_start_us":137586,"threads_started":1,"wal-append.queue_time_us":309672}
I20260709 12:10:22.689484 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:22.770499 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:22.770973 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 81588.2us
I20260709 12:10:22.771272 22581 raft_consensus.cc:2393] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:22.771373 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 323) took 1199 ms. Trace:
I20260709 12:10:22.771714 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:22.766985 21998 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:22.667091 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:22.655474 23880 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.773104 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1447) took 1316 ms. Trace:
I20260709 12:10:22.773190 23880 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.773470 21998 rpcz_store.cc:276] 0709 12:10:21.456825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.765991 (+1309166us) service_pool.cc:224] Handling call
0709 12:10:22.766308 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.772830 (+  6522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.773052 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.599264 24147 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.774799 21998 raft_consensus.cc:1240] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.775560 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1448) took 1318 ms. Trace:
I20260709 12:10:22.776058 24147 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:22.766170 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 90606us
I20260709 12:10:22.778483 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 663) took 2209 ms. Trace:
I20260709 12:10:22.765048 24182 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:22.785815 24181 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.786217 24182 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.787854 24139 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.668424 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:22.593149 24062 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.766150 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.693236 24185 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.775842 21998 rpcz_store.cc:276] 0709 12:10:21.457047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.774351 (+1317304us) service_pool.cc:224] Handling call
0709 12:10:22.774644 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.775351 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.775513 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.790151 24185 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.790669 24185 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.790850 22584 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:22.791502 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1449) took 1334 ms. Trace:
I20260709 12:10:22.716951 24173 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.779291 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:22.778930 24176 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:22.792902 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:22.793352 24176 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.793735 24176 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.793743 24091 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.780408 21964 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:22.791985 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:22.794270 24091 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.794814 24091 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.657295 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 321) took 1086 ms. Trace:
I20260709 12:10:22.795933 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:22.678630 21919 rpcz_store.cc:276] 0709 12:10:21.256565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.558665 (+302100us) service_pool.cc:224] Handling call
0709 12:10:22.469266 (+910601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.796859 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:22.797559 24149 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.797950 24149 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:22.782960 23945 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.790212 24062 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.798398 24149 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.798823 24062 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.799347 24062 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:22.800160 24062 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.801287 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:22.802057 24171 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:22.802567 24171 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:22.802695 23980 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:22.803289 23980 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:22.803385 24171 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.804155 23980 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.794166 24176 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:22.806118 22547 leader_election.cc:336] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.894s (SENT)
I20260709 12:10:22.807435 24149 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.809538 24149 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:22.778780 22580 raft_consensus.cc:2368] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:22.798568 24089 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:22.692601 23885 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.811565 24190 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.811829 23885 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.812127 24190 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.813877 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:22.814494 23885 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:22.815685 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:22.795822 21845 rpcz_store.cc:276] 0709 12:10:21.571337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.141017 (+569680us) service_pool.cc:224] Handling call
0709 12:10:22.650755 (+509738us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.791877 21998 rpcz_store.cc:276] 0709 12:10:21.457286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.790334 (+1333048us) service_pool.cc:224] Handling call
0709 12:10:22.791027 (+   693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.791199 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.791222 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.791265 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:22.791299 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.791347 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.791445 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.817795 21998 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:10:22.818112 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56590 (request call id 87) took 1243 ms. Trace:
I20260709 12:10:22.818428 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 403) took 1358 ms. Trace:
I20260709 12:10:22.819299 21998 rpcz_store.cc:276] 0709 12:10:21.459876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.817246 (+1357370us) service_pool.cc:224] Handling call
0709 12:10:22.817546 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:22.818178 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.818355 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.788460 24139 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:22.821368 24139 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.781816 23880 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.772320 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:22.825896 23880 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:22.785351 22579 rpcz_store.cc:276] 0709 12:10:20.569598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.463336 (+893738us) service_pool.cc:224] Handling call
0709 12:10:21.463706 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.496255 (+ 32549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.498870 (+  2615us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.644023 (+145153us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.239210 (+595187us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:22.275526 (+ 36316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.285025 (+  9499us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.778252 (+493227us) raft_consensus.cc:1685] finished
0709 12:10:22.778278 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.778431 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29568,"raft.queue_time_us":32313,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":24432,"thread_start_us":257635,"threads_started":1,"wal-append.queue_time_us":710747}
I20260709 12:10:22.827322 24102 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.827757 24102 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.828106 24102 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.829104 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:22.812404 24091 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.831931 23940 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.832032 24173 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.834033 21927 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:22.765533 23719 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:22.837013 22000 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.001s
I20260709 12:10:22.837069 21993 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:22.837867 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1441) took 1382 ms. Trace:
I20260709 12:10:22.838304 21993 rpcz_store.cc:276] 0709 12:10:21.455418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.828936 (+1373518us) service_pool.cc:224] Handling call
0709 12:10:22.836880 (+  7944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.837636 (+   756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.837812 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:22.839037 22547 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.228s (SENT)
I20260709 12:10:22.839870 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 407) took 1378 ms. Trace:
I20260709 12:10:22.840221 21993 rpcz_store.cc:276] 0709 12:10:21.461023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.839175 (+1378152us) service_pool.cc:224] Handling call
0709 12:10:22.839449 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.839598 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.839621 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.839658 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:22.839685 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.839732 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.839826 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.841249 23940 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.841939 21993 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:22.842865 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 519) took 1535 ms. Trace:
I20260709 12:10:22.843297 22577 rpcz_store.cc:276] 0709 12:10:21.307844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.485744 (+177900us) service_pool.cc:224] Handling call
0709 12:10:21.499363 (+ 13619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.183288 (+683925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.190729 (+  7441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.190787 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:22.190840 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.841174 (+650334us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b18003af660. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c7c2a6 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419
0709 12:10:22.842632 (+  1458us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b540046fd54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:22.842675 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.842803 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":565427,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":22724,"spinlock_wait_cycles":193443968}
I20260709 12:10:22.845013 22000 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:22.689006 24117 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:22.818565 21845 rpcz_store.cc:276] 0709 12:10:21.574507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.816759 (+1242252us) service_pool.cc:224] Handling call
0709 12:10:22.818032 (+  1273us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:22.876288 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.771819 21846 rpcz_store.cc:276] 0709 12:10:21.571952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.770593 (+1198641us) service_pool.cc:224] Handling call
0709 12:10:22.770902 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.771063 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.771088 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.771126 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:22.771165 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.771217 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.771321 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.884272 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1652) took 1662 ms. Trace:
W20260709 12:10:22.886739 24168 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:10:22.838462 24091 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.885006 21923 rpcz_store.cc:276] 0709 12:10:21.221408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.352490 (+1131082us) service_pool.cc:224] Handling call
0709 12:10:22.355427 (+  2937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.472487 (+117060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.472514 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.588695 (+116181us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.782622 (+193927us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:22.875791 (+ 93169us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.883792 (+  8001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.883908 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.883968 (+    60us) raft_consensus.cc:1685] finished
0709 12:10:22.883987 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.884187 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7129,"raft.queue_time_us":340548,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":150,"thread_start_us":343494,"threads_started":3,"wal-append.queue_time_us":171427}
W20260709 12:10:22.899849 22547 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.057s (SENT)
I20260709 12:10:22.912806 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:22.914794 21923 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.896850 24188 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.896941 22581 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:22.911689 24181 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.918895 23533 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:22.956043 24154 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 1.294s	user 0.003s	sys 0.016s
W20260709 12:10:22.963825 21994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1438) took 1535 ms (client timeout 1852 ms). Trace:
I20260709 12:10:22.964183 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.969911 21998 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:22.971128 21851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1525) took 1627 ms (client timeout 1987 ms). Trace:
I20260709 12:10:22.972158 21843 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:22.981634 21994 rpcz_store.cc:269] 0709 12:10:21.454528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.458188 (+  3660us) service_pool.cc:224] Handling call
0709 12:10:22.963621 (+1505433us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540018e7d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:22.963769 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423940992}
W20260709 12:10:22.974184 23906 consensus_meta.cc:287] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.003s
I20260709 12:10:22.978092 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1643) took 1559 ms. Trace:
W20260709 12:10:22.982743 21851 rpcz_store.cc:269] 0709 12:10:21.343504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.423131 (+ 79627us) service_pool.cc:224] Handling call
0709 12:10:22.970934 (+1547803us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b5400206a54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:22.971063 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131158400}
I20260709 12:10:22.981913 21926 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:22.970070 24071 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.919451 24190 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.986332 21852 rpcz_store.cc:276] 0709 12:10:21.418916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.589113 (+1170197us) service_pool.cc:224] Handling call
0709 12:10:22.589487 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.589713 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:22.876687 (+286974us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.977715 (+101028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.977800 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:22.977847 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.977927 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.978032 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":393926,"raft.queue_time_us":85,"thread_start_us":373788,"threads_started":2}
W20260709 12:10:22.988359 21736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d50c36e857cb4e33997aee7e5dd39447 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cffb5c192e144f7caa7b94271976ed42 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:22.988986 24171 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.980670 24163 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.990965 24171 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:22.991741 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:22.993095 24171 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:22.991051 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:22.994803 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.995987 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.996645 21926 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:22.997401 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.998018 21926 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:22.989971 24071 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.000208 24139 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.003346 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.004349 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:23.004972 21919 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:23.005896 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:23.008038 24190 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.008517 24190 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.012588 24058 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.014662 23906 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.015200 23719 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.015094 24185 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.016055 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.017314 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.017803 24185 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:22.944365 24176 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.018507 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.019220 21919 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.020771 24176 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.021843 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:22.940408 24188 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:23.018594 21992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 415) took 1555 ms (client timeout 1619 ms). Trace:
I20260709 12:10:23.023636 21924 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
W20260709 12:10:23.024163 21924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1856) took 1791 ms (client timeout 2113 ms). Trace:
I20260709 12:10:23.024459 21925 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:23.024547 21924 rpcz_store.cc:269] 0709 12:10:21.232779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.168880 (+936101us) service_pool.cc:224] Handling call
0709 12:10:23.021715 (+852835us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:23.024109 (+  2394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4493184}
I20260709 12:10:23.025651 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:23.025794 22001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 412) took 1563 ms (client timeout 2045 ms). Trace:
I20260709 12:10:23.026319 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:23.026149 22001 rpcz_store.cc:269] 0709 12:10:21.462687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.541607 (+ 78920us) service_pool.cc:224] Handling call
0709 12:10:23.025627 (+1484020us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b54001f04d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:23.025740 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53133184}
W20260709 12:10:23.023885 21992 rpcz_store.cc:269] 0709 12:10:21.463639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.506270 (+ 42631us) service_pool.cc:224] Handling call
0709 12:10:23.018435 (+1512165us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54002d19d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:23.018530 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1782308608}
I20260709 12:10:23.027091 21852 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
W20260709 12:10:23.035986 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.002293 24139 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:23.040091 21924 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:23.041275 21924 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:23.042819 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:23.043807 21926 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:23.025015 24190 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.055361 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 320) took 1490 ms. Trace:
I20260709 12:10:23.055769 21850 rpcz_store.cc:276] 0709 12:10:21.564558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.657751 (+1093193us) service_pool.cc:224] Handling call
0709 12:10:22.658053 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.674680 (+ 16627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.674730 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.744910 (+ 70180us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.913265 (+168355us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:22.913304 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.913372 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.055153 (+141781us) raft_consensus.cc:1685] finished
0709 12:10:23.055172 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.055302 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27272,"raft.queue_time_us":15929,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":24261,"thread_start_us":49385,"threads_started":1,"wal-append.queue_time_us":221787}
I20260709 12:10:23.058638 21923 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:23.062446 21924 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.082296 21923 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:23.088868 21926 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:23.090728 21921 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:23.095151 24188 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.101238 21967 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:23.105777 21967 leader_election.cc:400] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:23.095242 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 404) took 1635 ms. Trace:
I20260709 12:10:23.061674 24058 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.110913 21923 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:23.114070 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 806206us
I20260709 12:10:23.162375 21966 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:23.163564 21966 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:23.115175 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.123004 24182 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.126842 22579 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:23.127498 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 471) took 1886 ms. Trace:
I20260709 12:10:23.104012 24133 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:23.109812 24173 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.134809 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.181634 22580 raft_consensus.cc:2376] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5. Re-sending same reply.
W20260709 12:10:23.136186 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 496507us
I20260709 12:10:23.109298 24141 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.141341 24163 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:23.143808 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1898) took 1904 ms. Trace:
W20260709 12:10:23.150480 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 44829.8us
I20260709 12:10:23.146579 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.183000 21818 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:23.184449 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.182947 21997 rpcz_store.cc:276] 0709 12:10:21.239343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.241242 (+  1899us) service_pool.cc:224] Handling call
0709 12:10:21.241589 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.218627 (+977038us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:22.285643 (+ 67016us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.600131 (+314488us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.600453 (+   322us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.600518 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:22.600582 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.968249 (+367667us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b180020d3a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:22.969209 (+   960us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b180020d3a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c7c2a6 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419
0709 12:10:23.143588 (+174379us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54002d14d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:23.143636 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.143754 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11310,"prepare.queue_time_us":67526,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":13349,"raft.queue_time_us":5288,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":7598,"spinlock_wait_cycles":2254217344,"thread_start_us":308338,"threads_started":1,"wal-append.queue_time_us":470909}
I20260709 12:10:23.186031 21818 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:23.155884 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 101870us
I20260709 12:10:23.187670 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.188401 23975 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.189059 23975 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:23.189204 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.189682 23975 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:23.190065 23975 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:23.163743 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.190269 24176 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.190480 23975 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.190743 24176 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:23.191285 24176 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.191989 24058 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.192380 24058 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.192701 24058 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.187899 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:23.178334 22576 rpcz_store.cc:276] 0709 12:10:21.241074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.485939 (+244865us) service_pool.cc:224] Handling call
0709 12:10:23.127293 (+1641354us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b540057c6d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:23.127422 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95755648}
I20260709 12:10:23.186391 24163 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.195812 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:23.196767 22576 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:23.114537 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.175822 21847 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:23.198457 24176 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:23.200367 22579 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:23.200994 24137 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.201511 24137 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.175935 22575 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.203756 24137 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.175869 24131 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:23.176296 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:23.204440 23825 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.111476 23906 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.204552 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.205260 22581 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.207170 23975 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.209136 23975 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.210780 22577 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:10:23.213202 22000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 406) took 1752 ms (client timeout 1826 ms). Trace:
I20260709 12:10:23.213439 21964 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.215137 21818 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:23.142133 24071 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.107728 24054 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:10:23.190832 23945 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.179878 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:23.172647 21966 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:23.224961 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 52445.4us
W20260709 12:10:23.213768 22000 rpcz_store.cc:269] 0709 12:10:21.460759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.522544 (+ 61785us) service_pool.cc:224] Handling call
0709 12:10:23.212996 (+1690452us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b5400235fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:23.213125 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1594149632}
I20260709 12:10:23.225250 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:23.214846 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.172396 24139 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.222551 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.233206 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.234004 21923 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.229076 24176 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.154870 21995 rpcz_store.cc:276] 0709 12:10:21.460230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.328764 (+868534us) service_pool.cc:224] Handling call
0709 12:10:23.094953 (+766189us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b540018f1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:23.095158 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99574528}
I20260709 12:10:23.223964 23689 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.246131 21926 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:23.227447 24141 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:23.252292 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 319) took 1693 ms. Trace:
I20260709 12:10:23.257928 21847 rpcz_store.cc:276] 0709 12:10:21.563561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.602336 (+1038775us) service_pool.cc:224] Handling call
0709 12:10:22.652823 (+ 50487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.199033 (+546210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.252112 (+ 53079us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b5400207954. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:23.252247 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201838848}
W20260709 12:10:23.252768 21918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1864) took 1972 ms (client timeout 2123 ms). Trace:
I20260709 12:10:23.253990 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 405) took 1793 ms. Trace:
I20260709 12:10:23.250859 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1434) took 1824 ms. Trace:
I20260709 12:10:23.191301 23885 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:10:23.230350 24133 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:23.226794 23945 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:23.259580 21998 rpcz_store.cc:276] 0709 12:10:21.460490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.820825 (+1360335us) service_pool.cc:224] Handling call
0709 12:10:22.969736 (+148911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.982437 (+ 12701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.253858 (+271421us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540018e7d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:23.253946 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341846784}
I20260709 12:10:23.236716 23690 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.294570 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:23.303933 22000 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.241744 24091 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.232143 23906 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.312479 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.313624 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:23.258934 21918 rpcz_store.cc:269] 0709 12:10:21.280682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.187024 (+906342us) service_pool.cc:224] Handling call
0709 12:10:23.252580 (+1065556us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002e8454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:23.252715 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381004672}
I20260709 12:10:23.297240 21893 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.315632 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.316134 21918 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.294651 21923 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:23.300802 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:23.317706 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.317809 22582 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.318109 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:23.259723 21999 rpcz_store.cc:276] 0709 12:10:21.426568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.429138 (+  2570us) service_pool.cc:224] Handling call
0709 12:10:21.475408 (+ 46270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.541615 (+ 66207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.250625 (+1709010us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b54002d1ed4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:23.250800 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150943104}
I20260709 12:10:23.230551 23866 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:10:23.224079 24172 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:10:23.303305 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.320691 21923 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.307471 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.307600 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.342576 21994 raft_consensus.cc:2393] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:23.342341 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.307979 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:23.290423 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.223775 24171 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:23.245621 21919 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:23.249869 23689 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.359863 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:23.246870 23825 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:23.236296 24090 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:10:23.250656 24089 consensus_queue.cc:1059] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
W20260709 12:10:23.337219 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.311286 24091 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:23.344784 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 95258.3us
I20260709 12:10:23.337440 24174 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.303620 23690 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:23.316700 21893 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.395223 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.395272 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.377072 21999 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.396767 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:23.364033 24196 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:23.377885 22582 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:23.378707 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:23.296518 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.384060 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.389213 21918 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:23.224629 24102 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.310117 23945 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.390465 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:23.312181 23906 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:23.395547 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 78912.9us
I20260709 12:10:23.319476 23880 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:10:23.397446 21844 raft_consensus.cc:2393] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:23.353849 22000 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:23.400792 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.468451 21851 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:23.401106 21925 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:23.401404 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.403322 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:23.394290 24091 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.376693 22578 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.347134 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:23.459303 21923 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.298593 24133 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:23.309124 24149 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:10:23.469352 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.469894 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.376191 23689 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.469352 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.459353 21995 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:23.491688 21846 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:23.467871 23906 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.403234 23690 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.464639 22576 raft_consensus.cc:2393] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:10:23.402774 21892 connection.cc:256] RPC call timeout handler was delayed by -1.0675150209999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 12:10:23.474402 22584 raft_consensus.cc:2410] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:23.485221 22001 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:23.458431 23931 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:23.362468 24062 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:10:23.402940 23975 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:10:23.391898 24170 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:10:23.472163 24131 raft_consensus.cc:3055] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:23.512509 24131 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:23.513200 23931 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.513329 24131 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.390065 23825 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.517136 23825 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.492269 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.520380 24131 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.530511 24216 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:23.531071 24216 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:23.532058 24198 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.569s	user 0.004s	sys 0.000s
I20260709 12:10:23.533252 24216 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.486588 24174 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:23.534401 24174 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.535976 24163 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.486814 24182 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:23.504657 24183 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.507779 22576 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:23.509337 24213 log.cc:927] Time spent T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:10:23.504431 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.509559 24102 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.478112 24141 raft_consensus.cc:697] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:23.510033 24206 log.cc:927] Time spent T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 12:10:23.503011 21892 connection.cc:256] RPC call timeout handler was delayed by -1.0675150209999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 12:10:23.504428 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:23.537832 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 72563.6us
I20260709 12:10:23.480340 21818 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:23.497969 24133 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:23.581349 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 170989us
W20260709 12:10:23.584149 21892 connection.cc:256] RPC call timeout handler was delayed by -1.0432150209999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 12:10:23.584635 21892 connection.cc:256] RPC call timeout handler was delayed by -1.0351150209999105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 12:10:23.585057 21818 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:23.589526 24141 consensus_queue.cc:237] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.590616 24217 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:23.591121 24223 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:23.591209 24217 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.591755 24223 raft_consensus.cc:697] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:23.595211 21818 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:23.539656 24182 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:23.579128 24211 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:10:23.530128 23906 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.598891 21893 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.539827 22581 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:23.566004 24071 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.606968 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:23.602941 24182 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.609977 21893 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:23.606225 23825 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.607618 24102 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.613411 23825 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.613984 24216 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:23.592573 24223 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.615190 24071 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.615576 24071 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:23.615940 24071 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.617529 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.619196 24217 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.619841 22583 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:23.621397 23690 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.623104 24190 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.625909 22575 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:23.627041 24058 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.637676 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1641) took 2219 ms. Trace:
I20260709 12:10:23.637887 23825 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.640578 23945 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.641389 22578 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:23.579208 23689 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.648056 21967 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:23.628131 24182 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.648056 23931 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.642071 24163 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.638111 21843 rpcz_store.cc:276] 0709 12:10:21.418340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.443219 (+1024879us) service_pool.cc:224] Handling call
0709 12:10:22.971905 (+528686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.985651 (+ 13746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.637461 (+651810us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400206a50. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:23.637614 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848222080}
I20260709 12:10:23.628815 24188 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:23.673341 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.652037 24182 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:23.679302 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.648617 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 402653us
W20260709 12:10:23.685081 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 294467us
W20260709 12:10:23.685593 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 75674.9us
I20260709 12:10:23.696823 21847 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.697289 21893 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.699424 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:23.700279 21845 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.676191 22579 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.696422 21817 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:23.673369 23945 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:23.684253 24058 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:23.694190 23816 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.693964 23825 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:23.720980 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 116473us
W20260709 12:10:23.688710 21815 leader_election.cc:336] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.123s (SENT)
I20260709 12:10:23.779819 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:23.711467 24188 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:23.720563 24190 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:23.717795 24217 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.795712 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 274) took 2541 ms. Trace:
I20260709 12:10:23.796355 21922 rpcz_store.cc:276] 0709 12:10:21.254375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.369161 (+1114786us) service_pool.cc:224] Handling call
0709 12:10:22.612025 (+242864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.612734 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.795532 (+1182798us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540036f6d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:23.795657 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557720832}
I20260709 12:10:23.797513 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:23.787314 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 180415us
I20260709 12:10:23.788122 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:23.694506 24174 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
W20260709 12:10:23.791505 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 102823us
I20260709 12:10:23.793061 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:23.799991 21892 leader_election.cc:400] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:23.793900 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.800653 21925 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.794471 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:23.800323 21892 leader_election.cc:403] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:23.794747 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.800766 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:23.800271 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:23.806169 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:23.808382 21817 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:23.809193 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.810186 24117 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:23.816622 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:23.822608 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.823216 22583 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.784231 24228 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.823572 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:23.824860 21922 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.827026 21921 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:23.823216 21925 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:23.830222 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.829334 21921 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.843210 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.843803 21921 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:23.845144 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.846138 21849 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:23.847544 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:23.850119 21849 raft_consensus.cc:2368] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4.
I20260709 12:10:23.843432 22583 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:23.852514 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:23.854527 21893 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.855499 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.856547 21849 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:23.860149 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:23.869342 21996 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 2: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:23.861557 21999 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:23.862052 24217 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.790187 24223 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:23.789000 23825 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.872653 22001 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:23.815856 23690 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.804301 24190 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:23.874449 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:23.814708 23816 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:23.795674 24119 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:23.876483 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.877324 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.815538 23940 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:10:23.805220 24091 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.861382 24058 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.839497 23931 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:23.839704 22578 raft_consensus.cc:3055] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:23.826020 21845 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:23.905467 24071 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:23.877516 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.909231 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.909770 24071 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.910336 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.911394 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.911484 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:23.911954 21996 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:23.862845 23906 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.914599 21852 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:23.914708 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.885982 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:23.919039 24246 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:23.913056 24058 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.920843 24091 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:23.898241 23689 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:23.890324 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:23.891414 24234 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:23.892298 24181 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.892740 23690 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:23.893301 24133 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:23.893625 23825 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:23.894424 24174 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:23.861321 24182 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:23.895609 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 51354.1us
I20260709 12:10:23.896176 21846 raft_consensus.cc:2393] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:23.896679 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.896992 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.871089 24244 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:23.900750 24226 log.cc:927] Time spent T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:10:23.901873 24220 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 12:10:23.902567 24235 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:10:23.829774 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:23.895473 24119 consensus_queue.cc:1243] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:23.898990 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:23.814567 24188 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.055474 22580 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.068135 22580 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:24.049964 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.072726 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:23.980101 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:24.073983 21922 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:24.072328 22001 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:24.076076 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:24.021340 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:23.979851 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 191832us
I20260709 12:10:24.081663 22582 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 12:10:24.081353 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 191139us
I20260709 12:10:23.898248 22578 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:24.083024 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:23.921685 24058 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:24.085692 21992 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:24.086256 22549 leader_election.cc:400] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4.
I20260709 12:10:24.086715 22549 leader_election.cc:403] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:24.080391 21997 raft_consensus.cc:2376] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4. Re-sending same reply.
I20260709 12:10:24.088243 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.089092 22000 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
W20260709 12:10:24.050402 24212 log.cc:927] Time spent T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.663s	user 0.002s	sys 0.000s
I20260709 12:10:24.145877 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:24.142747 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 56638us
I20260709 12:10:24.086479 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:24.011250 24236 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:24.145462 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.090497 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:24.147447 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 61052.4us
I20260709 12:10:24.147817 22001 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:24.148066 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:24.150945 21999 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:24.048179 24170 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:24.148782 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:24.154029 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.155841 22001 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:24.157066 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:24.014671 23931 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:24.163384 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.084208 22580 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.107805 24244 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:24.165011 24091 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.085453 24174 raft_consensus.cc:697] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:24.086484 24246 raft_consensus.cc:2764] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:24.087867 24171 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:24.173418 22580 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.159835 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:24.179522 22582 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.160939 22583 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:24.161445 22549 connection.cc:256] RPC call timeout handler was delayed by -1.1010735190000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2642s for a response
I20260709 12:10:24.078970 24182 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:10:24.171083 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 296714us
I20260709 12:10:24.167977 24054 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.185598 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:24.175056 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.186704 21992 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:24.187942 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.189307 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.144302 23825 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:10:23.891580 24190 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.017064 23816 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.194348 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.150046 23690 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:24.174343 24141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.014s
I20260709 12:10:24.199424 22582 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:24.121841 21843 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:24.165802 24244 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.176582 24221 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.204465 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:24.195598 21992 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:24.162935 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:24.159209 21817 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:24.171633 24091 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:24.155447 23689 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.178851 24171 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:24.202220 22582 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:24.170814 23931 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.190759 24131 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.191692 24054 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.203822 23825 consensus_queue.cc:1243] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:24.232538 24250 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.205832 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:24.196782 24232 raft_consensus.cc:2764] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 12:10:24.212903 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 50064.3us
I20260709 12:10:24.178249 24229 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 12:10:24.201134 24141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.006s	sys 0.015s
I20260709 12:10:24.204026 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:24.229879 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 70753.3us
W20260709 12:10:24.258224 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.258558 21817 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:24.233486 21992 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.191663 24246 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4.
I20260709 12:10:24.191146 24234 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:24.203642 24223 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:24.197043 24117 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:24.243479 24245 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.249383 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.250092 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.250896 23690 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.251943 24054 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:24.254756 24229 raft_consensus.cc:3055] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.183552 24174 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.264268 21993 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.265053 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.265367 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.288036 21849 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 1.
I20260709 12:10:24.288393 21850 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:24.266654 21817 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:24.234248 23533 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.288908 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:24.291077 24248 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:24.292245 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:24.293167 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 685) took 1071 ms. Trace:
I20260709 12:10:24.293581 22577 rpcz_store.cc:276] 0709 12:10:23.222125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.223952 (+  1827us) service_pool.cc:224] Handling call
0709 12:10:24.291962 (+1068010us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:24.293106 (+  1144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93350272}
I20260709 12:10:24.236747 24131 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.270907 24176 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.290438 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:24.272619 21992 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:24.273201 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.281147 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.306977 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.307544 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:24.308451 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.283242 23931 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:24.283830 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.310122 21844 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:24.310701 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:24.303131 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 96605.4us
I20260709 12:10:24.267925 21995 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.281067 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.304618 21847 raft_consensus.cc:2376] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4. Re-sending same reply.
W20260709 12:10:24.312641 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 81380.7us
I20260709 12:10:24.311966 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:24.314384 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.287272 24229 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:24.315595 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:24.296376 24133 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:24.318506 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:24.295743 24058 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:24.321038 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:24.322824 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.323031 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.323889 21992 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:24.324488 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.324992 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.325551 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.322664 23931 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.321466 24058 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.330179 23931 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:24.316215 24176 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.331594 24058 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:24.329810 24229 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.300494 23533 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:24.331203 23931 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.328871 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.334435 21848 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.334518 21922 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.337764 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:24.339716 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:24.344319 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.349054 21893 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:24.365345 21844 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 2.
I20260709 12:10:24.300168 24171 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.373010 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:24.373509 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:24.374220 24241 raft_consensus.cc:2764] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:10:24.375557 24233 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.376011 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.376590 21992 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:24.322474 24234 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.321763 24246 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.380921 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.384052 22580 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:24.321815 24221 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:24.390288 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:24.391664 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:24.395263 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.338994 24071 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.400182 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.300017 24091 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:24.401216 22547 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:24.402526 24262 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:24.403553 24262 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.404479 24262 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.404778 24262 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:10:24.406219 24251 log.cc:927] Time spent T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:10:24.399811 24071 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.407030 24071 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.406325 24262 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.407672 24263 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:24.313454 24245 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:10:24.408449 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1869) took 1743 ms. Trace:
I20260709 12:10:24.410374 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:24.408836 21920 rpcz_store.cc:276] 0709 12:10:22.664729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.048594 (+383865us) service_pool.cc:224] Handling call
0709 12:10:23.048934 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:23.060172 (+ 11238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.060201 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:23.063668 (+  3467us) log.cc:844] Serialized 52 byte log entry
0709 12:10:23.297907 (+234239us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:23.346468 (+ 48561us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.346811 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.346974 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.347037 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.011162 (+664125us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b1800399220. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae522 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:24.196858 (+185696us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800399220. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c7c2a6 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1
0709 12:10:24.339099 (+142241us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b1800399220. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:24.408235 (+ 69136us) raft_consensus.cc:1685] finished
0709 12:10:24.408258 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.408392 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8087,"prepare.queue_time_us":105179,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":12516,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":26266,"spinlock_wait_cycles":67494656,"thread_start_us":191082,"threads_started":1,"wal-append.queue_time_us":305679}
I20260709 12:10:24.352962 24058 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:24.382871 24174 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.417217 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:24.420308 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 129991us
W20260709 12:10:24.420768 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 110957us
I20260709 12:10:24.422389 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:24.421424 21817 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:24.408090 24262 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.413563 24229 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.425966 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:24.430025 23533 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.431362 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:24.432798 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:24.429351 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:24.426929 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:24.437243 21918 raft_consensus.cc:2410] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:24.439163 21918 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:24.439427 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:24.429100 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.445128 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:24.416080 21919 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:24.420749 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.447921 21922 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.396920 24246 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.434787 24241 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.392118 24117 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.461413 24263 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:24.419587 24058 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.465076 24260 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.469120 21848 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:24.474782 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.475665 21848 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.462174 24263 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:10:24.457640 21845 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:24.492336 24249 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:24.465577 24259 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.490514 24246 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:24.447430 24255 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:24.510035 21848 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:24.474143 24131 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:24.521062 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.522472 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:24.525935 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 70054.9us
I20260709 12:10:24.483695 24221 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.483999 24234 consensus_queue.cc:1059] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:24.528635 24058 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:24.529424 24234 raft_consensus.cc:3055] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:24.528719 24269 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:24.529964 24234 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:24.482827 24260 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.532666 24269 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.536141 24071 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.545768 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:24.548828 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 124392us
I20260709 12:10:24.551523 21817 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:24.555164 24266 log.cc:927] Time spent T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:10:24.542062 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:24.558954 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.560492 21848 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.540210 24259 consensus_queue.cc:1059] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:24.569855 24249 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.570293 24259 raft_consensus.cc:3055] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.570715 24259 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:24.571570 24259 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.553366 24171 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.574479 24171 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.574956 24171 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.575680 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1913) took 1279 ms. Trace:
I20260709 12:10:24.576156 21993 rpcz_store.cc:276] 0709 12:10:23.296478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.296605 (+   127us) service_pool.cc:224] Handling call
0709 12:10:23.296884 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.287613 (+990729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.575351 (+287738us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400221d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:24.575608 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224375040}
I20260709 12:10:24.576882 24171 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:24.553450 24188 consensus_queue.cc:1059] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:10:24.582995 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.583607 24188 raft_consensus.cc:3055] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:24.584033 21850 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:10:24.586882 21736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d50c36e857cb4e33997aee7e5dd39447 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cffb5c192e144f7caa7b94271976ed42 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:24.551709 24269 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.802799 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1886) took 1582 ms. Trace:
W20260709 12:10:24.588721 22547 leader_election.cc:336] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.747s (SENT)
I20260709 12:10:24.840538 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:24.836804 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:24.845353 21923 rpcz_store.cc:276] 0709 12:10:23.220103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.341039 (+120936us) service_pool.cc:224] Handling call
0709 12:10:23.409606 (+ 68567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.487395 (+ 77789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.798776 (+1311381us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b54003606d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:24.802714 (+  3938us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157118848}
W20260709 12:10:24.845686 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 256980us
I20260709 12:10:24.808310 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1881) took 1639 ms. Trace:
I20260709 12:10:24.603703 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.847052 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:24.783987 24276 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.232s	user 0.005s	sys 0.003s
I20260709 12:10:24.584050 24188 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:24.566635 21845 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
W20260709 12:10:24.759423 24250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.006s	sys 0.025s
I20260709 12:10:24.863662 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.823136 24259 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.604501 24170 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:24.830129 24071 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:24.747920 24176 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.724802 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1672) took 1863 ms. Trace:
I20260709 12:10:24.817788 24091 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:24.831359 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 285686us
I20260709 12:10:24.916201 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:24.592727 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:24.831946 21848 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:24.723870 24089 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
W20260709 12:10:24.724278 21926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1882) took 1554 ms (client timeout 1568 ms). Trace:
I20260709 12:10:24.791018 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 488) took 1498 ms. Trace:
I20260709 12:10:24.717505 21852 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:24.847429 21927 rpcz_store.cc:276] 0709 12:10:23.169093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.169230 (+   137us) service_pool.cc:224] Handling call
0709 12:10:23.252729 (+ 83499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.253095 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:23.253140 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.291337 (+ 38197us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.578998 (+287661us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:23.579060 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.579151 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.177274 (+598123us) raft_consensus.cc:1685] finished
0709 12:10:24.177292 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.807969 (+630677us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b54002e8450. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:24.808228 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2582,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10929,"spinlock_wait_cycles":191075072,"thread_start_us":216094,"threads_started":1,"wal-append.queue_time_us":372074}
I20260709 12:10:24.599464 21992 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:24.862608 23816 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.723327 24249 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.858758 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:24.745776 24233 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.587754 24260 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:24.599627 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:24.860109 24171 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.880234 24170 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.723860 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:24.871099 24250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.007s	sys 0.032s
I20260709 12:10:24.602298 21995 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:24.914723 21924 rpcz_store.cc:276] 0709 12:10:22.861078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.068948 (+207870us) service_pool.cc:224] Handling call
0709 12:10:23.144567 (+ 75619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.144943 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.144970 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.145406 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.251748 (+106342us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:23.251789 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.251855 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.512640 (+260785us) raft_consensus.cc:1685] finished
0709 12:10:23.512661 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.724508 (+1211847us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b54001a3e50. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:24.724730 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2297,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7431,"spinlock_wait_cycles":124509440,"thread_start_us":105986,"threads_started":1,"wal-append.queue_time_us":191757,"wal-append.run_cpu_time_us":1928,"wal-append.run_wall_time_us":1175130}
W20260709 12:10:24.922538 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.923305 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:24.936751 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 344110us
I20260709 12:10:24.969182 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:24.970832 24255 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.971423 24255 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:24.972528 24255 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:24.975450 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.976584 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:24.610611 24058 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.270s
I20260709 12:10:24.940156 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:25.014870 21850 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:24.940515 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:24.944341 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 85688.9us
I20260709 12:10:24.875481 24253 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:24.919238 21926 rpcz_store.cc:269] 0709 12:10:23.169380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.180459 (+ 11079us) service_pool.cc:224] Handling call
0709 12:10:24.724095 (+1543636us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b540013a1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:24.724223 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19657984}
I20260709 12:10:24.881692 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:24.959995 21993 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:24.612249 24234 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:24.968302 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:24.943004 24117 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:24.973541 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:24.926347 24277 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:25.011140 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 87950.7us
I20260709 12:10:25.041760 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.940197 22581 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:25.013664 21992 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.016047 21817 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:24.723496 22578 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.018966 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:24.970306 22549 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:24.962937 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 85006.1us
I20260709 12:10:24.922211 24091 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:24.963217 24250 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:25.012333 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1460) took 1171 ms. Trace:
I20260709 12:10:25.023557 21850 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:24.924510 22579 rpcz_store.cc:276] 0709 12:10:23.292763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.510922 (+218159us) service_pool.cc:224] Handling call
0709 12:10:23.653189 (+142267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.718836 (+ 65647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.790804 (+1071968us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54004380d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:24.790950 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316837248}
I20260709 12:10:25.041965 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:24.948102 24260 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.042883 21997 raft_consensus.cc:2393] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:24.941921 23816 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.038283 22575 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:25.048719 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 78503.2us
I20260709 12:10:25.049055 21964 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:25.020311 23931 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.047966 21993 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:25.141813 21844 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:25.041275 24117 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:25.153738 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 327281us
W20260709 12:10:25.155030 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 113158us
I20260709 12:10:25.157752 21844 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:25.158715 21992 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:25.159521 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:25.160470 22549 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.619s (SENT)
I20260709 12:10:25.160897 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.046978 24229 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.046285 21845 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:25.144258 22578 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.164095 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.154016 24234 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.170670 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.162572 24117 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.015108 24188 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.158097 24277 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:25.179436 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 130590us
I20260709 12:10:25.183028 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:25.177416 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.156749 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 492) took 1091 ms. Trace:
W20260709 12:10:25.161636 24278 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.609s	user 0.002s	sys 0.000s
I20260709 12:10:25.167677 24071 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.162743 24241 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.147117 24263 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:25.162635 24298 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.144559 21995 rpcz_store.cc:276] 0709 12:10:23.837109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.179105 (+341996us) service_pool.cc:224] Handling call
0709 12:10:25.008451 (+829346us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:25.205950 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 164968us
I20260709 12:10:25.209106 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.221769 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.222975 21926 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:25.169934 24171 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.180783 24262 consensus_meta.cc:287] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.746s	user 0.005s	sys 0.006s
I20260709 12:10:25.168552 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 686) took 1377 ms. Trace:
I20260709 12:10:25.176447 23931 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.178970 24190 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.223021 21817 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:25.202199 24277 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.202778 24089 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:25.236699 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 53780.5us
W20260709 12:10:25.238430 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 96759.4us
I20260709 12:10:25.245950 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.175766 24297 consensus_queue.cc:1059] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:10:25.247416 22547 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.233523 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:25.253330 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 92867.5us
I20260709 12:10:25.246896 23975 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.248090 23866 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:25.247687 24293 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.203589 24091 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.236227 22575 rpcz_store.cc:276] 0709 12:10:23.791413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.795947 (+  4534us) service_pool.cc:224] Handling call
0709 12:10:24.723713 (+927766us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76e9c 00007f3be1c76a5b 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:25.166513 (+442800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10638592}
I20260709 12:10:25.262547 24131 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:25.243338 24262 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.266938 24258 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.245548 24277 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.229012 24292 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:10:25.271162 21992 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.289537 21847 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:25.272348 22001 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:25.202896 22581 rpcz_store.cc:276] 0709 12:10:24.065748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.071613 (+  5865us) service_pool.cc:224] Handling call
0709 12:10:24.823297 (+751684us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:24.862114 (+ 38817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.047290 (+185176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.153296 (+106006us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10533248}
I20260709 12:10:25.273272 21996 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.236101 24171 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.257702 24172 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:25.281617 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 308255us
I20260709 12:10:25.228878 24298 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.263537 23975 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.292725 21996 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:25.217707 24250 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.300096 21966 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.299350 21996 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.311329 21996 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.288642 24258 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:25.302858 24102 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 12:10:25.319242 24289 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:10:25.331434 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:25.312183 24262 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.302443 23975 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.303038 24172 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:25.346948 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46939.3us
I20260709 12:10:25.366794 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:25.296816 24283 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:25.382441 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.331952 24258 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.336239 23866 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:25.307988 24307 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.369021 22579 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:25.336298 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:25.361209 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1654) took 1088 ms. Trace:
I20260709 12:10:25.310082 24304 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.364976 22575 pending_rounds.cc:85] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 4
I20260709 12:10:25.391741 21847 rpcz_store.cc:276] 0709 12:10:24.273195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.354027 (+ 80832us) service_pool.cc:224] Handling call
0709 12:10:25.360959 (+1006932us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54001da1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:25.361116 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304032640}
W20260709 12:10:25.352509 24291 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.341s	user 0.002s	sys 0.000s
W20260709 12:10:25.394547 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 58354.1us
I20260709 12:10:25.406394 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:25.362630 24288 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
W20260709 12:10:25.353157 24287 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
W20260709 12:10:25.396189 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 148830us
I20260709 12:10:25.351429 24298 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:25.399422 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:25.415462 21847 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.351251 24137 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.419162 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.419471 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:25.404155 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.352851 23816 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:25.336483 24293 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:25.398779 22575 pending_rounds.cc:107] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:25.399403 24174 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:25.391300 24089 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:25.388413 24307 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.421241 22549 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.452678 24137 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:25.416005 24173 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:25.458379 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 53374.9us
W20260709 12:10:25.446643 24286 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.365s	user 0.001s	sys 0.001s
I20260709 12:10:25.452925 24089 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.443763 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1664) took 1138 ms. Trace:
I20260709 12:10:25.448540 22575 raft_consensus.cc:2889] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:25.444757 24090 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:25.451097 24305 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:25.467236 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 46111us
I20260709 12:10:25.449862 24174 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:25.466868 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47818us
I20260709 12:10:25.469499 21847 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:25.462268 24173 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:25.472429 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.399005 23866 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.474990 21966 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.406404 24299 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:10:25.482013 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.455585 24262 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:25.484282 24296 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.484808 22579 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.485306 24310 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.485951 24089 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:25.476876 24174 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.472347 24298 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:25.507308 23885 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.490180 24058 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:25.508311 24058 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.472903 24090 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.494706 24262 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.494979 24311 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.495417 24307 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:25.494737 24171 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:25.480422 24173 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.496400 24117 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.471146 24131 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:25.499555 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.500994 21966 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.511853 21993 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.526623 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.514716 21997 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:25.516360 21846 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
W20260709 12:10:25.517452 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 63503.3us
I20260709 12:10:25.528218 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.526916 21993 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:25.528795 21997 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:25.534230 21997 raft_consensus.cc:3055] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.534309 21817 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:25.534767 21997 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:25.510475 24269 consensus_meta.cc:287] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
W20260709 12:10:25.544447 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 43561.7us
I20260709 12:10:25.532124 21993 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.547050 21993 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.548492 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.549371 21926 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:25.551082 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:25.545495 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.521360 24310 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.510401 24058 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:25.463160 24137 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.512984 24311 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.523381 24234 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.521625 24190 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.483559 24304 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:25.535763 21997 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.614853 21993 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:10:25.614951 21997 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.512446 24262 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:10:25.540611 24259 consensus_meta.cc:287] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 12:10:25.521914 24298 raft_consensus.cc:697] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:25.543588 23885 raft_consensus.cc:697] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:25.608726 24089 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.623988 24321 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:25.466280 21845 rpcz_store.cc:276] 0709 12:10:24.284305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.302567 (+1018262us) service_pool.cc:224] Handling call
0709 12:10:25.342677 (+ 40110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.387241 (+ 44564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.390518 (+  3277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.395179 (+  4661us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:25.396821 (+  1642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.407404 (+ 10583us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.422212 (+ 14808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.609668 24299 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:25.644498 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.552882 24176 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:25.543015 24277 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.628582 21993 pending_rounds.cc:85] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 4
I20260709 12:10:25.610268 24311 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.544267 24216 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:10:25.553465 21996 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.624356 21995 pending_rounds.cc:85] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 6
I20260709 12:10:25.618564 24172 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:25.584834 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:25.646728 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 90652.3us
I20260709 12:10:25.647018 21993 pending_rounds.cc:107] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:10:25.500110 24293 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.647496 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:25.649142 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 122627us
I20260709 12:10:25.620211 24190 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.620021 24234 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:25.638034 24321 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:25.644704 24090 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:25.662344 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.656831 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.625277 21851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207491536b034836987ee3a520d08ff6"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:25.663208 21925 raft_consensus.cc:2393] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:25.663501 21851 raft_consensus.cc:606] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:25.663978 21851 raft_consensus.cc:614] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:25.652168 21995 pending_rounds.cc:107] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:25.653133 21993 raft_consensus.cc:2917] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
W20260709 12:10:25.660548 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 75815.9us
I20260709 12:10:25.660706 21920 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:25.669698 21927 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:25.582042 24269 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.667485 21922 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.676971 21920 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:25.646373 24176 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.679468 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.670957 21966 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:25.672585 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:25.681058 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.668963 21993 raft_consensus.cc:2889] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:25.677739 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:25.682147 21922 raft_consensus.cc:2368] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4.
I20260709 12:10:25.682850 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:25.684653 21927 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:25.677899 21918 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:25.671473 22547 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.651530 24247 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.655406 24181 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.687430 21925 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:25.690286 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.690901 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:25.667985 24299 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.677129 21995 raft_consensus.cc:2889] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:25.666147 24321 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.694497 21924 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:25.696452 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.696849 22580 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:25.685385 24176 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:25.689220 24170 consensus_meta.cc:287] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.000s
I20260709 12:10:25.680029 24090 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:10:25.725198 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 54358.1us
I20260709 12:10:25.729704 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.692031 22577 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:25.724558 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:25.741274 21966 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:25.741858 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 75316.1us
I20260709 12:10:25.742543 21851 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.744040 21997 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:25.744874 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.745312 21997 pending_rounds.cc:85] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 2
I20260709 12:10:25.745647 21997 pending_rounds.cc:107] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:25.745755 21993 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:25.746016 21997 raft_consensus.cc:2889] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:25.748054 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:25.748649 21993 raft_consensus.cc:2376] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4. Re-sending same reply.
I20260709 12:10:25.724721 21845 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:25.736209 24326 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.754469 21925 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:25.728381 24058 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:25.698076 24299 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.750727 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.762166 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.686578 24298 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.687845 24262 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.703877 24117 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:25.738978 24277 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:25.743667 24170 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.765964 21851 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 2.
I20260709 12:10:25.727898 23885 consensus_queue.cc:237] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.743875 24250 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.770179 21927 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:25.772249 21925 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:25.738821 24309 consensus_queue.cc:1059] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:10:25.755097 24326 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:25.747107 24297 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.767405 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:25.743628 24089 consensus_queue.cc:1059] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:25.773548 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:25.774554 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.748704 23975 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.776027 21993 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.780443 23975 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:25.781234 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:25.760360 23931 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:25.739737 24258 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.765143 24299 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.799608 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:25.798520 24325 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.800395 24117 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.771338 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1667) took 1468 ms. Trace:
I20260709 12:10:25.800571 24332 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.803448 21851 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
W20260709 12:10:25.758224 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 67409.1us
I20260709 12:10:25.778400 24326 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:25.819711 21846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1657) took 1537 ms (client timeout 1701 ms). Trace:
W20260709 12:10:25.820291 21846 rpcz_store.cc:269] 0709 12:10:24.282356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.325259 (+ 42903us) service_pool.cc:224] Handling call
0709 12:10:25.819506 (+1494247us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400215f54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:25.819632 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2718603136}
I20260709 12:10:25.822705 21926 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:25.805496 21925 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:10:25.806020 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:25.806622 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.810425 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:25.804265 24297 raft_consensus.cc:697] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:25.800700 24190 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:25.775822 24250 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.828022 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:25.828452 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.829454 24332 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.834652 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:25.835664 21851 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.837177 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.838620 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:25.834326 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:25.841850 21846 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:25.845616 24328 log.cc:927] Time spent T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:25.847087 21851 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:25.834326 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:25.848572 21851 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:10:25.849331 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1668) took 1536 ms. Trace:
I20260709 12:10:25.849704 21851 rpcz_store.cc:276] 0709 12:10:24.313005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.847752 (+1534747us) service_pool.cc:224] Handling call
0709 12:10:25.848240 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.849007 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.849254 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.840626 22577 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:25.863547 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.816425 24117 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.812568 21845 rpcz_store.cc:276] 0709 12:10:24.302643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.654609 (+1351966us) service_pool.cc:224] Handling call
0709 12:10:25.686830 (+ 32221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.758094 (+ 71264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.769420 (+ 11326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.874837 24332 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:25.880908 24250 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:25.882366 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:25.885334 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:25.889369 21851 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:25.889443 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:25.890298 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1550) took 1490 ms. Trace:
I20260709 12:10:25.887473 21847 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:25.890729 21851 rpcz_store.cc:276] 0709 12:10:24.399673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.850406 (+1450733us) service_pool.cc:224] Handling call
0709 12:10:25.880187 (+ 29781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.889965 (+  9778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.890249 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.892381 21847 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:25.893167 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1670) took 1033 ms. Trace:
I20260709 12:10:25.893553 21847 rpcz_store.cc:276] 0709 12:10:24.860278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.891617 (+1031339us) service_pool.cc:224] Handling call
0709 12:10:25.891990 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.892869 (+   879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.893100 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.896802 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:25.897738 21993 raft_consensus.cc:2368] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4.
I20260709 12:10:25.886399 24117 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:25.895071 24277 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.885356 21750 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 5, leader changed from <none> to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 5 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:25.902581 21750 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:25.908453 21846 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:25.904199 21750 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 4, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 4 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:10:25.913884 21750 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 4, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 4 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:25.916597 21750 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 2, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:25.867703 24297 consensus_queue.cc:237] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.886435 24139 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.928103 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:25.929191 21846 raft_consensus.cc:2368] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:25.921742 24326 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.922605 22577 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:25.909744 24117 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.924278 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.925629 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.896045 24190 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.927093 24247 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.877956 24321 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.929917 24258 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:25.900902 24277 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.932076 21750 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 3, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 3 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:25.936398 21996 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:25.937963 21851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:25.938472 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.931108 24139 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:25.949867 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:25.878240 24173 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:25.952232 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:25.995743 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 45971.2us
W20260709 12:10:25.962438 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.996616 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:25.958904 24309 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.953229 24332 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:25.947206 22578 consensus_meta.cc:287] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.770s	user 0.006s	sys 0.006s
I20260709 12:10:25.991066 24326 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:25.992805 21851 raft_consensus.cc:606] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:25.948382 22549 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:26.005764 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 57482.5us
I20260709 12:10:26.005893 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:25.994207 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:25.998030 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:25.992610 21750 catalog_manager.cc:5697] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:26.001693 24321 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.001592 24309 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.002938 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:26.003986 21922 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.994349 24277 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.960485 23931 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.022529 21851 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:25.947484 24174 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:25.993254 24190 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:26.016882 21927 raft_consensus.cc:2410] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:26.038430 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:26.039203 21996 raft_consensus.cc:2376] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5. Re-sending same reply.
I20260709 12:10:25.994792 21845 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.046869 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:26.008000 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:26.017802 24331 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:26.018239 24290 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.920s	user 0.005s	sys 0.007s
I20260709 12:10:26.023707 21851 raft_consensus.cc:1240] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.024271 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:26.056335 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.014469 21750 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:26.018258 24173 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.000823 24232 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:26.036708 22579 consensus_meta.cc:287] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.006s
I20260709 12:10:26.016142 24181 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.048974 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:26.091579 21927 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:26.050482 22578 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:26.061434 21925 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:26.059840 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 51938.2us
W20260709 12:10:26.088810 21848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1660) took 1805 ms (client timeout 2199 ms). Trace:
I20260709 12:10:26.088497 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:26.098285 21892 leader_election.cc:400] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4.
I20260709 12:10:26.098742 21892 leader_election.cc:403] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:26.098928 21996 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:26.097937 21848 rpcz_store.cc:269] 0709 12:10:24.283163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.522234 (+239071us) service_pool.cc:224] Handling call
0709 12:10:26.088631 (+1566397us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b54002909d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:26.088754 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82999680}
I20260709 12:10:26.101197 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:26.082110 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:26.102375 21848 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.960330 24117 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.106305 24117 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.114925 21848 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:26.094476 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:26.093943 22578 pending_rounds.cc:85] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 6
W20260709 12:10:26.095294 24285 log.cc:927] Time spent T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 1.083s	user 0.003s	sys 0.000s
I20260709 12:10:26.116547 22578 pending_rounds.cc:107] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:26.117084 22578 raft_consensus.cc:2889] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.095419 24190 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:26.118064 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 532) took 2336 ms. Trace:
I20260709 12:10:26.118865 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 538) took 1833 ms. Trace:
I20260709 12:10:26.118573 22578 rpcz_store.cc:276] 0709 12:10:23.781616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.782800 (+  1184us) service_pool.cc:224] Handling call
0709 12:10:23.825514 (+ 42714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.608071 (+782557us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54007646a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d1906f 00007f3be4d91f60 00007f3be4d937de 00007f3be4d9db49 00007f3be4d9e416 00007f3be4d9ad8f 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62
0709 12:10:26.117690 (+1509619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.117966 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175924480}
I20260709 12:10:26.120788 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:26.102564 24181 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.122531 22578 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 3: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:26.123723 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:26.125303 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:26.116516 21848 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:26.127444 24323 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.128577 21848 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:26.128139 24323 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.130790 21848 raft_consensus.cc:1240] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:26.061990 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 1931) took 1464 ms. Trace:
I20260709 12:10:26.139103 21998 rpcz_store.cc:276] 0709 12:10:24.597689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.608860 (+ 11171us) service_pool.cc:224] Handling call
0709 12:10:26.024128 (+1415268us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:26.061912 (+ 37784us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62524800}
I20260709 12:10:26.140231 21847 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:26.141060 21998 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:26.063066 21851 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 8. Ops: [6.6-6.6]
I20260709 12:10:26.063647 21750 catalog_manager.cc:5697] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:26.144399 21750 catalog_manager.cc:5697] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 4, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 4 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:26.134131 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:26.159247 21927 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.161190 21964 leader_election.cc:400] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 3 election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4.
I20260709 12:10:26.119532 22582 rpcz_store.cc:276] 0709 12:10:24.285944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.286080 (+   136us) service_pool.cc:224] Handling call
0709 12:10:24.286520 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.321868 (+ 35348us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:24.420499 (+ 98631us) log.cc:844] Serialized 14 byte log entry
0709 12:10:24.848238 (+427739us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.871244 (+ 23006us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.871449 (+   205us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:24.871498 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.871609 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.038598 (+1166989us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:26.118500 (+ 79902us) raft_consensus.cc:1685] finished
0709 12:10:26.118644 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.118798 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42387,"prepare.queue_time_us":131908,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":55244,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":34244,"spinlock_wait_cycles":68944768,"thread_start_us":484000,"threads_started":2,"wal-append.queue_time_us":573759}
I20260709 12:10:26.162374 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:26.150590 21998 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:26.135942 24244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.883s	user 0.021s	sys 0.003s
I20260709 12:10:26.093665 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1671) took 1233 ms. Trace:
I20260709 12:10:26.167459 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:26.038928 24182 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.187099 24182 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.191277 24102 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:26.191874 24102 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:26.192857 24102 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:26.057973 23931 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:26.200344 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.196142 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:26.207710 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 45440.4us
I20260709 12:10:26.211738 21964 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:26.182085 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:26.148017 24258 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.092454 24176 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:26.215214 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 287681us
W20260709 12:10:26.215864 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.218159 21964 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:26.058660 24139 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:26.178676 24244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.926s	user 0.021s	sys 0.003s
I20260709 12:10:26.221084 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:26.171306 22579 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:10:26.229415 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:26.235504 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.236001 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:26.236251 21892 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:26.208766 24102 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.194680 24058 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:26.214001 23975 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.240592 21848 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.087265 24311 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.219789 24293 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.240442 21844 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.240375 23931 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.219916 24294 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.234820 22579 pending_rounds.cc:85] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 4
I20260709 12:10:26.237095 24137 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.252717 21996 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:26.221424 24090 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:26.182737 21845 rpcz_store.cc:276] 0709 12:10:24.860563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.899054 (+1038491us) service_pool.cc:224] Handling call
0709 12:10:25.952934 (+ 53880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.053014 (+100080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.092263 (+ 39249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.241631 24139 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.221272 24263 consensus_queue.cc:1059] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:10:26.242022 24190 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.219067 24223 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:26.221553 24172 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:10:26.273590 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:26.248365 22579 pending_rounds.cc:107] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
W20260709 12:10:26.250599 24319 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.513s	user 0.002s	sys 0.000s
I20260709 12:10:26.245810 24255 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.279752 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:26.245723 24174 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:26.221036 24228 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:10:26.244450 24173 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:10:26.314913 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 72482.5us
I20260709 12:10:26.306936 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:26.239755 24250 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:26.314000 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:26.249155 24309 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:26.246851 24299 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:26.315496 21845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:26.289769 22578 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.317663 24176 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:26.318243 24345 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:10:26.318576 24253 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:26.320020 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:26.324311 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:26.316455 24306 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.286633 24310 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:26.289880 22579 raft_consensus.cc:2917] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:10:26.283437 24190 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:10:26.367654 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.366019 21996 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.287061 24222 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.280903 23931 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:10:26.370857 21998 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: [3.5-6.6]
I20260709 12:10:26.389510 21992 raft_consensus.cc:2368] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
W20260709 12:10:26.389727 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 65473.6us
I20260709 12:10:26.310827 24293 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:10:26.402381 21992 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:26.370712 24321 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:26.367183 21845 raft_consensus.cc:606] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:26.391484 24310 raft_consensus.cc:697] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:26.368433 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 541) took 1004 ms. Trace:
I20260709 12:10:26.406172 22579 raft_consensus.cc:2889] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.420770 24190 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.421759 24181 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4.
I20260709 12:10:26.335335 24058 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:26.403856 24253 raft_consensus.cc:697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:26.414928 24321 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.397957 24117 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:10:26.314850 24339 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 12:10:26.452351 24263 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.435312 24176 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.436933 24321 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:26.463999 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56984us
W20260709 12:10:26.466461 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.446367 24326 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.471638 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.438916 24247 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:26.450287 24233 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.453089 24263 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.488030 24233 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.484562 24326 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.472723 24311 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.467157 24176 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:26.482518 24332 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.456187 24253 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.495199 24299 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:26.523119 21993 raft_consensus.cc:2410] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:10:26.524107 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 278992us
W20260709 12:10:26.526854 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.429827 22575 rpcz_store.cc:276] 0709 12:10:25.364252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.364366 (+   114us) service_pool.cc:224] Handling call
0709 12:10:25.364685 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:25.649198 (+284513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.649233 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:25.690701 (+ 41468us) log.cc:844] Serialized 52 byte log entry
0709 12:10:26.239696 (+548995us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:26.241635 (+  1939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.245776 (+  4141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.366602 (+120826us) raft_consensus.cc:1685] finished
0709 12:10:26.366646 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.366839 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11533,"raft.queue_time_us":128376,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":629727,"threads_started":2,"wal-append.queue_time_us":635613}
I20260709 12:10:26.529497 24263 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:26.531859 24312 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.070s	user 0.000s	sys 0.003s
I20260709 12:10:26.508004 24293 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.535198 21892 leader_election.cc:400] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:26.535730 21892 leader_election.cc:403] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:26.523664 24233 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:26.537539 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:26.542631 24356 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.543180 24356 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:26.536958 24174 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.533011 24249 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.535844 24181 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.541918 24283 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.005s	sys 0.000s
I20260709 12:10:26.548005 21921 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:26.543535 24149 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.543018 24137 consensus_queue.cc:1059] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:26.571599 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:26.571751 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1663) took 2287 ms. Trace:
I20260709 12:10:26.572259 21998 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:26.572228 21844 rpcz_store.cc:276] 0709 12:10:24.284049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.159196 (+875147us) service_pool.cc:224] Handling call
0709 12:10:25.159471 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.246233 (+1086762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.571519 (+325286us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540024c554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:26.571694 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485630336}
I20260709 12:10:26.573167 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:26.575048 24323 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.575615 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:26.576143 21998 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.578131 24323 consensus_queue.cc:1059] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:26.579012 24332 raft_consensus.cc:3055] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.579084 24170 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:26.579494 24332 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:26.580399 24332 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.581445 24332 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:26.565893 24283 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.005s	sys 0.001s
I20260709 12:10:26.539078 24277 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:26.567374 24157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.005s	sys 0.010s
I20260709 12:10:26.537230 24293 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.565222 24149 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:26.522688 24310 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.561319 24249 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:26.593612 24183 consensus_queue.cc:1059] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:26.588904 24157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.006s	sys 0.010s
W20260709 12:10:26.589676 24358 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:10:26.566867 24181 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:26.624768 21817 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.007s (SENT) [suppressed 48 similar messages]
I20260709 12:10:26.597268 24364 consensus_queue.cc:1059] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:10:26.646646 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.599287 22581 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:26.652529 24326 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.653132 24149 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.937825 24362 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:26.665171 24294 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.670619 21998 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:26.942402 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:26.943403 21998 raft_consensus.cc:2393] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:26.944353 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:26.947722 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.699266 24181 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.701349 24277 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.606642 24356 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:26.728641 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.934079 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1899) took 1279 ms. Trace:
I20260709 12:10:26.967423 21926 rpcz_store.cc:276] 0709 12:10:25.654684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.656474 (+  1790us) service_pool.cc:224] Handling call
0709 12:10:26.933865 (+1277391us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54001937d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:26.934009 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366380928}
I20260709 12:10:26.935386 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 337) took 2590 ms. Trace:
W20260709 12:10:26.936810 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.968796 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1685) took 1294 ms. Trace:
I20260709 12:10:26.968734 21852 rpcz_store.cc:276] 0709 12:10:24.263780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.263923 (+   143us) service_pool.cc:224] Handling call
0709 12:10:24.274850 (+ 10927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.925174 (+650324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.853548 (+1928374us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400208854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:26.853856 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017371904}
I20260709 12:10:26.964084 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1489) took 1040 ms. Trace:
I20260709 12:10:26.969296 21922 rpcz_store.cc:276] 0709 12:10:25.674640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.683479 (+  8839us) service_pool.cc:224] Handling call
0709 12:10:25.683660 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.016705 (+333045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.968535 (+951830us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540036fbd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:26.968737 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736254336}
I20260709 12:10:26.933892 24283 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:26.792943 24174 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:26.708174 24176 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.707739 24293 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:26.711194 24249 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:26.975394 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.984627 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.974529 24283 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:26.980454 24326 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:26.678576 24321 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:26.989320 24188 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:26.990659 21843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 335) took 2748 ms (client timeout 3314 ms). Trace:
I20260709 12:10:26.991633 24321 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:26.949668 24139 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:26.986851 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 309) took 1137 ms. Trace:
W20260709 12:10:26.993279 21736 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d50c36e857cb4e33997aee7e5dd39447 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cffb5c192e144f7caa7b94271976ed42 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:26.988683 24326 consensus_queue.cc:1243] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:26.997685 24283 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:26.993709 21925 rpcz_store.cc:276] 0709 12:10:25.849011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.849150 (+   139us) service_pool.cc:224] Handling call
0709 12:10:25.865601 (+ 16451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.097502 (+231901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.981934 (+884432us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540013abd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:26.986762 (+  4828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449858432}
I20260709 12:10:26.938923 24362 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.004460 24234 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:26.991326 21843 rpcz_store.cc:269] 0709 12:10:24.242031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.243598 (+  1567us) service_pool.cc:224] Handling call
0709 12:10:26.990430 (+2746832us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540017f7d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:26.990590 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741222656}
I20260709 12:10:27.009048 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1651) took 2736 ms. Trace:
I20260709 12:10:27.009629 24217 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.015578 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 422612us
I20260709 12:10:27.012682 21850 rpcz_store.cc:276] 0709 12:10:24.272596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.148579 (+875983us) service_pool.cc:224] Handling call
0709 12:10:25.148870 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.180764 (+ 31894us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:25.258768 (+ 78004us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.391476 (+132708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.391548 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:25.391608 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.531214 (+1139606us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:27.008768 (+477554us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b540021cd54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:27.008823 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.008978 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2787,"prepare.queue_time_us":231395,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":5545,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":8439,"spinlock_wait_cycles":190229632,"thread_start_us":207201,"threads_started":2,"wal-append.queue_time_us":157734}
I20260709 12:10:27.018507 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:27.003060 24139 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.018512 21892 leader_election.cc:400] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:27.030064 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.030929 21850 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:27.032816 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:27.033402 21850 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.034806 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.035487 21848 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:27.019708 24246 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.047120 24362 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.049365 24139 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.019819 24234 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:27.017881 24217 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.059581 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1935) took 2460 ms. Trace:
I20260709 12:10:27.062201 21997 raft_consensus.cc:1217] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-5.7]   Dedup: 4.6->[5.7-5.7]
I20260709 12:10:27.062969 21997 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:10:27.067889 24217 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:27.069229 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.060151 21994 rpcz_store.cc:276] 0709 12:10:24.598968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.599085 (+   117us) service_pool.cc:224] Handling call
0709 12:10:24.599433 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:24.609231 (+  9798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.609275 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:24.609954 (+   679us) log.cc:844] Serialized 52 byte log entry
0709 12:10:25.041175 (+431221us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.147564 (+106389us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.179164 (+ 31600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.179246 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.997893 (+1818647us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b18000ac3c0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:27.056225 (+ 58332us) raft_consensus.cc:1685] finished
0709 12:10:27.059286 (+  3061us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.059500 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91389,"prepare.queue_time_us":110787,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":97343,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":9802,"spinlock_wait_cycles":7915264,"thread_start_us":217747,"threads_started":1,"wal-append.queue_time_us":346631}
I20260709 12:10:27.054391 24246 consensus_queue.cc:1059] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:27.081861 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:27.086547 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:27.083415 21850 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:27.089859 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:27.089932 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:27.099671 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.087661 24234 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:27.101313 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 476571us
W20260709 12:10:27.092976 23866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.594s	user 0.005s	sys 0.016s
I20260709 12:10:27.095319 24188 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.107906 24181 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.143603 24284 log.cc:927] Time spent T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 2.133s	user 0.006s	sys 0.009s
I20260709 12:10:27.111161 24137 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.105810 24249 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:27.106523 23866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.608s	user 0.005s	sys 0.017s
I20260709 12:10:27.151521 21850 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:27.104140 24234 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.142453 24366 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:27.103785 24071 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.120282 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:27.165848 24304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.544s	user 0.040s	sys 0.015s
I20260709 12:10:27.107751 24364 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.188093 24366 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.188334 24364 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.191501 24364 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.196331 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.196867 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:27.197561 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:27.198172 21923 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:27.183329 24367 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:10:27.149592 24362 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.211711 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:27.211516 24362 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.170511 24277 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:27.199193 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:27.172398 24190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.013s	sys 0.039s
I20260709 12:10:27.200371 24356 consensus_queue.cc:1059] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:27.200688 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:27.204393 24262 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:27.183549 24318 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.593s	user 0.002s	sys 0.011s
I20260709 12:10:27.210214 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.192457 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 696) took 1552 ms. Trace:
I20260709 12:10:27.229957 22580 rpcz_store.cc:276] 0709 12:10:25.640230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.682755 (+ 42525us) service_pool.cc:224] Handling call
0709 12:10:25.682991 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.703633 (+ 20642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.192203 (+1488570us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54006a45d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:27.192388 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31424256}
I20260709 12:10:27.176198 24188 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.220749 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:27.212927 24102 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:10:27.222259 24362 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.222800 24307 raft_consensus.cc:3055] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.223376 24283 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:27.213704 24249 raft_consensus.cc:697] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:27.294324 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:27.294478 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 82468.8us
W20260709 12:10:27.192724 24304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.571s	user 0.041s	sys 0.015s
I20260709 12:10:27.224018 24277 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:27.225966 24316 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 1.812s	user 0.000s	sys 0.015s
I20260709 12:10:27.280704 23866 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:27.224869 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 434) took 1473 ms. Trace:
I20260709 12:10:27.206250 24071 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.300228 21997 rpcz_store.cc:276] 0709 12:10:25.751674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.756276 (+  4602us) service_pool.cc:224] Handling call
0709 12:10:27.061989 (+1305713us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:27.063331 (+  1342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.224660 (+161329us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54003f3750. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:27.224801 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2993125632}
I20260709 12:10:27.301723 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:27.184971 24234 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.276404 21923 raft_consensus.cc:2410] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:10:27.228441 24190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.013s	sys 0.039s
I20260709 12:10:27.182929 24181 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.290472 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:27.224833 24366 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.282714 24188 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.310781 24277 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.313011 24324 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.313428 24324 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:10:27.315420 24370 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:27.316298 24269 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.185328 24137 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.295312 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:27.291767 24307 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:27.299919 24325 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:27.330360 21817 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:27.308797 24249 consensus_queue.cc:237] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.309212 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 699) took 1663 ms. Trace:
I20260709 12:10:27.336880 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:27.301517 24294 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.334661 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1933) took 2736 ms. Trace:
I20260709 12:10:27.335381 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.346238 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:27.346908 21994 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.318356 24137 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.324122 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.352984 21850 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:27.349929 23885 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.362119 24373 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:10:27.362452 23885 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.362955 24305 raft_consensus.cc:3055] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.363543 24305 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:27.363854 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:27.364704 23885 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.365038 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:27.336395 22577 rpcz_store.cc:276] 0709 12:10:25.645733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.875629 (+229896us) service_pool.cc:224] Handling call
0709 12:10:25.875895 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.949105 (+ 73210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.308852 (+1359747us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5400548dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:27.309106 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42337024}
I20260709 12:10:27.364665 24305 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.368798 24305 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.969964 21996 rpcz_store.cc:276] 0709 12:10:25.923804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.399986 (+476182us) service_pool.cc:224] Handling call
0709 12:10:26.417751 (+ 17765us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:26.418091 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.418115 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:26.418856 (+   741us) log.cc:844] Serialized 52 byte log entry
0709 12:10:26.565231 (+146375us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:26.570342 (+  5111us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.940563 (+370221us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b18000ab8e0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be4d93060 00007f3be4da5716 00007f3be4db6287 00007f3be4db6208
0709 12:10:26.940828 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.940936 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.940997 (+    61us) raft_consensus.cc:1685] finished
0709 12:10:26.963723 (+ 22726us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.963991 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13117,"prepare.queue_time_us":17368,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":378812,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":19161,"spinlock_wait_cycles":3118464,"thread_start_us":118036,"threads_started":1,"wal-append.queue_time_us":194332}
I20260709 12:10:27.366086 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:27.375260 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:27.339319 24283 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.344379 24362 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:27.340361 24062 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.305154 23866 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.386708 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:27.376469 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:27.387661 24295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.902s	user 0.001s	sys 0.016s
I20260709 12:10:27.381968 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 542) took 2013 ms. Trace:
I20260709 12:10:27.386461 24362 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:27.403136 24362 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.413416 24241 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.351971 24294 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:27.414074 21999 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:27.396482 24295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.910s	user 0.001s	sys 0.017s
I20260709 12:10:27.418610 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1930) took 2821 ms. Trace:
I20260709 12:10:27.419847 21999 rpcz_store.cc:276] 0709 12:10:24.597313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.612581 (+ 15268us) service_pool.cc:224] Handling call
0709 12:10:27.413579 (+2800998us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:27.413804 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.418173 (+  4369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.418523 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62365056}
I20260709 12:10:27.424923 21996 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:27.427563 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:27.428192 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.390314 24307 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.429407 24307 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.414088 24241 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.442580 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:27.423336 24283 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:27.438298 24071 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.456224 23866 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.439124 24188 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:27.457286 24314 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 2.043s	user 0.010s	sys 0.013s
I20260709 12:10:27.458585 24188 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.463116 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:27.471150 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:27.474357 24091 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.476379 21998 raft_consensus.cc:2410] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:27.480866 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1942) took 2185 ms. Trace:
I20260709 12:10:27.483091 24173 raft_consensus.cc:3055] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:27.483517 24173 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:27.396275 22576 rpcz_store.cc:276] 0709 12:10:25.364582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.371235 (+  6653us) service_pool.cc:224] Handling call
0709 12:10:25.371568 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:25.371967 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.371996 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:25.372595 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 12:10:25.413113 (+ 40518us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:25.413173 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.413286 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.225338 (+1812052us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:27.319171 (+ 93833us) raft_consensus.cc:1685] finished
0709 12:10:27.327233 (+  8062us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.378394 (+ 51161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":216203008,"thread_start_us":40003,"threads_started":1,"wal-append.queue_time_us":40430}
I20260709 12:10:27.448767 24181 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.486332 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:27.487911 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.481451 22001 rpcz_store.cc:276] 0709 12:10:25.295748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.295964 (+   216us) service_pool.cc:224] Handling call
0709 12:10:27.300093 (+2004129us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:27.300308 (+   215us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:27.304621 (+  4313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.304652 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:27.314362 (+  9710us) log.cc:844] Serialized 52 byte log entry
0709 12:10:27.384087 (+ 69725us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:27.384123 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.384191 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.480461 (+ 96270us) raft_consensus.cc:1685] finished
0709 12:10:27.480489 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.480780 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1837,"raft.queue_time_us":110,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":17345,"spinlock_wait_cycles":20606336,"thread_start_us":69344,"threads_started":1,"wal-append.queue_time_us":101980}
I20260709 12:10:27.445730 23825 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.461839 24283 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.489967 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:27.491376 22001 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.491724 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:27.484505 24234 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.484364 24173 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.502254 24173 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:27.503356 24234 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:27.503566 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.504197 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.496871 23825 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.512660 23825 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.507956 24294 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:27.516208 24315 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 2.051s	user 0.008s	sys 0.000s
I20260709 12:10:27.517048 24261 raft_consensus.cc:3055] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:27.517536 24261 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:27.518375 24261 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:27.519083 24374 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.359s	user 0.000s	sys 0.002s
I20260709 12:10:27.519779 24261 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.525635 24250 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.526276 24250 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.526218 24324 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.527752 24324 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.532227 24259 raft_consensus.cc:3055] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:27.532691 24259 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:27.533504 24259 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.537230 24172 raft_consensus.cc:3055] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:27.537664 24172 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:27.536423 24283 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.538545 24172 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:27.539378 24387 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:10:27.539565 24172 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.545354 24250 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.546944 24259 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.548185 24062 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:27.548857 24062 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.554474 24149 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.557677 24241 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:27.560560 24283 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.603314 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:27.604457 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.635979 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.638357 21852 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.641862 21852 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:27.651484 21844 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:27.652187 21843 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.652113 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.653576 21850 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.654006 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.654959 21848 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
W20260709 12:10:27.657198 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.657913 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.661798 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.663631 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.665930 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:27.666229 21921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 293) took 3286 ms (client timeout 1690 ms). Trace:
W20260709 12:10:27.666846 21921 rpcz_store.cc:269] 0709 12:10:24.379351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.391429 (+ 12078us) service_pool.cc:224] Handling call
0709 12:10:27.665674 (+3274245us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54001711d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:27.665897 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4957233024}
I20260709 12:10:27.671851 21848 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:27.674168 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:27.674959 21848 raft_consensus.cc:2376] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5. Re-sending same reply.
I20260709 12:10:27.678474 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:27.679546 21848 raft_consensus.cc:2376] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4. Re-sending same reply.
I20260709 12:10:27.682442 21850 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:27.683205 21817 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:27.685658 21850 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:27.686756 21993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1478) took 1882 ms (client timeout 2353 ms). Trace:
W20260709 12:10:27.687541 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.688455 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.688524 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:27.689703 21850 raft_consensus.cc:2393] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:27.692378 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.692565 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:27.687232 21993 rpcz_store.cc:269] 0709 12:10:25.804208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.059578 (+255370us) service_pool.cc:224] Handling call
0709 12:10:27.686294 (+1626716us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54002b84d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:27.686545 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934472064}
I20260709 12:10:27.695142 21850 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.695237 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:27.697043 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:27.697342 21848 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:27.697788 21993 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.712030 21996 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:27.715514 21995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1480) took 1903 ms (client timeout 2501 ms). Trace:
W20260709 12:10:27.716128 21995 rpcz_store.cc:269] 0709 12:10:25.812374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.133844 (+321470us) service_pool.cc:224] Handling call
0709 12:10:27.714961 (+1581117us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54000c44d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:27.715272 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927156096}
I20260709 12:10:27.719842 21996 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:27.722039 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.723892 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.726194 21848 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:27.727723 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.729247 21750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42850 (request call id 205) took 7005 ms. Trace:
I20260709 12:10:27.729445 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.730711 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:27.733997 21850 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.751314 21848 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:27.751711 24141 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.752585 24141 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.760535 21852 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:27.763545 24292 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.764451 24292 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.771366 24141 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.772001 24172 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.772702 24172 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.774734 24181 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:27.775097 24176 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.775470 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 700) took 2121 ms. Trace:
I20260709 12:10:27.775401 24181 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.775684 24176 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.776049 22578 rpcz_store.cc:276] 0709 12:10:25.653801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.126512 (+472711us) service_pool.cc:224] Handling call
0709 12:10:26.126871 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.387777 (+260906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.774920 (+1387143us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54004e9b54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:27.775250 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345660288}
I20260709 12:10:27.777849 24217 consensus_queue.cc:1059] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:27.779249 24182 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.779904 24217 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.782238 24381 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:27.784210 21997 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.784760 24228 raft_consensus.cc:3055] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:27.785194 24228 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:27.787231 24190 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:27.788056 24188 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:27.790628 24241 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:27.790798 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:27.791644 21848 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.791492 24241 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.786387 24183 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:10:27.795667 22576 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.798178 22577 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.798935 24362 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.799805 24362 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.802955 24174 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.803669 24174 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.806865 24090 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:27.807806 24090 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.347646 22000 rpcz_store.cc:276] 0709 12:10:24.598363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.602668 (+  4305us) service_pool.cc:224] Handling call
0709 12:10:26.285141 (+1682473us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76e9c 00007f3be1c76a5b 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:26.285334 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.285554 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:26.409447 (+123893us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.165536 (+756089us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b1800328f00. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be49434bc 00007f3be1c9148b 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b23a
0709 12:10:27.307651 (+142115us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.333900 (+ 26249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.334217 (+   317us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:27.334306 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.334421 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.334580 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247,"prepare.queue_time_us":130968,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":16116,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":7015,"spinlock_wait_cycles":69381248,"thread_start_us":269410,"threads_started":3,"wal-append.queue_time_us":7500}
I20260709 12:10:27.822016 24261 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:27.822829 24243 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:27.826133 24277 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.826848 24277 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.829690 24277 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:27.820106 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 80939.5us
I20260709 12:10:27.823191 24255 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:27.779918 24182 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.812422 24174 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.838902 21843 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.774771 24171 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:27.794341 24241 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:27.847824 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.848980 24377 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:27.818486 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:27.850924 24269 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:27.851691 24269 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.854941 24102 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.849040 24182 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.854449 24255 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.857357 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.865154 21850 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:27.861233 24262 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.854197 24269 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.871472 21993 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:27.872360 21995 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.849828 24377 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.855597 24102 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.906718 24102 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.907624 21844 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:27.908113 24377 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:27.912250 24090 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.882507 24262 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.927484 24176 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.929059 24262 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.929682 24182 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.929952 24174 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:27.930271 24182 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.930972 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:27.932480 21927 raft_consensus.cc:1240] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.890504 24171 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.933216 21923 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:27.933336 23931 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:27.893062 22582 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.893198 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:27.933941 23931 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.935127 21852 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:27.935320 21923 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:27.935266 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.936182 23931 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.936712 23931 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.936910 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.937129 24171 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.937201 23931 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.937794 24171 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.898927 21999 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:27.938405 24171 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.901383 24297 consensus_queue.cc:1059] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:27.861243 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 540) took 2480 ms. Trace:
I20260709 12:10:27.895659 22584 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.940462 24224 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.940903 24224 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:27.941023 24171 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.897023 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.941442 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.941893 22579 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:27.822853 24261 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.943106 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.944023 24362 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.943974 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:27.914085 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 67088.8us
I20260709 12:10:27.944442 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.944887 24261 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.944954 22579 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:27.883278 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:27.946341 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:27.946588 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 63579.8us
I20260709 12:10:27.941941 24224 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.946823 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:27.947217 22579 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:27.947829 24224 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.917624 24255 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.949206 21925 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.949783 24255 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:27.940477 22581 rpcz_store.cc:276] 0709 12:10:25.363959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.364107 (+   148us) service_pool.cc:224] Handling call
0709 12:10:25.364513 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.936916 (+1572403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.839388 (+902472us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400704254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:27.844081 (+  4693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2801357696}
I20260709 12:10:27.950330 24173 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:27.950945 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:27.921347 22577 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:10:27.951318 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.951975 24173 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.952075 22579 raft_consensus.cc:2410] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:27.952276 22581 raft_consensus.cc:2410] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:27.924628 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:27.952527 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.930814 24174 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.923672 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.924364 24149 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:27.914733 24310 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:27.954674 22583 raft_consensus.cc:2410] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:27.954864 24310 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.875983 24181 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.952396 24173 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.925511 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.956508 24173 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.956933 22580 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:27.954758 24149 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.892273 24172 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.958210 24172 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:27.958737 24172 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:27.932541 24182 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:27.959755 24172 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:27.953740 22579 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:10:27.952814 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.961265 22579 pending_rounds.cc:85] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 4
I20260709 12:10:27.961647 22579 pending_rounds.cc:107] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:27.963727 22579 raft_consensus.cc:2889] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:27.948040 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:27.965754 24261 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.937923 22582 raft_consensus.cc:2410] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:27.913026 24062 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.969758 21848 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:10:27.973193 21927 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:10:27.967020 21994 consensus_meta.cc:287] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.013s
I20260709 12:10:27.786374 24228 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:27.986464 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:28.000761 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:27.997089 24149 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:27.968833 22578 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:28.013892 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:27.986675 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:27.998641 21994 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:28.010890 22583 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:28.015836 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.011603 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:28.004184 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:27.730988 21750 rpcz_store.cc:276] 0709 12:10:20.724007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.724179 (+   172us) service_pool.cc:224] Handling call
0709 12:10:27.728936 (+7004757us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:26.418973 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:26.440496 (+ 21523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:26.440537 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:10:26.440554 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:26.557795 (+117241us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:26.560698 (+  2903us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:26.565591 (+  4893us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:10:26.591354 (+ 25763us) tablet.cc:701] Row locks acquired
0709 12:10:26.591378 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:10:26.591542 (+   164us) write_op.cc:270] Start()
0709 12:10:26.591726 (+   184us) write_op.cc:276] Timestamp: P: 1783599026591496 usec, L: 0
0709 12:10:26.591752 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:10:26.592423 (+   671us) log.cc:844] Serialized 4078 byte log entry
0709 12:10:27.222830 (+630407us) op_driver.cc:464] REPLICATION: finished
0709 12:10:27.396914 (+174084us) write_op.cc:301] APPLY: starting
0709 12:10:27.398556 (+  1642us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:27.432165 (+ 33609us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:27.438196 (+  6031us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:27.513879 (+ 75683us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:27.514171 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:10:27.514240 (+    69us) write_op.cc:312] APPLY: finished
0709 12:10:27.514562 (+   322us) log.cc:844] Serialized 77 byte log entry
0709 12:10:27.514752 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:27.515247 (+   495us) write_op.cc:454] Released schema lock
0709 12:10:27.515317 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:27.515725 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:27.515755 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":167015,"apply.run_cpu_time_us":5329,"apply.run_wall_time_us":123444,"num_ops":10,"prepare.queue_time_us":178938,"prepare.run_cpu_time_us":12053,"prepare.run_wall_time_us":243318,"raft.queue_time_us":128219,"raft.run_cpu_time_us":23609,"raft.run_wall_time_us":157592,"replication_time_us":621618,"thread_start_us":293516,"threads_started":4,"wal-append.queue_time_us":406623}]]}
I20260709 12:10:28.018173 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:28.024223 21925 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:28.024335 24292 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:28.033325 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.044947 21927 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:28.026863 22577 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:28.048390 22584 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:28.039429 24310 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:28.059165 21926 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:28.060118 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1953) took 1627 ms. Trace:
I20260709 12:10:28.060809 24174 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.043490 24261 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.060526 21992 rpcz_store.cc:276] 0709 12:10:26.432560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.435875 (+  3315us) service_pool.cc:224] Handling call
0709 12:10:26.436192 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.469967 (+ 33775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.470015 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.470624 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.675752 (+1205128us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b1800408e20. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:10:27.722946 (+ 47194us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:27.723014 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.723102 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.059579 (+336477us) raft_consensus.cc:1685] finished
0709 12:10:28.059622 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.059911 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40525,"raft.queue_time_us":33420,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":11532,"spinlock_wait_cycles":5071104,"thread_start_us":33170,"threads_started":1,"wal-append.queue_time_us":1390210}
W20260709 12:10:28.063807 22001 consensus_meta.cc:287] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.545s	user 0.004s	sys 0.009s
I20260709 12:10:28.064324 22001 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:28.065420 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:28.058753 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 78888.4us
W20260709 12:10:28.093734 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.103121 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:28.103794 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 225039us
I20260709 12:10:28.061328 24228 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:28.106004 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.106580 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.107761 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:28.108958 21998 raft_consensus.cc:1240] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:28.110332 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.110916 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.111750 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:28.111964 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.112325 21993 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:28.114388 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.118047 23931 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.119561 21921 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:28.125550 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:28.124814 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:28.130672 21927 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:28.132913 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.147931 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:28.149767 21993 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:28.152223 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.154170 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.154970 21924 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
W20260709 12:10:28.154174 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.132635 24261 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:28.158887 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:28.160181 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.139652 24062 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:28.142642 21921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5937d593814d4b568742fc86c954922d"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:10:28.165160 21921 raft_consensus.cc:606] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:28.165606 21921 raft_consensus.cc:614] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:28.168651 21926 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:28.166689 24255 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.169788 24255 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:28.170219 24255 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.175547 24306 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:28.179592 21927 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:28.180213 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.176349 24306 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.183249 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:28.180472 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:28.185534 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 234747us
I20260709 12:10:28.185858 21966 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:28.194566 21920 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:28.205938 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 49269.5us
I20260709 12:10:28.233628 21923 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:28.214659 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.203847 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:28.235670 21927 raft_consensus.cc:2393] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:28.205367 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 48911.8us
I20260709 12:10:28.204406 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:28.226558 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.218185 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:28.238763 21919 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:28.237910 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:28.244196 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.205606 24381 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.246567 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:28.250926 21892 leader_election.cc:336] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.353s (SENT)
I20260709 12:10:28.251770 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:28.251905 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:28.208087 24306 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:28.188355 22581 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:28.215818 24182 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.215579 24181 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.254567 21927 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:28.248135 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.215679 24277 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.234934 24149 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:28.257061 22583 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:28.260370 21848 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:28.261299 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:28.252624 24381 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:28.264200 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.194355 24173 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:28.264820 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:28.269652 21995 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:28.270888 22579 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:10:28.284490 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:28.271806 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.272116 21846 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:28.272217 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:28.253851 24062 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.272967 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:28.252792 24310 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:28.290213 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 127780us
I20260709 12:10:28.341346 21849 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:28.283936 24381 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.346442 21844 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:28.350936 24181 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:28.343758 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:28.357086 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:28.357452 24362 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:28.366858 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:28.367810 24262 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:28.369220 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 128412us
I20260709 12:10:28.370229 24325 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.370716 24325 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.371044 24325 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.371610 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.372355 21922 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:28.373526 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.374084 21922 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:28.284399 22579 pending_rounds.cc:85] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 4
W20260709 12:10:28.353483 24385 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:28.286799 24277 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:28.287710 24062 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.274115 24182 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:28.342260 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:28.376211 24228 consensus_queue.cc:1059] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:28.445415 24176 raft_consensus.cc:3055] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:28.445967 24176 raft_consensus.cc:740] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:28.377344 22577 raft_consensus.cc:1240] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:28.448475 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:28.379565 24401 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.319s	user 0.000s	sys 0.005s
I20260709 12:10:28.380861 21918 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:28.380800 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:28.466287 21850 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:28.382019 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:28.351716 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 91207.6us
I20260709 12:10:28.351356 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:28.387665 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.418817 22579 pending_rounds.cc:107] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 3.5
W20260709 12:10:28.481508 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 53571us
I20260709 12:10:28.465214 21924 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:28.447994 24261 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.494477 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1970) took 1099 ms. Trace:
I20260709 12:10:28.447062 24176 consensus_queue.cc:260] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.503538 21920 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:28.431753 24062 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.512111 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:28.513154 21967 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:28.529356 24149 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.529925 24149 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:28.538643 24306 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.539202 24306 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:28.539605 24306 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.539685 23825 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:28.496685 22579 raft_consensus.cc:2889] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:28.494339 21843 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:28.494892 21996 rpcz_store.cc:276] 0709 12:10:27.367373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.864425 (+497052us) service_pool.cc:224] Handling call
0709 12:10:27.989159 (+124734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.059886 (+ 70727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.059917 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.060452 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.156221 (+ 95769us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:28.156267 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.156339 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.466032 (+309693us) raft_consensus.cc:1685] finished
0709 12:10:28.466055 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.466228 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38801,"raft.queue_time_us":40009,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"spinlock_wait_cycles":1822464,"thread_start_us":95405,"threads_started":1,"wal-append.queue_time_us":186524}
W20260709 12:10:28.613369 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 362512us
W20260709 12:10:28.560112 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 53112.8us
W20260709 12:10:28.595037 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 218880us
I20260709 12:10:28.606969 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:28.578328 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.624830 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.547022 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.495307 24377 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:28.635288 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.644618 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:28.645331 22583 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:28.530401 24149 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.649266 21922 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:28.569847 22578 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:28.647682 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:28.568746 24173 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.507548 24261 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.569885 24182 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.564306 24283 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.565166 24172 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:10:28.662395 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.664994 21924 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:28.653457 22578 pending_rounds.cc:85] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 5
I20260709 12:10:28.667002 24292 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.667492 22578 pending_rounds.cc:107] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:28.667851 22578 raft_consensus.cc:2889] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:28.667670 24292 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:28.659191 24310 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.669262 21919 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:28.669445 24310 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:28.669931 24310 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.670109 24292 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:28.637874 24176 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.541620 23825 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.675575 21924 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:28.677307 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.575779 24255 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.573149 24224 consensus_queue.cc:1059] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 12:10:28.674280 24325 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.675279 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:28.691630 24292 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:28.699239 24283 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:28.701628 24283 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.654137 24377 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:28.832261 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 543094us
I20260709 12:10:28.659616 24173 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.853003 24325 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:28.853303 24306 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.686493 24181 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.708146 24277 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.853889 24310 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.718106 24261 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.855459 23825 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.874118 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:28.732581 24381 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.752285 24062 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.860965 24173 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.866542 24424 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:10:28.892168 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 230337us
W20260709 12:10:28.915374 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 54362.7us
W20260709 12:10:28.920598 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 262429us
I20260709 12:10:28.929782 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:28.909940 24261 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.875119 24362 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 12:10:28.932843 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.939839 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:28.946784 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 295977us
W20260709 12:10:28.947431 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.944265 24181 consensus_queue.cc:1059] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:28.954535 24137 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.958537 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:28.960050 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:28.939112 24306 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:28.938385 24149 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.941527 24261 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:28.968837 24228 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:28.949553 24182 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:10:28.981606 24362 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.990705 24424 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:28.991531 24310 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:28.992048 24173 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:28.992437 24381 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:28.993506 24062 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:28.998606 24377 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:29.013603 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 262847us
I20260709 12:10:28.947861 24277 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:10:29.001868 24362 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:29.006508 24182 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.020299 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:29.028379 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 370930us
I20260709 12:10:29.035387 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:29.016710 24090 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.042722 24224 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.049503 24224 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:29.050307 24224 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.051469 24224 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.019016 24310 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.068436 21996 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:29.030710 24362 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:29.069981 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 48901.9us
W20260709 12:10:29.066722 21851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.012s
W20260709 12:10:29.074694 21851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.003s	sys 0.013s
I20260709 12:10:29.094054 21994 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:29.028364 24182 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:29.065075 23825 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.098392 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:29.099560 22584 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.064726 24228 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:29.101935 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 451992us
I20260709 12:10:29.036940 24062 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:10:29.104118 21999 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:29.106025 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 146080us
W20260709 12:10:29.104604 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 168144us
W20260709 12:10:29.208065 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 234707us
W20260709 12:10:29.210759 22549 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.56.126:35507, user_credentials={real_user=slave}} blocked reactor thread for 95556.1us
I20260709 12:10:29.212663 21919 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:29.099335 23825 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:29.218425 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:29.221205 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:29.221808 21926 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.218538 21893 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:29.227123 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 256211us
I20260709 12:10:29.238320 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1719) took 1159 ms. Trace:
I20260709 12:10:29.251818 21893 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:29.209961 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:29.103048 24310 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.105047 24426 raft_consensus.cc:3055] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.248237 21918 rpcz_store.cc:276] 0709 12:10:28.062501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.122498 (+ 59997us) service_pool.cc:224] Handling call
0709 12:10:28.161000 (+ 38502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.478720 (+317720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.221240 (+742520us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540013b5d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:29.221410 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431270272}
I20260709 12:10:29.226361 23825 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.259671 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:29.268559 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 174624us
I20260709 12:10:29.271811 24438 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:10:29.272797 21964 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:29.267112 22578 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.261732 24149 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:29.261888 24426 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:29.289125 21893 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:29.315601 21851 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:29.324831 24149 consensus_queue.cc:1059] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:29.326609 24432 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.327526 24432 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.330607 24434 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:10:29.330892 24439 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:29.332659 24434 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.333227 24434 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.338234 21926 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:29.346589 24425 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.347699 24444 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.348392 24444 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.351302 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1930) took 1076 ms. Trace:
W20260709 12:10:29.351178 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62131.8us
I20260709 12:10:29.351843 21920 rpcz_store.cc:276] 0709 12:10:28.274541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.296247 (+ 21706us) service_pool.cc:224] Handling call
0709 12:10:29.351112 (+1054865us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54003606d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:29.351223 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54467328}
I20260709 12:10:29.352450 21893 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:29.359597 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:29.364071 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:29.365674 21996 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:29.368750 21893 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:29.366714 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:29.385396 21997 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.386241 22584 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:29.269734 24228 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:10:29.397652 21967 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:29.401003 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:29.319414 24062 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:29.368346 24277 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.370177 24261 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:29.435286 24431 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.390903 24173 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:29.445042 24436 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.146s	user 0.003s	sys 0.002s
I20260709 12:10:29.445158 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:29.442669 21817 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:29.427449 24445 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.447834 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:29.390841 24283 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.453622 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:29.450618 24224 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.455621 24173 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:29.492170 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.465488 21847 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:29.431471 24432 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:29.284848 24182 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.462762 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:29.440791 24424 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:29.394578 24425 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:10:29.499289 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:29.507092 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 233200us
I20260709 12:10:29.509431 24446 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.509644 24182 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.509907 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1932) took 1151 ms. Trace:
W20260709 12:10:29.527148 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 129267us
W20260709 12:10:29.510371 24447 log.cc:927] Time spent T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:10:29.468545 24171 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.465075 24283 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:29.514564 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.541085 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.468386 24224 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:29.496807 24173 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.549070 24456 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.549610 24456 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.458638 24431 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.551766 24456 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:29.551906 24431 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:29.552385 24431 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.502656 24228 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.552824 24431 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.541759 24310 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:29.510615 24450 consensus_queue.cc:1059] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:10:29.519469 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 145131us
I20260709 12:10:29.460988 24062 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.556828 24062 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:29.524616 24442 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:29.557379 24442 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:29.558717 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:29.525321 24453 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:29.499987 24445 raft_consensus.cc:697] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:29.559419 24453 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.560081 24445 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.561627 24453 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:29.525575 24292 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:29.561740 24433 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:29.562381 24292 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.564412 24292 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:29.510169 24424 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.568075 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:29.568637 22584 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.569463 21852 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:29.570750 24450 raft_consensus.cc:3055] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.571132 24450 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:29.531220 21997 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:29.510834 24440 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.527612 21921 rpcz_store.cc:276] 0709 12:10:28.358578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.675647 (+317069us) service_pool.cc:224] Handling call
0709 12:10:28.682437 (+  6790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.682853 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.682882 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.683383 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.943810 (+260427us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:28.943867 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.943961 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.509656 (+565695us) raft_consensus.cc:1685] finished
0709 12:10:29.509678 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.509821 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1044,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":21201,"thread_start_us":249282,"threads_started":1,"wal-append.queue_time_us":406001}
I20260709 12:10:29.544013 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:29.526894 24446 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:29.542110 24283 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.532326 24171 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.547320 24224 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.512480 24426 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.558317 24442 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.525103 24452 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:29.528654 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:29.579496 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47825.9us
W20260709 12:10:29.571606 24437 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.004s
I20260709 12:10:29.735617 24434 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:29.745074 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 247737us
I20260709 12:10:29.643365 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:29.594372 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 324072us
I20260709 12:10:29.682202 24262 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.747815 22584 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:29.617288 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:29.587481 24440 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.587065 22583 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.676627 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:29.582558 24446 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.759662 22578 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:29.600406 24171 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.662503 24431 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:29.582721 21843 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.761488 21964 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:29.792805 21851 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.593698 24438 consensus_queue.cc:1243] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:29.752470 24424 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:29.800762 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 245776us
I20260709 12:10:29.800666 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:29.804636 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:29.760782 24452 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:29.811278 24292 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:29.812152 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:29.756063 24306 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:29.791850 24439 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.816538 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:29.818401 21921 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.818892 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:29.806193 24431 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.818197 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:29.823024 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:29.826144 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 70593us
W20260709 12:10:29.826763 24429 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:10:29.827999 21964 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:29.828581 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1922) took 1608 ms. Trace:
I20260709 12:10:29.829144 24434 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.830082 24434 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:29.830556 24062 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:29.831377 24453 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.831972 24453 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:29.832911 24453 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.747319 24450 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.830902 24434 consensus_queue.cc:1243] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:10:29.836299 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 303677us
W20260709 12:10:29.841120 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 90003.8us
W20260709 12:10:29.841964 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.764701 24262 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:29.843403 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.844664 24438 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.844972 24467 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:29.830587 24439 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.828956 21923 rpcz_store.cc:276] 0709 12:10:28.220572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.347392 (+126820us) service_pool.cc:224] Handling call
0709 12:10:28.412792 (+ 65400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:28.494843 (+ 82051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.494872 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:28.635353 (+140481us) log.cc:844] Serialized 52 byte log entry
0709 12:10:28.931592 (+296239us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:28.944610 (+ 13018us) log.cc:844] Serialized 14 byte log entry
0709 12:10:28.949159 (+  4549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.949255 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.731241 (+781986us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b48000627d8. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be9cc4aa1 00007f3be9cbbb37 00007f3be9cbb9ca 00007f3be9db326f 00007f3be9db2f37 00007f3be9dc755c 00007f3be9dc7508 00007f3be9dc7488 00007f3be9dc7443 00007f3be9dc66ec 00007f3be8cf0a96
0709 12:10:29.828300 (+ 97059us) raft_consensus.cc:1685] finished
0709 12:10:29.828394 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.828524 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70657,"prepare.queue_time_us":12595,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":77244,"raft.run_cpu_time_us":3239,"raft.run_wall_time_us":1228522,"spinlock_wait_cycles":30788864,"thread_start_us":266767,"threads_started":1,"wal-append.queue_time_us":861263}
I20260709 12:10:29.822271 24249 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.851810 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:29.843329 24362 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.743s	user 0.005s	sys 0.009s
W20260709 12:10:29.848575 23825 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.000s
W20260709 12:10:29.860618 24435 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:10:29.871366 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:29.835057 24255 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:29.848501 24438 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:29.871302 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:29.860936 21925 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:29.910521 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:29.871325 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:29.911597 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:29.910720 22580 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:29.874621 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:29.873818 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 78778.1us
I20260709 12:10:29.822376 24431 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.912652 21922 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:29.829819 24173 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.918182 21918 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 2.
I20260709 12:10:29.925868 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:29.926501 21923 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
W20260709 12:10:29.927693 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 85608.5us
I20260709 12:10:29.911827 24438 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.756160 24456 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:10:29.829814 24459 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:29.923993 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:29.977619 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 130948us
I20260709 12:10:29.872427 24228 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:10:29.860482 24462 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:29.965642 24450 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.967935 24434 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.863436 24362 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.870803 23825 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:29.983675 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:29.870491 24249 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:29.991560 21818 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:29.858348 24467 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:29.995246 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 167343us
I20260709 12:10:29.998095 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:29.998365 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:30.000635 24461 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:30.000835 21926 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:30.001225 24461 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.002002 24467 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.003794 24461 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.007246 24431 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.008080 24456 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.008459 24456 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.008806 24456 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.011042 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1921) took 1820 ms. Trace:
I20260709 12:10:29.922269 24452 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.011430 21927 rpcz_store.cc:276] 0709 12:10:28.220162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.259712 (+ 39550us) service_pool.cc:224] Handling call
0709 12:10:28.283334 (+ 23622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.354781 (+ 71447us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:28.354811 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.653469 (+298658us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.021707 (+368238us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:29.021767 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.021863 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.010773 (+988910us) raft_consensus.cc:1685] finished
0709 12:10:30.010792 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.010966 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59908,"raft.queue_time_us":60085,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"thread_start_us":339079,"threads_started":1,"wal-append.queue_time_us":849156}
I20260709 12:10:29.979835 24432 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:10:29.982635 24463 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:10:30.023164 21919 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:30.016793 22579 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:30.026461 24137 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:30.029544 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 513) took 2142 ms. Trace:
I20260709 12:10:30.031800 24062 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:30.032842 24466 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:10:30.035282 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.996039 24440 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:29.997191 24455 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:30.023448 24457 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.479s	user 0.000s	sys 0.005s
I20260709 12:10:29.991328 24434 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.050871 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:30.085078 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:30.085765 24455 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.086247 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:30.086704 24440 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.086350 24455 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.087386 24440 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.087697 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:30.088090 24262 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.089073 22579 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.089380 24474 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.089939 24474 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:30.091962 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 106129us
I20260709 12:10:30.090891 24474 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:30.081904 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 83602.1us
I20260709 12:10:30.090382 22579 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:30.102862 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:30.091018 24255 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.103731 22579 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:30.104065 24255 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:30.102917 24460 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:10:30.106865 24470 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.107318 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 709) took 1656 ms. Trace:
I20260709 12:10:30.091537 24476 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:30.102789 24464 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:30.108278 24476 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:30.109046 24464 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:30.109477 24464 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:30.109341 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.109215 24476 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:30.110725 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 145529us
I20260709 12:10:30.110365 24464 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.111171 24439 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.111687 24464 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.112090 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:30.112980 21999 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:30.116528 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:30.117159 21995 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:30.039816 24062 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:30.040422 24137 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:30.124929 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 555) took 2143 ms. Trace:
I20260709 12:10:30.050827 21843 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:30.118641 23931 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:30.050495 24462 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:30.050143 24306 consensus_queue.cc:1059] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
W20260709 12:10:30.147337 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 287730us
I20260709 12:10:30.148303 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:30.149025 24474 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.149413 21815 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:30.150194 24381 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:30.151048 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 66076.7us
W20260709 12:10:30.154603 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.156066 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:30.095532 24455 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.164664 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:30.137440 24476 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.167927 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:30.169019 21927 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:30.118846 24461 consensus_queue.cc:1059] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:30.054168 24459 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 12:10:30.175823 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 64378.1us
I20260709 12:10:30.173869 21817 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:30.171895 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:30.177986 21919 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:30.173084 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:30.182257 21817 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:30.128980 24283 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:30.188714 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 48003.3us
I20260709 12:10:30.193688 21921 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:30.194872 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 334) took 1084 ms. Trace:
I20260709 12:10:30.166736 24255 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.166062 24173 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.128822 24224 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:30.198271 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:30.198796 21993 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.144728 23931 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.203816 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:30.207868 21921 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:30.200276 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:30.209156 21994 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:30.214685 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:30.222724 21925 raft_consensus.cc:2410] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:30.196039 24432 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.223626 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:30.197769 21924 rpcz_store.cc:276] 0709 12:10:29.110335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.110476 (+   141us) service_pool.cc:224] Handling call
0709 12:10:29.219599 (+109123us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.250856 (+ 31257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.250892 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.267940 (+ 17048us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.507709 (+239769us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:29.507748 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.507810 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.006737 (+498927us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:30.183810 (+177073us) raft_consensus.cc:1685] finished
0709 12:10:30.183829 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.194799 (+ 10970us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5333,"raft.queue_time_us":10822,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6302,"spinlock_wait_cycles":64188800,"thread_start_us":203431,"threads_started":1,"wal-append.queue_time_us":262736}
I20260709 12:10:30.195873 24062 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.204586 24362 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.229069 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:30.226178 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:30.227555 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:30.228066 21996 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:30.277442 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 45936.4us
I20260709 12:10:30.208693 24137 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:30.284806 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 80246us
I20260709 12:10:30.227468 24432 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.276618 24306 consensus_queue.cc:1243] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:10:30.285403 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 99987.5us
I20260709 12:10:30.224977 24470 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.296847 24482 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.285060 24478 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:30.301548 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.297854 24470 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.284704 24249 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.288959 24432 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.308108 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.252976 23825 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:30.307721 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:30.307739 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:30.303548 24137 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.308911 21850 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:30.309608 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.282460 24362 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:10:30.311311 21851 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.305321 21843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:30.039566 22575 rpcz_store.cc:276] 0709 12:10:27.886974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.891047 (+  4073us) service_pool.cc:224] Handling call
0709 12:10:27.891408 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.945858 (+ 54450us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:28.113830 (+167972us) log.cc:844] Serialized 14 byte log entry
0709 12:10:28.350547 (+236717us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.411031 (+ 60484us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:28.417787 (+  6756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.029055 (+1611268us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b54000ff354. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:30.029135 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.029329 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":291634,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":5034,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":27522,"spinlock_wait_cycles":124401024,"thread_start_us":319234,"threads_started":2,"wal-append.queue_time_us":698884,"wal-append.run_cpu_time_us":1076,"wal-append.run_wall_time_us":1003125}
I20260709 12:10:30.310832 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.304527 24478 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.293229 24171 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.312834 21849 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:30.107784 22577 rpcz_store.cc:276] 0709 12:10:28.451240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.465242 (+ 14002us) service_pool.cc:224] Handling call
0709 12:10:29.365019 (+899777us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:29.365198 (+   179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.365622 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.365658 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.366203 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.676413 (+310210us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:29.681282 (+  4869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.692392 (+ 11110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.107012 (+414620us) raft_consensus.cc:1685] finished
0709 12:10:30.107032 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.107256 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8744,"raft.queue_time_us":2509,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11568,"spinlock_wait_cycles":8750848,"thread_start_us":233410,"threads_started":1,"wal-append.queue_time_us":453287}
I20260709 12:10:30.301731 24424 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:30.308228 24470 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.307713 24434 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:30.321887 23931 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.322656 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:30.320091 24478 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.320346 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:30.359172 24455 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.359750 24455 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:30.362005 24455 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:30.310853 24482 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:30.367791 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50522.2us
I20260709 12:10:30.368973 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:30.369863 22578 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:30.319471 24461 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.378510 23931 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:30.319149 21843 raft_consensus.cc:606] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:30.379452 24171 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.382336 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:30.374191 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:30.384883 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 95303us
I20260709 12:10:30.390899 22000 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.391194 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:30.392349 24071 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.392416 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:30.392843 24071 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.393275 24071 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:30.394243 24465 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.418s	user 0.003s	sys 0.013s
I20260709 12:10:30.394939 24445 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.395362 24445 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:30.395730 24445 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.398293 24174 raft_consensus.cc:3055] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:30.398751 24174 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:30.389248 24182 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:10:30.399559 24174 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.401011 24174 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.401656 24071 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.404275 24071 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.395570 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:30.422286 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:30.422943 22578 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.421523 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:30.426872 22580 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.428371 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:30.354568 24424 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.422997 24182 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.437130 24182 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:30.437595 24182 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.438123 24482 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.438740 24482 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.438917 24456 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.439270 24482 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.441597 24456 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:30.389439 24467 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:10:30.443586 24479 log.cc:927] Time spent T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:10:30.445523 24482 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.417896 24283 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.414673 23931 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:30.374429 24432 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.459893 21998 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:30.465735 21851 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
W20260709 12:10:30.478658 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.435575 24224 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:30.495566 21815 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:30.497203 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:30.423415 24453 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:10:30.499782 21846 raft_consensus.cc:2393] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:30.500765 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 81130.2us
I20260709 12:10:30.432919 24438 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.502194 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:30.504995 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46194.2us
W20260709 12:10:30.506575 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 142389us
I20260709 12:10:30.507396 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 708) took 2145 ms. Trace:
I20260709 12:10:30.448385 24450 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:10:30.508482 22578 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:30.434463 24480 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:10:30.515308 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:30.502359 24482 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.517688 21920 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:30.503147 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:30.518980 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:30.520153 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:30.507908 22581 rpcz_store.cc:276] 0709 12:10:28.361558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.361728 (+   170us) service_pool.cc:224] Handling call
0709 12:10:28.362128 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.368581 (+  6453us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:28.530226 (+161645us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4800061458. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be9cc4aa1 00007f3be9cbbb37 00007f3be9cbb9ca 00007f3be9db326f 00007f3be9db2f37 00007f3be9dc755c 00007f3be9dc7508 00007f3be9dc7488 00007f3be9dc7443 00007f3be9dc66ec 00007f3be8cf0a96
0709 12:10:30.117158 (+1586932us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.288750 (+171592us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.300056 (+ 11306us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.300156 (+   100us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.300176 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.300265 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.504010 (+203745us) raft_consensus.cc:1685] finished
0709 12:10:30.507173 (+  3163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.507311 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1688451,"prepare.queue_time_us":1741524,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":6397,"raft.run_cpu_time_us":3200,"raft.run_wall_time_us":168880,"spinlock_wait_cycles":33834880,"thread_start_us":116925,"threads_started":1,"wal-append.queue_time_us":194266}
I20260709 12:10:30.527706 21918 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.524716 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:30.517869 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:30.514179 24445 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.524091 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:30.530290 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.538174 24443 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.015s	sys 0.018s
W20260709 12:10:30.538574 24443 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.015s	sys 0.018s
I20260709 12:10:30.528889 22578 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:30.505978 24461 raft_consensus.cc:697] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:30.543596 21964 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:30.544567 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:30.545780 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:30.553072 24456 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:30.566565 21927 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:30.553980 24453 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.568279 24453 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.568743 24453 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.541167 23931 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.554353 24292 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.572237 24292 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.572670 24292 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.579632 24452 raft_consensus.cc:3055] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:30.580118 24452 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:30.582537 24444 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.541538 24440 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.540966 24464 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.525661 24224 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:30.544157 24283 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.602922 22578 raft_consensus.cc:3055] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.602778 24440 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:30.628158 24440 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.629230 24283 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:30.629693 24283 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:30.633096 24430 log.cc:927] Time spent T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.117s	user 0.005s	sys 0.010s
I20260709 12:10:30.633567 24478 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.611363 24438 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:30.617719 22000 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:30.629999 24182 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.627365 22578 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:30.593822 22580 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:10:30.125389 22582 rpcz_store.cc:276] 0709 12:10:27.981523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.997823 (+ 16300us) service_pool.cc:224] Handling call
0709 12:10:28.005327 (+  7504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.014907 (+  9580us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:28.230729 (+215822us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.041446 (+1810717us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b1800353d40. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be87933c7 00007f3be4da59a7 00007f3be4db50bf 00007f3be4db5038
0709 12:10:30.041704 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.124593 (+ 82889us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.124643 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.124713 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.124776 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.124875 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1700005,"prepare.queue_time_us":1967562,"prepare.run_cpu_time_us":157,"prepare.run_wall_time_us":52354,"raft.queue_time_us":4223,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":125,"spinlock_wait_cycles":11729792,"thread_start_us":378487,"threads_started":3,"wal-append.queue_time_us":98923,"wal-append.run_cpu_time_us":1322,"wal-append.run_wall_time_us":1001272}
W20260709 12:10:30.661693 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.665500 21926 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.664462 22578 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.693760 22578 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:30.670908 24446 consensus_meta.cc:287] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.000s
W20260709 12:10:30.693416 24481 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
W20260709 12:10:30.713811 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 162140us
W20260709 12:10:30.712725 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 150783us
I20260709 12:10:30.718235 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:30.720634 21926 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:30.723229 21817 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:30.701666 24182 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.671439 24453 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.729540 24424 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.724750 24455 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:30.730677 24455 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.724907 24464 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:10:30.726883 24292 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.732745 24455 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.726917 24438 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.734009 24438 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.729548 24453 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:30.734267 24292 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:30.735956 24438 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.736850 24461 consensus_queue.cc:237] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.708631 24446 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:30.738785 24449 raft_consensus.cc:3055] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.739202 24449 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:30.740132 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.740257 24446 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.739967 24449 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.741325 24491 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:30.741876 24491 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:30.742853 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:30.743677 21922 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:10:30.741166 24509 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:30.727715 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1592) took 2438 ms. Trace:
I20260709 12:10:30.753170 22578 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:30.714476 24432 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:30.752112 24456 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:10:30.756248 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.756409 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.756945 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:30.757237 21852 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:30.757592 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.775061 21851 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:30.750914 21848 rpcz_store.cc:276] 0709 12:10:28.284979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.285514 (+   535us) service_pool.cc:224] Handling call
0709 12:10:28.341603 (+ 56089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.357256 (+ 15653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.357288 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.627486 (+270198us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.010094 (+382608us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:29.010136 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.010217 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.632408 (+1622191us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:30.713040 (+ 80632us) raft_consensus.cc:1685] finished
0709 12:10:30.713062 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.723640 (+ 10578us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10701,"raft.queue_time_us":12177,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"spinlock_wait_cycles":3495296,"thread_start_us":343006,"threads_started":1,"wal-append.queue_time_us":802031}
I20260709 12:10:30.765527 22582 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:30.786084 21849 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:30.727612 24442 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.798565 24456 consensus_queue.cc:1243] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:10:30.818452 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 92959.5us
I20260709 12:10:30.824275 22582 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:10:30.821587 24474 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.004s
I20260709 12:10:30.833652 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.795308 24509 consensus_queue.cc:1243] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:30.742753 24491 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:30.835201 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.837551 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:30.842787 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:30.843073 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:30.843938 21994 raft_consensus.cc:2410] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:30.845626 22578 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
W20260709 12:10:30.855295 24495 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:10:30.837879 24474 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.835453 24478 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:30.870998 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:30.916013 22578 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:30.967986 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.073915 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.210222 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 492065us
I20260709 12:10:30.855656 24509 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:31.241571 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.007190 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:31.238340 21815 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:31.007859 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.162710 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:31.189204 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:31.247920 22582 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:31.018937 24503 log.cc:927] Time spent T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 12:10:31.018863 24500 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.354s	user 0.001s	sys 0.001s
W20260709 12:10:31.190058 24460 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:10:31.165205 22575 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:31.254402 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:31.253847 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:31.197935 24381 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:31.162989 24485 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.263904 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:31.258136 22578 raft_consensus.cc:2376] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6. Re-sending same reply.
I20260709 12:10:31.264776 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:31.109954 24445 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:31.165933 24443 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.258704 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1734) took 1104 ms. Trace:
I20260709 12:10:31.308848 21927 rpcz_store.cc:276] 0709 12:10:30.153824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.184753 (+ 30929us) service_pool.cc:224] Handling call
0709 12:10:31.258505 (+1073752us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54002e6654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:31.258632 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820531584}
I20260709 12:10:31.311687 24485 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:31.312813 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:31.313683 21848 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:31.241219 24509 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.251497 24474 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.253278 24478 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:31.318578 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:31.314576 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 105222us
I20260709 12:10:31.328176 24509 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.392274 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:31.333585 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:31.334694 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 371) took 1537 ms. Trace:
W20260709 12:10:31.403367 21918 consensus_meta.cc:287] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.000s
I20260709 12:10:31.403509 21845 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:30.971578 24283 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:31.374655 24510 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:10:31.359897 24452 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:31.366214 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:31.264540 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:31.393049 21997 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
W20260709 12:10:31.426858 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 884435us
W20260709 12:10:31.394472 24492 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.986s	user 0.007s	sys 0.007s
I20260709 12:10:31.405261 21818 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:31.426748 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 902643us
I20260709 12:10:31.406848 21918 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:31.403374 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:31.327723 24440 consensus_meta.cc:287] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.001s
I20260709 12:10:31.404132 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1599) took 1105 ms. Trace:
W20260709 12:10:31.427037 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 173272us
I20260709 12:10:31.400741 24438 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:31.405743 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:31.441538 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:31.441958 21848 raft_consensus.cc:2393] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:31.443372 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:31.375972 24478 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:31.406250 24503 log.cc:927] Time spent T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:10:31.403307 21847 rpcz_store.cc:276] 0709 12:10:29.797759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.797919 (+   160us) service_pool.cc:224] Handling call
0709 12:10:29.813915 (+ 15996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.846807 (+ 32892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.846855 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.874171 (+ 27316us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.869402 (+995231us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b18002a4ba0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:10:31.196179 (+326777us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:31.196222 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.196385 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.334344 (+137959us) raft_consensus.cc:1685] finished
0709 12:10:31.334366 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.334609 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35115,"raft.queue_time_us":159915,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":7692,"spinlock_wait_cycles":3789696,"thread_start_us":270855,"threads_started":1,"wal-append.queue_time_us":1398506}
I20260709 12:10:31.393471 24463 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:31.406469 24470 consensus_meta.cc:287] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.033s	user 0.012s	sys 0.000s
W20260709 12:10:31.444602 24442 consensus_meta.cc:287] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
I20260709 12:10:31.506801 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:31.520241 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.526980 24485 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:31.528653 24283 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:31.529520 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 124322us
I20260709 12:10:31.480665 24502 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:31.442287 24448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.021s	sys 0.035s
I20260709 12:10:31.433472 24071 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:31.531646 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:31.330746 24443 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:31.580554 21847 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:31.530145 21852 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:31.517309 21994 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:31.536721 22582 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:31.583897 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:31.584630 22582 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.483263 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:31.585285 22000 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:31.538748 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 568) took 1247 ms. Trace:
I20260709 12:10:31.538691 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:31.539676 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1731) took 1386 ms. Trace:
I20260709 12:10:31.586982 21924 rpcz_store.cc:276] 0709 12:10:30.153074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.253616 (+100542us) service_pool.cc:224] Handling call
0709 12:10:30.280584 (+ 26968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.293782 (+ 13198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.293831 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.294511 (+   680us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.507314 (+212803us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:30.507389 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.507492 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.539453 (+1031961us) raft_consensus.cc:1685] finished
0709 12:10:31.539479 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.539617 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":892,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":12487,"thread_start_us":192563,"threads_started":1,"wal-append.queue_time_us":246391}
I20260709 12:10:31.546947 21995 raft_consensus.cc:2410] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:31.396282 24474 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:31.550743 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 72011.9us
I20260709 12:10:31.551079 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:31.532264 24452 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.580283 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:31.542356 22575 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:31.479743 24478 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:31.553630 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 112177us
I20260709 12:10:31.608871 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:31.595548 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 277075us
I20260709 12:10:31.609740 21923 raft_consensus.cc:2376] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7. Re-sending same reply.
I20260709 12:10:31.610359 21967 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:31.615619 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:31.616560 21852 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 9 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:10:31.549211 22581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.005s	sys 0.027s
I20260709 12:10:31.598649 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:31.598817 21924 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:10:31.617362 22581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.005s	sys 0.027s
I20260709 12:10:31.601282 21893 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:31.553225 24071 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:31.594741 21993 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
W20260709 12:10:31.550307 24448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.024s	sys 0.041s
I20260709 12:10:31.606375 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:31.619158 21967 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:31.680752 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 79538.1us
I20260709 12:10:31.618472 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:31.627367 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.632608 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:31.684574 21927 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:31.684993 22582 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:31.633360 21921 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.686467 22582 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:31.658573 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:31.687320 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 536) took 1134 ms. Trace:
I20260709 12:10:31.589468 22579 rpcz_store.cc:276] 0709 12:10:30.291097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.446789 (+155692us) service_pool.cc:224] Handling call
0709 12:10:30.447209 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.447750 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.447786 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.492484 (+ 44698us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.794267 (+301783us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:30.794323 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.797062 (+  2739us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.532029 (+734967us) raft_consensus.cc:1685] finished
0709 12:10:31.537441 (+  5412us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.538690 (+  1249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":263083,"threads_started":1,"wal-append.queue_time_us":321914}
I20260709 12:10:31.540386 24432 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:31.548887 24502 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:31.550375 24424 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.448592 24440 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:31.674851 22549 connection.cc:256] RPC call timeout handler was delayed by -2.0462925149997773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 12:10:31.687355 21919 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.618398 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:31.664006 21818 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:31.553610 24249 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:31.689949 21922 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:31.687953 22582 rpcz_store.cc:276] 0709 12:10:30.552935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.685930 (+1132995us) service_pool.cc:224] Handling call
0709 12:10:31.686250 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.687004 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.687261 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.541354 24470 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:31.445839 21845 rpcz_store.cc:276] 0709 12:10:30.298966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.301874 (+  2908us) service_pool.cc:224] Handling call
0709 12:10:31.333350 (+1031476us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:31.404049 (+ 70699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4734720}
I20260709 12:10:31.695276 21893 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:31.696012 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:31.696264 21852 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:31.725950 21997 raft_consensus.cc:2376] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4. Re-sending same reply.
I20260709 12:10:31.592367 24485 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:31.605190 24174 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:31.632009 24505 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:31.708238 22549 connection.cc:256] RPC call timeout handler was delayed by -2.0453925149997758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 12:10:31.688138 24071 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.619182 24182 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:31.610812 24467 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:31.609719 24463 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:10:31.695880 24137 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:31.727964 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 284674us
W20260709 12:10:31.736086 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.727970 24283 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:31.737032 24530 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:31.737321 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 118227us
I20260709 12:10:31.737555 24533 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:31.749969 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 156076us
W20260709 12:10:31.721954 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 77972.1us
I20260709 12:10:31.756846 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:31.757580 21850 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:31.757659 21852 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:31.669207 24522 consensus_queue.cc:1059] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:31.707957 24502 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:31.766851 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.728693 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:31.688480 24524 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 12:10:31.726461 24171 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:31.772032 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.735801 24485 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:31.734856 24174 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:31.752871 24438 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:31.692344 24516 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:10:31.801530 22000 raft_consensus.cc:2410] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:31.781667 23931 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:31.761556 24505 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:31.800282 22549 connection.cc:256] RPC call timeout handler was delayed by -1.8207545109999046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2767s for a response
I20260709 12:10:31.756695 24182 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:31.802399 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 193077us
I20260709 12:10:31.806716 22579 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:31.768509 24528 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:31.807909 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:31.813952 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 118706us
I20260709 12:10:31.732786 24249 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:31.772526 24137 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:31.760744 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 567) took 1449 ms. Trace:
I20260709 12:10:31.764019 24467 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:31.711726 24424 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:31.839526 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.855309 21964 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:31.810375 24171 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.803969 24283 raft_consensus.cc:697] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:31.837646 21747 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:31.840245 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:31.806354 24445 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:31.821408 24485 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.824823 24174 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.821611 24432 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:31.830844 22575 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:31.847214 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:31.866182 21924 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:31.829767 24513 raft_consensus.cc:3055] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:31.850653 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:31.852068 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:31.852362 24527 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:10:31.852720 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:31.857136 24137 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:31.858865 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:31.873934 21851 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:31.874620 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1721) took 1031 ms. Trace:
I20260709 12:10:31.875581 22583 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:31.859380 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:31.862248 21918 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:31.842935 24528 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.843523 23931 raft_consensus.cc:697] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:31.874940 21851 rpcz_store.cc:276] 0709 12:10:30.843594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.873333 (+1029739us) service_pool.cc:224] Handling call
0709 12:10:31.873719 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.874353 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.874569 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.847594 24517 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:31.867887 24432 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:31.887252 24517 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:31.861104 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 539) took 1055 ms. Trace:
I20260709 12:10:31.868011 24513 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:31.889675 24517 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:31.890070 24513 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:31.891372 24513 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.891075 23931 consensus_queue.cc:237] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:31.888818 22579 rpcz_store.cc:276] 0709 12:10:30.814473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.708228 (+893755us) service_pool.cc:224] Handling call
0709 12:10:31.739111 (+ 30883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.842364 (+103253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.858903 (+ 16539us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.891067 22000 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:31.873971 24509 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:31.895736 22000 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:10:31.896066 22000 pending_rounds.cc:85] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 7
I20260709 12:10:31.896313 22000 pending_rounds.cc:107] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:10:31.896524 22000 raft_consensus.cc:2889] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:31.877249 21747 catalog_manager.cc:5697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 6, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 6 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:31.896756 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1709) took 1132 ms. Trace:
I20260709 12:10:31.897703 22000 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:31.896077 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 575) took 1580 ms. Trace:
I20260709 12:10:31.898993 24424 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:31.899559 24424 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.900157 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55856 (request call id 26) took 1603 ms. Trace:
I20260709 12:10:31.900007 24424 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:31.900799 24470 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:31.902027 24424 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:31.902503 24443 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:31.903059 24443 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.903487 24443 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:31.896080 24509 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:31.889155 24432 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:31.904618 24283 consensus_queue.cc:237] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:31.910291 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1736) took 1756 ms. Trace:
I20260709 12:10:31.897224 21847 rpcz_store.cc:276] 0709 12:10:30.764681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.650489 (+885808us) service_pool.cc:224] Handling call
0709 12:10:31.696724 (+ 46235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.707457 (+ 10733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.707486 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.736983 (+ 29497us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.833586 (+ 96603us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:31.840247 (+  6661us) log.cc:844] Serialized 14 byte log entry
0709 12:10:31.848073 (+  7826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.848165 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.896552 (+ 48387us) raft_consensus.cc:1685] finished
0709 12:10:31.896575 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.896697 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17903,"raft.queue_time_us":20205,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":19590,"thread_start_us":102220,"threads_started":2,"wal-append.queue_time_us":147369}
I20260709 12:10:31.897732 21747 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 6, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 6 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:31.898810 22581 rpcz_store.cc:276] 0709 12:10:30.316073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.754806 (+438733us) service_pool.cc:224] Handling call
0709 12:10:30.815982 (+ 61176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.829177 (+ 13195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.829224 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.847295 (+ 18071us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.617869 (+770574us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:31.617920 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.617988 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.895890 (+277902us) raft_consensus.cc:1685] finished
0709 12:10:31.895909 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.896024 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":579,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5216,"thread_start_us":655834,"threads_started":1,"wal-append.queue_time_us":763135}
I20260709 12:10:31.921403 21919 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:31.860610 24171 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.864243 21845 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:31.922276 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 117090us
I20260709 12:10:31.910836 21925 rpcz_store.cc:276] 0709 12:10:30.154345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.276435 (+122090us) service_pool.cc:224] Handling call
0709 12:10:30.286556 (+ 10121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.295270 (+  8714us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:30.434120 (+138850us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.503547 (+ 69427us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.516422 (+ 12875us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.516562 (+   140us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:30.516594 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.516657 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.364268 (+847611us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b18003637c0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be8c6f58f 00007f3be1cae571 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd
0709 12:10:31.407748 (+ 43480us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b18003637c0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:31.905371 (+497623us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b18003637c0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:31.910021 (+  4650us) raft_consensus.cc:1685] finished
0709 12:10:31.910051 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.910218 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12511,"prepare.queue_time_us":210705,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":6818,"raft.queue_time_us":6060,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":18140,"spinlock_wait_cycles":25423744,"thread_start_us":175339,"threads_started":2,"wal-append.queue_time_us":77806}
W20260709 12:10:31.942051 22547 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.012s (SENT) [suppressed 20 similar messages]
I20260709 12:10:31.942800 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:31.943652 22579 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:10:31.934870 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 94705.4us
W20260709 12:10:31.944067 22549 connection.cc:256] RPC call timeout handler was delayed by -1.2389925149998362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2819s for a response
W20260709 12:10:31.944852 22549 connection.cc:256] RPC call timeout handler was delayed by -1.2281871309999133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 12:10:31.945200 22549 connection.cc:256] RPC call timeout handler was delayed by -1.2281871309999133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 12:10:31.945531 22549 connection.cc:256] RPC call timeout handler was delayed by -1.2101871309998842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 12:10:31.945868 22549 connection.cc:256] RPC call timeout handler was delayed by -1.2101871309998842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 12:10:31.945755 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 90574us
W20260709 12:10:31.924440 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.938083 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:31.871142 24474 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:31.947489 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 174053us
I20260709 12:10:31.907869 24442 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:31.950577 21967 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:31.951429 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:31.957149 21892 connection.cc:256] RPC call timeout handler was delayed by -2.6641036529997564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
I20260709 12:10:31.947065 21747 catalog_manager.cc:5697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:10:31.948681 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:31.908907 24528 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.963917 21747 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 6, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 6 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:31.946313 22549 connection.cc:256] RPC call timeout handler was delayed by -1.1669871309998143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 12:10:31.959908 21848 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:31.966665 22549 connection.cc:256] RPC call timeout handler was delayed by -1.0382871309998336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 12:10:31.967022 22549 connection.cc:256] RPC call timeout handler was delayed by -1.0292871309998191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 12:10:31.967346 22549 connection.cc:256] RPC call timeout handler was delayed by -1.0292871309998191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 12:10:31.900597 21843 rpcz_store.cc:276] 0709 12:10:30.297050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.297192 (+   142us) service_pool.cc:224] Handling call
0709 12:10:31.899929 (+1602737us) spinlock_profiling.cc:243] Waited 9.26 ms on lock 0x7b4c001c7e00. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3067a20 00007f3be3078a29 00007f3be303e644 00007f3be3065f2d 00007f3be3065b93 00007f3be4d95c92 00007f3be4d9584a 00007f3be9d6360a 00007f3be32e97d4 00007f3be32e9762 00007f3be32e9691
0709 12:10:31.900073 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21304576}
I20260709 12:10:31.968313 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:31.968641 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:31.969456 21843 raft_consensus.cc:2368] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:31.969620 24475 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:31.970484 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:31.965468 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:31.971547 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:31.972137 21922 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.968933 21747 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 5 to 6, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 6 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:31.944641 24445 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:31.963374 24424 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.973019 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:31.972002 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:31.967670 22549 connection.cc:256] RPC call timeout handler was delayed by -1.0283871309998176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
I20260709 12:10:31.949710 24462 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.984212 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:31.991948 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:31.939430 24534 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:31.990370 22549 connection.cc:256] RPC call timeout handler was delayed by -1.0283871309998176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 12:10:31.993825 22549 connection.cc:256] RPC call timeout handler was delayed by -1.0058871309997812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 12:10:31.995028 22000 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:31.970119 24475 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:31.970713 24474 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.947351 24438 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.004139 21747 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 7, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 7 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:31.995520 21843 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.219511 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.218992 21747 catalog_manager.cc:5697] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 5, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.220270 21993 raft_consensus.cc:2368] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:32.220708 24534 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:32.221122 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:32.051590 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 91859.7us
I20260709 12:10:32.063683 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 723) took 1509 ms. Trace:
I20260709 12:10:31.989923 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1719) took 1149 ms. Trace:
I20260709 12:10:32.005518 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:32.076313 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:32.106730 21850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1706) took 1344 ms (client timeout 1621 ms). Trace:
I20260709 12:10:32.051486 24442 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:32.222061 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:31.992069 24424 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.181602 24071 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:32.243800 24442 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:32.245023 24471 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:32.054030 24492 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:32.053133 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:32.176563 24475 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:32.221983 21993 raft_consensus.cc:2410] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:10:32.225553 21926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1747) took 1715 ms (client timeout 1832 ms). Trace:
I20260709 12:10:32.206534 24445 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:32.172989 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 208959us
W20260709 12:10:32.249467 21926 rpcz_store.cc:269] 0709 12:10:30.509643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.519923 (+ 10280us) service_pool.cc:224] Handling call
0709 12:10:32.225390 (+1705467us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540013b0d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:32.225494 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316533504}
I20260709 12:10:32.088416 24551 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:32.227298 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.227734 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.253376 21998 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:31.996740 24462 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.005218 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:32.228780 24467 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:32.220840 21747 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 5, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 5 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:10:32.052615 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 102607us
W20260709 12:10:32.175009 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 185338us
W20260709 12:10:32.255656 21892 connection.cc:256] RPC call timeout handler was delayed by -2.4913036529999317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 12:10:32.222148 22578 rpcz_store.cc:276] 0709 12:10:30.526449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.314743 (+788294us) service_pool.cc:224] Handling call
0709 12:10:31.378841 (+ 64098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.379147 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:31.694083 (+314936us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.035627 (+341544us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.035702 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:32.035914 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.036007 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.036196 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":458941,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4310,"raft.queue_time_us":149568,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10990,"thread_start_us":635782,"threads_started":3,"wal-append.queue_time_us":127005}
I20260709 12:10:32.256012 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:32.255941 21747 catalog_manager.cc:5697] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:32.255982 21892 connection.cc:256] RPC call timeout handler was delayed by -2.3880570540000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 12:10:32.260409 21747 catalog_manager.cc:5697] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 5, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:32.261444 21892 connection.cc:256] RPC call timeout handler was delayed by -2.2510036529997706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 12:10:32.261777 21892 connection.cc:256] RPC call timeout handler was delayed by -2.1558570539998527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:10:32.262006 21892 connection.cc:256] RPC call timeout handler was delayed by -2.1243570540000292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 12:10:32.262223 21892 connection.cc:256] RPC call timeout handler was delayed by -2.0901570539999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 12:10:32.262449 21892 connection.cc:256] RPC call timeout handler was delayed by -2.0226570539998647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
W20260709 12:10:32.262753 21892 connection.cc:256] RPC call timeout handler was delayed by -1.4788036529998863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30910000000000004s for a response
W20260709 12:10:32.262965 21892 connection.cc:256] RPC call timeout handler was delayed by -1.4520570539998516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25579999999999997s for a response
W20260709 12:10:32.263245 21892 connection.cc:256] RPC call timeout handler was delayed by -1.09732077700005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 12:10:32.103852 24553 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.233239 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 228077us
I20260709 12:10:32.235510 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:32.234292 21850 rpcz_store.cc:269] 0709 12:10:30.762636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.828441 (+ 65805us) service_pool.cc:224] Handling call
0709 12:10:32.106447 (+1278006us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400341cd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:32.106648 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116546944}
I20260709 12:10:32.236747 21999 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:32.054687 24443 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:32.234025 21845 rpcz_store.cc:276] 0709 12:10:30.834611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.803653 (+969042us) service_pool.cc:224] Handling call
0709 12:10:31.847823 (+ 44170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.961647 (+113824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.983700 (+ 22053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:31.849634 22577 rpcz_store.cc:276] 0709 12:10:30.289496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.380856 (+ 91360us) service_pool.cc:224] Handling call
0709 12:10:30.381184 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.381606 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:30.381972 (+   366us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.399524 (+ 17552us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b18002b3600. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:30.504868 (+105344us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.617361 (+112493us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.642749 (+ 25388us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:30.670370 (+ 27621us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.702125 (+ 31755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.713617 (+ 11492us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.721708 (+1008091us) raft_consensus.cc:1685] finished
0709 12:10:31.724481 (+  2773us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.738441 (+ 13960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19046,"prepare.queue_time_us":4647,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":82,"raft.queue_time_us":8256,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":42253,"spinlock_wait_cycles":62976896,"thread_start_us":120605,"threads_started":1,"wal-append.queue_time_us":278968}
I20260709 12:10:32.242115 21922 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:32.242652 21843 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:10:32.077531 22579 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:32.251452 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.285904 21926 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:32.286655 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.287111 21926 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:32.276903 21747 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 5, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.287751 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:32.288338 21926 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:32.254204 21848 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.263684 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:32.270485 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.268577 22000 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:32.245792 24071 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:32.281503 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:32.281931 21847 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.256878 24551 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.291527 24551 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.253441 24249 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:32.288822 21747 catalog_manager.cc:5697] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 2, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.300464 21747 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 5, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.302973 21747 catalog_manager.cc:5697] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 4, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 4 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:10:32.305107 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 1995) took 2179 ms. Trace:
I20260709 12:10:32.255153 24508 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.288949 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.282820 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.306559 21996 rpcz_store.cc:276] 0709 12:10:30.101394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.101528 (+   134us) service_pool.cc:224] Handling call
0709 12:10:30.101852 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.251108 (+149256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.280403 (+2029295us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002b75d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:32.280608 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289737600}
I20260709 12:10:32.315629 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:32.321568 21998 raft_consensus.cc:2410] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:32.322863 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.323740 21922 raft_consensus.cc:2410] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:32.324564 21747 catalog_manager.cc:5697] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:10:32.325766 21926 raft_consensus.cc:2376] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4. Re-sending same reply.
W20260709 12:10:32.326779 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 307189us
I20260709 12:10:32.326869 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:32.332088 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.284699 24459 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:32.363147 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.364684 21926 raft_consensus.cc:2410] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:32.375326 21747 catalog_manager.cc:5697] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 5, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 5 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:10:32.376403 24565 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:32.377710 21747 catalog_manager.cc:5697] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.380160 21747 catalog_manager.cc:5697] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.381999 21848 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:32.334268 24475 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.389508 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:32.391492 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:32.391590 21922 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.385004 21747 catalog_manager.cc:5697] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.395045 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.397197 22578 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:32.399937 22581 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.362185 24459 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:32.411295 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.411734 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:32.362526 24545 consensus_queue.cc:1059] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:32.394037 24424 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:32.279776 24553 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:32.413828 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 157200us
I20260709 12:10:32.395463 21747 catalog_manager.cc:5697] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 3, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 3 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:32.399848 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:32.438647 21922 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:32.406798 24471 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:32.443837 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:32.444211 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.362320 24508 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:32.447433 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.405648 24559 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:32.448117 21926 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:32.419832 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:32.450711 24547 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:32.452147 24556 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 12:10:32.454530 24552 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 12:10:32.455206 24462 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:32.455446 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.456238 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.456686 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.456871 21996 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:32.457707 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.458977 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.459697 21993 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:32.459771 24174 consensus_meta.cc:287] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.000s
I20260709 12:10:32.460063 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.460474 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.460244 24174 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:32.458334 21996 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:32.461150 21993 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:32.461649 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:32.461802 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:32.460644 22000 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:32.463802 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.464725 21926 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:32.465870 21922 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.463797 21993 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:32.463044 24174 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:32.473459 21843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
W20260709 12:10:32.468509 24452 consensus_meta.cc:287] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.857s	user 0.006s	sys 0.014s
W20260709 12:10:32.755769 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 499775us
I20260709 12:10:32.554996 21922 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
W20260709 12:10:32.765748 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.756366 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:32.480160 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 711) took 3972 ms. Trace:
I20260709 12:10:32.768162 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:32.768883 22579 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:32.717586 21920 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.496142 22578 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:32.481798 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 580) took 1953 ms. Trace:
I20260709 12:10:32.474774 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:32.498263 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.474539 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:32.774097 22581 raft_consensus.cc:2410] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:32.723960 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.777487 21993 raft_consensus.cc:2368] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:32.767189 22576 rpcz_store.cc:276] 0709 12:10:28.507774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.512975 (+  5201us) service_pool.cc:224] Handling call
0709 12:10:28.647045 (+134070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.964249 (+317204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.973151 (+  8902us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.039658 (+ 66507us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.284388 (+244730us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:32.274269 (+2989881us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b180036dfc0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cab455 00007f3be87933c7 00007f3be4da59a7 00007f3be4db50bf 00007f3be4db5038
0709 12:10:32.351843 (+ 77574us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.446310 (+ 94467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.449600 (+  3290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.463017 (+ 13417us) raft_consensus.cc:1685] finished
0709 12:10:32.479896 (+ 16879us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.480084 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":843890,"prepare.queue_time_us":884468,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":4138,"raft.queue_time_us":207444,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":10476,"spinlock_wait_cycles":9044864,"thread_start_us":580583,"threads_started":4,"wal-append.queue_time_us":358952,"wal-append.run_cpu_time_us":2056,"wal-append.run_wall_time_us":1002087}
I20260709 12:10:32.771174 22584 rpcz_store.cc:276] 0709 12:10:30.527956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.334245 (+806289us) service_pool.cc:224] Handling call
0709 12:10:31.334744 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:31.335214 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.335254 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:31.357916 (+ 22662us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.922815 (+564899us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b18002e1260. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:10:31.993130 (+ 70315us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:31.993189 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.993286 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.462486 (+469200us) raft_consensus.cc:1685] finished
0709 12:10:32.462505 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.481715 (+ 19210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":769,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":14578,"spinlock_wait_cycles":3630464,"thread_start_us":70076,"threads_started":1,"wal-append.queue_time_us":833679}
I20260709 12:10:32.785298 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:32.786156 21997 raft_consensus.cc:2410] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:10:32.787873 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 396453us
I20260709 12:10:32.791168 22549 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:32.792434 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:32.593434 24513 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.001s
W20260709 12:10:32.728556 24528 consensus_meta.cc:287] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.737s	user 0.016s	sys 0.016s
I20260709 12:10:32.802353 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.469657 24559 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:32.805778 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:32.809055 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.787731 24544 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.796327 24541 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.801174 24549 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.802485 24508 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:32.467223 24459 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.835237 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:32.807746 24424 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:32.835904 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.796058 24522 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:32.817091 24426 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.838905 21926 raft_consensus.cc:2410] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:32.801717 24563 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:10:32.839112 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.843374 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 213082us
I20260709 12:10:32.811257 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:32.541342 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:32.540550 24471 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:32.850570 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1955) took 1001 ms. Trace:
I20260709 12:10:32.857438 21922 rpcz_store.cc:276] 0709 12:10:31.848779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.836726 (+987947us) service_pool.cc:224] Handling call
0709 12:10:32.850059 (+ 13333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.850238 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.850267 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.850305 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:32.850341 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.850391 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.850518 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.805199 24528 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.847996 24549 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.843380 24424 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:32.607824 24551 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.885958 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.889638 24548 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.889957 24578 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.890270 24548 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.890470 24578 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.882258 24547 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:32.891883 24547 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.892757 24548 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:32.893285 24572 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:10:32.892784 24578 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:32.890491 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:32.894840 21993 raft_consensus.cc:2393] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:32.895650 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:32.896153 21993 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.879913 24452 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.881757 24424 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.899179 24452 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:32.901827 24452 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:32.904058 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:32.904867 21848 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:32.904458 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:32.905331 21845 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.910498 24569 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
W20260709 12:10:32.911732 24520 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 1.519s	user 0.002s	sys 0.001s
I20260709 12:10:32.912714 24559 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.918470 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 724) took 2376 ms. Trace:
I20260709 12:10:32.918919 22583 rpcz_store.cc:276] 0709 12:10:30.541938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.671837 (+1129899us) service_pool.cc:224] Handling call
0709 12:10:31.706873 (+ 35036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.876046 (+169173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.918223 (+1042177us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400480154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:32.918384 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387230080}
I20260709 12:10:32.928323 24424 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.930568 21994 raft_consensus.cc:2410] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:32.931049 21993 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:32.932292 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:32.933770 24485 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.059s	user 0.014s	sys 0.009s
W20260709 12:10:32.894222 24576 log.cc:927] Time spent T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:32.838263 24541 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:32.885785 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.978319 24505 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:32.937165 24502 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.127s	user 0.005s	sys 0.006s
I20260709 12:10:32.859565 22577 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:32.951045 24062 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:32.952476 24475 consensus_meta.cc:287] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.001s
I20260709 12:10:32.960171 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1605) took 1006 ms. Trace:
I20260709 12:10:32.991308 24485 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.994727 21850 rpcz_store.cc:276] 0709 12:10:31.953905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.268642 (+314737us) service_pool.cc:224] Handling call
0709 12:10:32.284889 (+ 16247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.309271 (+ 24382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.309313 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:32.352381 (+ 43068us) log.cc:844] Serialized 26 byte log entry
0709 12:10:32.602784 (+250403us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:32.602826 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.602899 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.959928 (+357029us) raft_consensus.cc:1685] finished
0709 12:10:32.959955 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.960098 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24600,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":20391,"thread_start_us":198224,"threads_started":1,"wal-append.queue_time_us":564040}
I20260709 12:10:32.996191 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:32.996670 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:32.997457 22579 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:32.997692 21998 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.960817 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:32.963182 24551 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:32.879014 24478 consensus_meta.cc:287] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.210s	user 0.001s	sys 0.017s
I20260709 12:10:32.967568 21847 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:33.003073 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1607) took 1048 ms. Trace:
I20260709 12:10:32.974421 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1717) took 2141 ms. Trace:
I20260709 12:10:32.976248 21924 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:10:32.982383 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 176807us
I20260709 12:10:32.982906 21844 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:32.983980 21815 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:33.003509 21847 rpcz_store.cc:276] 0709 12:10:31.954611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.966621 (+1012010us) service_pool.cc:224] Handling call
0709 12:10:32.967177 (+   556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.002817 (+ 35640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.003015 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.985898 21922 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.987170 21817 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:33.003659 21852 rpcz_store.cc:276] 0709 12:10:30.833101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.797550 (+964449us) service_pool.cc:224] Handling call
0709 12:10:31.823705 (+ 26155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.889785 (+ 66080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.889823 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:31.889863 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:31.889907 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.974060 (+1084153us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b540021cd54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:32.974134 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.974321 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151479040}
I20260709 12:10:32.989634 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:32.984742 24171 consensus_meta.cc:287] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.024s	user 0.006s	sys 0.005s
I20260709 12:10:33.005317 21817 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:32.838027 24544 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:32.990736 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:32.991291 21999 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:33.006458 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:32.992918 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:33.007056 22583 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:32.997879 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:32.994333 22584 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.987972 24224 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.986272 24553 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:32.972406 21995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 1997) took 2840 ms (client timeout 1923 ms). Trace:
W20260709 12:10:33.030369 21995 rpcz_store.cc:269] 0709 12:10:30.131818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.139080 (+  7262us) service_pool.cc:224] Handling call
0709 12:10:32.972050 (+2832970us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000d2854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:32.972250 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3176124800}
I20260709 12:10:33.008306 24171 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.031265 24224 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.031836 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:33.001930 24549 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:33.005139 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1958) took 1155 ms. Trace:
I20260709 12:10:33.034607 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:33.034837 21922 rpcz_store.cc:276] 0709 12:10:31.849980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.883940 (+1033960us) service_pool.cc:224] Handling call
0709 12:10:32.985723 (+101783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.004818 (+ 19095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.005086 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:33.006213 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1959) took 1156 ms. Trace:
I20260709 12:10:33.035702 21924 rpcz_store.cc:276] 0709 12:10:31.850264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.975475 (+1125211us) service_pool.cc:224] Handling call
0709 12:10:32.975936 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.005932 (+ 29996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.006146 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.983590 24277 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.010689 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:32.997465 24485 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:33.006201 22547 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:33.032498 21851 raft_consensus.cc:2368] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:32.984074 21845 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:33.033268 22549 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:33.033443 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49525.7us
I20260709 12:10:33.034453 21995 raft_consensus.cc:2410] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:33.035234 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:33.037786 22583 raft_consensus.cc:2410] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:33.037889 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:33.036921 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:33.039441 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:33.040340 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:33.009107 24522 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.039916 21999 raft_consensus.cc:2410] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:33.041599 22578 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:33.036726 24277 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.044871 24563 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.045373 24563 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:33.045513 24424 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:33.046335 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:33.046746 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:33.046897 21918 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:33.047676 22000 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:33.043813 21815 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:33.049516 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:33.050313 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:32.998704 24502 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.051604 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:33.003327 24478 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.035727 24283 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.046875 24474 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.053934 24513 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.052723 24508 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.036962 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:33.063500 22549 leader_election.cc:336] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.581s (SENT)
I20260709 12:10:33.063896 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:33.051827 24544 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:33.055061 24424 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.057356 21843 raft_consensus.cc:606] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:33.074860 21843 raft_consensus.cc:614] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:33.052762 24431 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:33.052944 24277 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:33.041844 24553 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.036913 24482 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.042840 24549 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:33.061684 24474 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:33.056232 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:33.051047 24475 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.046278 24563 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.062249 22577 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.060652 24513 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:33.090512 24513 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:33.091162 24581 log.cc:927] Time spent T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:33.074795 24424 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.136814 21966 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:33.169507 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 255556us
I20260709 12:10:33.163132 24424 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:33.184036 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 177900us
I20260709 12:10:33.177706 24547 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.165243 24277 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:33.165822 24485 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:33.240967 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 189398us
I20260709 12:10:33.242121 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:33.178659 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 402820us
W20260709 12:10:33.248639 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.237942 24522 raft_consensus.cc:697] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:33.250633 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 113897us
I20260709 12:10:33.169458 24580 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:33.178457 24171 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:33.278694 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:33.264638 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:33.265978 21849 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:33.260672 24485 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.267105 21847 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:10:33.268980 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.270323 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 96050.4us
I20260709 12:10:33.273222 21966 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:33.281615 21849 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:33.284865 21966 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:33.274273 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.275323 21852 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:33.276098 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:33.313818 21850 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:33.358084 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.286183 21966 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:33.276445 21964 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:33.576432 22549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.048s	sys 0.110s
W20260709 12:10:33.576849 22549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.048s	sys 0.110s
W20260709 12:10:33.577453 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 293841us
W20260709 12:10:33.577334 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 513815us
I20260709 12:10:33.267591 24478 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:33.269409 24431 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.273995 24283 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.642963 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1957) took 1793 ms. Trace:
I20260709 12:10:33.641433 21849 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:33.673619 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 95211.4us
I20260709 12:10:33.677649 21849 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.263386 24277 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.680357 21926 rpcz_store.cc:276] 0709 12:10:31.849254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.855459 (+1006205us) service_pool.cc:224] Handling call
0709 12:10:32.872317 (+ 16858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.872574 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:33.169841 (+297267us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.582319 (+412478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.642528 (+ 60209us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:33.642615 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.642715 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.642885 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":397011,"prepare.run_wall_time_us":50,"raft.queue_time_us":356457,"thread_start_us":399660,"threads_started":2}
I20260709 12:10:33.585374 24438 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.661877 24442 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:33.685007 24583 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.630s	user 0.001s	sys 0.000s
I20260709 12:10:33.694114 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:33.704632 21848 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:33.674938 24171 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:33.702703 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 426331us
I20260709 12:10:33.707844 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:33.703302 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.644548 24362 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:33.264488 24549 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.287388 24580 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:33.717907 24493 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 3.320s	user 0.009s	sys 0.013s
I20260709 12:10:33.695014 24597 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:33.728917 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.728156 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:33.694787 24438 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:33.736004 24438 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.736021 21848 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.695964 24502 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:33.706349 24445 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.692214 24551 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:10:33.688606 24283 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.715765 24588 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.733134 24547 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:33.744135 24589 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:10:33.715664 24171 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:33.769112 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 190189us
I20260709 12:10:33.768697 21892 leader_election.cc:400] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:33.772327 21892 leader_election.cc:403] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.754225 24588 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.774895 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 572) took 3482 ms. Trace:
I20260709 12:10:33.776769 22580 rpcz_store.cc:276] 0709 12:10:30.292567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.515787 (+2223220us) service_pool.cc:224] Handling call
0709 12:10:32.597163 (+ 81376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.601248 (+  4085us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:32.718682 (+117434us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.250719 (+532037us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.774505 (+523786us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.774558 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:33.774610 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.774677 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.774814 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519944,"prepare.queue_time_us":101260,"prepare.run_cpu_time_us":1168,"prepare.run_wall_time_us":3881,"thread_start_us":448444,"threads_started":2,"wal-append.queue_time_us":987024}
I20260709 12:10:33.710976 24522 consensus_queue.cc:237] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:33.772015 24513 consensus_meta.cc:287] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.001s
I20260709 12:10:33.783877 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:33.791400 21848 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:33.794047 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2000) took 3648 ms. Trace:
I20260709 12:10:33.795367 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:33.796226 21848 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:33.795344 21992 rpcz_store.cc:276] 0709 12:10:30.145255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.145450 (+   195us) service_pool.cc:224] Handling call
0709 12:10:30.168929 (+ 23479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.214173 (+ 45244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.214216 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.226695 (+ 12479us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.288362 (+ 61667us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:30.288403 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.288731 (+   328us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.696386 (+3407655us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:33.779180 (+ 82794us) raft_consensus.cc:1685] finished
0709 12:10:33.779202 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.793954 (+ 14752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4652,"raft.queue_time_us":75532,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":10251,"spinlock_wait_cycles":29346688,"thread_start_us":61295,"threads_started":1,"wal-append.queue_time_us":91885}
I20260709 12:10:33.801239 24513 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:33.802619 24599 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:10:33.803692 24596 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:33.805378 24513 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:33.805663 24528 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:33.778268 24553 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.806788 24381 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:33.807237 24381 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.807634 24277 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:33.807535 24505 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:33.808244 24277 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:33.792165 24563 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.739611 24597 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.755726 24445 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.815042 24504 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:33.842725 24504 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:33.779165 24588 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.824826 24513 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:33.843410 24513 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.843549 24504 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.844753 24504 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.845477 24513 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:33.812373 24528 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:33.825745 24424 consensus_meta.cc:287] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.000s
I20260709 12:10:33.846288 24528 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:33.846356 24424 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:33.846961 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.847273 24528 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.848685 24424 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:33.826963 24531 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:33.849824 24531 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:33.828517 24062 consensus_meta.cc:287] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.829s	user 0.010s	sys 0.000s
W20260709 12:10:33.850605 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.824571 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:33.837752 24381 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.839937 24597 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:33.841372 21992 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:33.841871 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:33.845654 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:33.830065 24182 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:33.852492 22577 consensus_meta.cc:287] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.684s	user 0.006s	sys 0.002s
W20260709 12:10:33.862816 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 108189us
I20260709 12:10:33.862864 22577 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:33.863299 22001 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:33.865068 22001 pending_rounds.cc:85] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 2
I20260709 12:10:33.865334 22001 pending_rounds.cc:107] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:33.865604 22001 raft_consensus.cc:2889] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.867877 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:33.868788 21846 raft_consensus.cc:2410] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:33.869143 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:33.869942 21848 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:33.870762 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:33.871876 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:33.872516 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:33.873339 21847 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:33.874684 24277 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.874938 21992 raft_consensus.cc:1217] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Deduplicated request from leader. Original: 3.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 12:10:33.875519 21992 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:33.876353 22580 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:33.877455 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:33.878252 21847 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:33.859403 24505 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.884079 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:33.875248 24277 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:33.888309 21849 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:33.889396 21992 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:33.909614 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:33.912555 21846 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.912801 21847 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:33.872181 24182 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:33.890080 24485 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:33.930158 24171 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:33.930577 24381 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:33.882805 24505 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.937258 24505 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:33.937857 24609 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:10:33.938495 24585 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:33.938771 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 652622us
I20260709 12:10:33.939018 24585 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.939803 21966 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:33.940757 24485 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.942167 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:33.942668 24277 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:33.945268 24438 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.868784 24531 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:33.946810 24531 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.948308 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:33.948925 22580 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:33.949174 21966 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:33.951195 24580 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:33.928946 24606 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.127s	user 0.000s	sys 0.003s
I20260709 12:10:33.953296 24445 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:33.954496 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:33.960287 24508 consensus_meta.cc:287] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.891s	user 0.010s	sys 0.000s
I20260709 12:10:33.961943 21846 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:33.962038 21926 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:33.963850 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:33.987917 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1960) took 2137 ms. Trace:
W20260709 12:10:34.004570 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 120197us
I20260709 12:10:34.004868 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:33.976720 24508 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:34.016883 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 53147.9us
I20260709 12:10:33.994880 21922 rpcz_store.cc:276] 0709 12:10:31.850565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.052042 (+1201477us) service_pool.cc:224] Handling call
0709 12:10:33.058916 (+  6874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.059114 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:33.243638 (+184524us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.987588 (+743950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.987639 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:33.987681 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.987743 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.987862 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1419,"prepare.queue_time_us":715627,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":32733,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8792,"thread_start_us":926032,"threads_started":3,"wal-append.queue_time_us":611550}
I20260709 12:10:33.986479 24615 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.982035 24588 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:34.020087 24580 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.020038 24504 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.033962 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.039709 21992 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:34.020491 24471 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:34.089310 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:34.094659 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.028368 24062 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:10:34.027376 24612 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:10:34.079080 24090 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.025345 24528 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:10:34.104266 24508 raft_consensus.cc:1064] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:10:34.093461 24504 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:34.106726 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.107439 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.107573 24504 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:34.109480 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:34.110302 21926 raft_consensus.cc:2376] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7. Re-sending same reply.
I20260709 12:10:34.123636 24438 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:34.126044 24588 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:34.130667 24610 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:34.095043 24471 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.131594 24610 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:34.133315 24182 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:34.133857 24621 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:34.130626 24505 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.092694 24580 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:34.135749 24505 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.136849 24580 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.133356 24622 consensus_queue.cc:1059] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:34.140040 24611 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:34.141058 24622 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:34.140697 24611 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.141554 24622 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:34.146169 24090 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:34.142719 24622 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:34.150669 24622 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.133390 21992 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:34.152557 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:34.163228 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:34.164467 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:34.166731 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:34.167372 21926 raft_consensus.cc:2376] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5. Re-sending same reply.
I20260709 12:10:34.165668 24182 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.169404 24621 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.170771 24471 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:34.171777 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1517) took 1818 ms. Trace:
I20260709 12:10:34.172058 21998 rpcz_store.cc:276] 0709 12:10:32.353354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.353624 (+   270us) service_pool.cc:224] Handling call
0709 12:10:32.378816 (+ 25192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.999349 (+620533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.171592 (+1172243us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54002dfad4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:34.171730 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422821248}
I20260709 12:10:34.163309 24277 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.175861 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:34.177521 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.178045 24611 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:34.179591 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:34.179566 21924 raft_consensus.cc:2376] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6. Re-sending same reply.
I20260709 12:10:34.182782 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:34.183914 21924 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.182015 24600 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.185446 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.182091 24586 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.189087 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.244583 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55856 (request call id 27) took 1776 ms. Trace:
I20260709 12:10:34.216732 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:34.246268 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:34.245415 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:34.406390 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 241988us
W20260709 12:10:34.307925 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.285910 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.408058 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.409730 21926 raft_consensus.cc:2410] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:34.414963 21924 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:34.415886 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1971) took 1119 ms. Trace:
I20260709 12:10:34.416352 21924 rpcz_store.cc:276] 0709 12:10:33.296834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.182520 (+885686us) service_pool.cc:224] Handling call
0709 12:10:34.415809 (+233289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.417734 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:34.423254 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1764) took 1176 ms. Trace:
I20260709 12:10:34.468485 21924 rpcz_store.cc:276] 0709 12:10:33.246794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.417406 (+1170612us) service_pool.cc:224] Handling call
0709 12:10:34.423159 (+  5753us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.526473 21994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1502) took 2755 ms (client timeout 1966 ms). Trace:
I20260709 12:10:34.527730 21998 raft_consensus.cc:2368] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:34.526523 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1954) took 2482 ms. Trace:
I20260709 12:10:34.528620 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:34.529592 21845 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:34.530694 21846 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:34.533665 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:34.534633 21849 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 3: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:34.405069 21843 rpcz_store.cc:276] 0709 12:10:32.468103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.468259 (+   156us) service_pool.cc:224] Handling call
0709 12:10:34.244394 (+1776135us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54000bf9d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d95853 00007f3be9d6360a 00007f3be32e97d4 00007f3be32e9762 00007f3be32e9691 00007f3be32e960c 00007f3be32e88c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:34.244507 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693197056}
W20260709 12:10:34.526975 21994 rpcz_store.cc:269] 0709 12:10:31.770939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.771071 (+   132us) service_pool.cc:224] Handling call
0709 12:10:34.328995 (+2557924us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400220e54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:34.526364 (+197369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500005632}
I20260709 12:10:34.528664 21920 rpcz_store.cc:276] 0709 12:10:31.848506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.848616 (+   110us) service_pool.cc:224] Handling call
0709 12:10:31.848890 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.770379 (+921489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.330547 (+1560168us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54003e62d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:34.330804 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997150080}
W20260709 12:10:34.537792 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 130418us
I20260709 12:10:34.540253 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:34.540481 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 294274us
I20260709 12:10:34.540941 21847 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
W20260709 12:10:34.541359 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.542083 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.542801 21993 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:34.543004 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:34.543810 21924 raft_consensus.cc:2410] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:34.543690 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.182858 24443 raft_consensus.cc:3055] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.538638 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:34.548349 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:34.549072 22580 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:34.550710 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:34.551138 21924 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.551162 22577 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:34.551970 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 336) took 2281 ms. Trace:
I20260709 12:10:34.552269 21924 rpcz_store.cc:276] 0709 12:10:32.270808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.550679 (+2279871us) service_pool.cc:224] Handling call
0709 12:10:34.550964 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.551775 (+   811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.551929 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.555457 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:34.536346 24587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.008s	sys 0.017s
I20260709 12:10:34.558456 21892 leader_election.cc:400] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:34.252816 24471 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:34.223501 24610 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:34.561121 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:34.561251 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.561563 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:34.562192 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.562124 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.572141 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.300266 24622 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:34.557415 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:34.579526 21850 raft_consensus.cc:2393] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:34.526777 24228 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:34.562784 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:34.584271 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:34.584890 24610 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.547959 24443 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:34.587110 24443 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:34.588209 24443 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.581176 24471 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.573472 24612 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:34.590818 24612 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:34.591209 22578 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEARNER]: Advancing to term 6
I20260709 12:10:34.591971 24471 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:34.188347 24600 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:34.575271 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.577739 21993 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:34.549592 24623 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.568744 24182 raft_consensus.cc:2764] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:34.544834 24171 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:34.545078 24559 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:34.572805 22000 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:34.614928 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:34.622750 22580 raft_consensus.cc:2393] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:34.579748 21998 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:34.586078 22579 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:34.617250 21920 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:34.571400 24587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.009s	sys 0.018s
I20260709 12:10:34.586130 24622 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.610960 24090 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:34.633427 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:34.636224 22580 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:34.599629 24440 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:34.628165 22578 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:34.629276 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.633087 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.639529 24622 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:34.634881 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.189460 24508 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.648509 22000 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:34.653198 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.611124 24228 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.662990 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:34.663837 22580 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:34.664988 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.626592 24171 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:34.676885 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.677693 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.629197 24559 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:34.679960 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.680815 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.655149 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:34.685994 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.687942 21994 raft_consensus.cc:2410] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:34.662533 22575 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:34.691864 24513 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.694448 24553 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:34.697608 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.711422 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.712229 21994 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:34.718112 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.678870 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:34.698848 24090 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.723306 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.727547 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:34.728358 21849 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.707013 22576 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.707798 24553 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.731042 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.732121 21967 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:34.732368 22000 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:34.188792 24586 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.735541 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.737144 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:34.734951 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 199343us
I20260709 12:10:34.737717 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.739074 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:34.739472 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.740600 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.741736 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:34.741750 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.743764 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:34.744344 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.745185 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 337) took 2474 ms. Trace:
I20260709 12:10:34.745369 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.746444 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.747414 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.745636 21924 rpcz_store.cc:276] 0709 12:10:32.271089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.552832 (+2281743us) service_pool.cc:224] Handling call
0709 12:10:34.553119 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.557539 (+  4420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.557568 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.570685 (+ 13117us) log.cc:844] Serialized 26 byte log entry
0709 12:10:34.744899 (+174214us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:34.744935 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.744994 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.745033 (+    39us) raft_consensus.cc:1685] finished
0709 12:10:34.745043 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.745139 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4097,"raft.queue_time_us":28284,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":143,"thread_start_us":116296,"threads_started":1,"wal-append.queue_time_us":123838}
I20260709 12:10:34.748459 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.748657 21924 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:34.749244 22000 raft_consensus.cc:2410] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:34.749311 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1761) took 2304 ms. Trace:
I20260709 12:10:34.749920 21924 rpcz_store.cc:276] 0709 12:10:32.445398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.748233 (+2302835us) service_pool.cc:224] Handling call
0709 12:10:34.748501 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.749091 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.749252 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.750278 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.751284 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.751528 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1969) took 1833 ms. Trace:
I20260709 12:10:34.751515 24623 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:34.752554 22000 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.752578 21924 rpcz_store.cc:276] 0709 12:10:32.918273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.750792 (+1832519us) service_pool.cc:224] Handling call
0709 12:10:34.751044 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.751210 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.751235 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.751273 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:34.751326 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.751377 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.751483 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.752837 24623 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.756032 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:34.756258 21921 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.756839 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1760) took 2314 ms. Trace:
I20260709 12:10:34.757174 21921 rpcz_store.cc:276] 0709 12:10:32.442184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.722390 (+2280206us) service_pool.cc:224] Handling call
0709 12:10:34.756094 (+ 33704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.756605 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.756776 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.759138 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 198075us
I20260709 12:10:34.760875 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.761668 21892 leader_election.cc:400] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:34.763499 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:34.767004 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.756659 21847 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:34.761691 21992 raft_consensus.cc:2410] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:34.770315 21849 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:34.761371 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:34.773892 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:34.775988 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:34.780380 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:34.781096 21850 raft_consensus.cc:2393] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:34.781973 22577 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:34.774868 24622 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.782809 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.785722 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:34.786091 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1763) took 1539 ms. Trace:
I20260709 12:10:34.786373 21849 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.710827 24513 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:34.788187 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:34.762939 24471 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.788578 21994 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:34.789191 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.790112 21921 rpcz_store.cc:276] 0709 12:10:33.246509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.758124 (+1511615us) service_pool.cc:224] Handling call
0709 12:10:34.785724 (+ 27600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.785879 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.785897 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.785924 (+    27us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:34.785948 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.785980 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.786051 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.792918 21849 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:34.794113 22000 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:34.782919 24565 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.795588 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:34.797403 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.804659 21992 raft_consensus.cc:2393] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:34.775799 24530 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:34.810328 24530 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:34.810766 24530 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.799661 21920 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.800025 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.800395 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:34.733981 24442 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:10:34.815646 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1766) took 1568 ms. Trace:
I20260709 12:10:34.776044 24450 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:10:34.801265 24623 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:34.816005 21920 rpcz_store.cc:276] 0709 12:10:33.247353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.787469 (+1540116us) service_pool.cc:224] Handling call
0709 12:10:34.798776 (+ 11307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.815386 (+ 16610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.815591 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.798949 24622 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.802277 24559 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:34.802860 24449 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.734160 24090 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:34.807091 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.823603 21994 raft_consensus.cc:2368] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7.
I20260709 12:10:34.808708 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1768) took 1560 ms. Trace:
I20260709 12:10:34.809798 21850 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:34.801699 24635 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:34.817404 22000 raft_consensus.cc:2410] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:34.795125 24471 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.772485 24438 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:34.819629 21847 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:10:34.796257 24600 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:34.824514 21921 rpcz_store.cc:276] 0709 12:10:33.247867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.792045 (+1544178us) service_pool.cc:224] Handling call
0709 12:10:34.808023 (+ 15978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.808278 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.808315 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.808374 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.808428 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.808499 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.808635 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.836390 21920 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:34.839087 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.839457 21920 pending_rounds.cc:85] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 3
I20260709 12:10:34.839771 21920 pending_rounds.cc:107] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 12:10:34.837153 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 61262us
I20260709 12:10:34.840241 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.840538 24090 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:34.841113 21992 raft_consensus.cc:2410] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:34.816967 24622 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:34.844821 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.845216 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.834230 24559 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:34.845588 21817 connection.cc:256] RPC call timeout handler was delayed by -1.1938322689998131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
I20260709 12:10:34.845870 24559 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:34.846257 21817 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:34.846762 24559 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.838044 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.840018 21920 raft_consensus.cc:2889] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.849229 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1973) took 1550 ms. Trace:
I20260709 12:10:34.849642 22000 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.803625 24565 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:34.804360 24634 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:34.842199 21992 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:34.849556 21920 rpcz_store.cc:276] 0709 12:10:33.299311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.817627 (+1518316us) service_pool.cc:224] Handling call
0709 12:10:34.835953 (+ 18326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.849025 (+ 13072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.849182 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.858517 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.862824 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.875989 21919 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:34.879475 22000 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:34.864120 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:34.882378 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.837692 24471 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.884258 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:34.875859 24565 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.889972 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:34.884943 21847 raft_consensus.cc:2376] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7. Re-sending same reply.
I20260709 12:10:34.862288 24588 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:34.895004 21992 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:34.916008 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 67707.4us
I20260709 12:10:34.918133 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:34.923408 21847 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.886775 24090 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.932920 21849 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.936751 21849 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:34.906147 22000 raft_consensus.cc:2410] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:34.939998 21846 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.943481 21846 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:34.947151 24228 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:34.948086 24171 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:34.948698 21846 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.950976 24513 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:34.952893 24586 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:34.953822 21996 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:34.954208 21996 pending_rounds.cc:85] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 2
I20260709 12:10:34.954468 21996 pending_rounds.cc:107] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:34.954698 21996 raft_consensus.cc:2889] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.955770 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:34.956538 21851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1601) took 2983 ms (client timeout 1731 ms). Trace:
I20260709 12:10:34.956914 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:34.956929 21851 rpcz_store.cc:269] 0709 12:10:31.951831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.953099 (+  1268us) service_pool.cc:224] Handling call
0709 12:10:34.935231 (+2982132us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540017edd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:34.935352 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445668096}
I20260709 12:10:34.937635 21849 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.958048 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:34.962143 21992 raft_consensus.cc:2410] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:34.882815 24530 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.933480 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1964) took 2974 ms. Trace:
I20260709 12:10:34.935704 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:34.965000 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.965418 21994 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:34.967218 21994 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:34.936007 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1962) took 3071 ms. Trace:
I20260709 12:10:34.880419 24634 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:34.969895 21925 rpcz_store.cc:276] 0709 12:10:31.959097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.545501 (+2586404us) service_pool.cc:224] Handling call
0709 12:10:34.571039 (+ 25538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.571251 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:34.772195 (+200944us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.932252 (+160057us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.932616 (+   364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.932674 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.932736 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.933297 (+   561us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.933418 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43972,"prepare.queue_time_us":175328,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":3284,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":20502,"thread_start_us":293979,"threads_started":2,"wal-append.queue_time_us":150546}
I20260709 12:10:34.918041 24588 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:34.920912 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 173292us
I20260709 12:10:34.960917 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:34.969005 21926 rpcz_store.cc:276] 0709 12:10:31.865117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.545799 (+2680682us) service_pool.cc:224] Handling call
0709 12:10:34.568143 (+ 22344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.568297 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:34.719993 (+151696us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.935688 (+215695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.935735 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:34.935778 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.935833 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.935941 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174523,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":2306,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":320463,"threads_started":2}
I20260709 12:10:34.974799 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:34.975394 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.971817 24634 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:34.935197 21847 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:34.890640 24646 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 12:10:34.962162 24625 log.cc:927] Time spent T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.967s	user 0.013s	sys 0.000s
I20260709 12:10:34.979914 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:34.982545 21992 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:34.961452 24533 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:34.995939 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 216063us
I20260709 12:10:34.998858 24530 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:35.003911 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.994644 24533 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:35.015165 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 88806.7us
I20260709 12:10:35.015986 22576 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:35.016180 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:34.985373 24559 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.019137 24620 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.019508 24513 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:35.025458 21999 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:34.983783 24586 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.018551 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:35.029163 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:35.034264 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:35.020458 24559 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.040195 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2015) took 2065 ms. Trace:
I20260709 12:10:35.004376 24171 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:35.024988 24381 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:35.031560 24620 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:35.047580 24445 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.044845 21995 rpcz_store.cc:276] 0709 12:10:32.974359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.169702 (+195343us) service_pool.cc:224] Handling call
0709 12:10:33.170104 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.170369 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:33.278322 (+107953us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.178362 (+900040us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18000e2840. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae522 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:34.958150 (+779788us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b18000e2840. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be87933c7 00007f3be4da59a7 00007f3be4db50bf 00007f3be4db5038
0709 12:10:34.958425 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.039562 (+ 81137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.039612 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:35.039658 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.040003 (+   345us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.040137 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":822008,"prepare.queue_time_us":1817895,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":6519,"raft.queue_time_us":89325,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":12775,"spinlock_wait_cycles":21200128,"thread_start_us":586610,"threads_started":3,"wal-append.queue_time_us":469005,"wal-append.run_cpu_time_us":2106,"wal-append.run_wall_time_us":1179860}
I20260709 12:10:35.031143 24630 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:35.044234 24485 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:35.081269 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47119.8us
W20260709 12:10:35.081496 21997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1501) took 3345 ms (client timeout 1774 ms). Trace:
I20260709 12:10:35.039359 24610 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:10:35.030347 24646 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:35.045614 24559 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.087895 24171 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.088475 24171 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:35.084978 21997 rpcz_store.cc:269] 0709 12:10:31.736192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.736332 (+   140us) service_pool.cc:224] Handling call
0709 12:10:35.081266 (+3344934us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000d4154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:35.081419 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320701184}
W20260709 12:10:35.093910 21892 leader_election.cc:336] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.107s (SENT)
I20260709 12:10:35.094591 24171 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:35.096535 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:35.094676 24586 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:35.081789 24445 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.081936 24536 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.099851 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1503) took 3296 ms. Trace:
I20260709 12:10:35.101909 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:35.098850 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:35.095309 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 83663.8us
I20260709 12:10:35.085114 24630 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.110383 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:35.105250 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:35.111238 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:35.083585 24657 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.108814 22001 rpcz_store.cc:276] 0709 12:10:31.802256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.802507 (+   251us) service_pool.cc:224] Handling call
0709 12:10:31.827075 (+ 24568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.866011 (+2038936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.098122 (+1232111us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54000c44d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:35.098336 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4674004224}
W20260709 12:10:35.102027 24650 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:10:35.118858 24630 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:35.119316 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 90268.1us
I20260709 12:10:35.105116 24171 raft_consensus.cc:3055] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:35.111658 24549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.309s	user 0.016s	sys 0.021s
I20260709 12:10:35.110181 24445 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.107304 24666 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.133279 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:35.126143 24448 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:35.079691 24620 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:35.108501 24536 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:35.132815 24549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.330s	user 0.017s	sys 0.022s
I20260709 12:10:35.099453 24634 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:35.139434 21818 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:35.131471 24171 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:35.148900 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:35.149786 22582 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:35.149569 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:35.150563 22580 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
I20260709 12:10:35.151819 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:35.138082 24672 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.143566 24448 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:35.158402 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:35.166960 22576 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:10:35.164121 24642 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:10:35.164686 24661 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:35.166317 24448 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:35.170091 24448 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:35.170712 24593 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 1.377s	user 0.013s	sys 0.001s
I20260709 12:10:35.171056 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:35.171943 22581 raft_consensus.cc:2410] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:35.172382 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 547) took 2179 ms. Trace:
I20260709 12:10:35.172677 22581 rpcz_store.cc:276] 0709 12:10:32.993163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.995546 (+  2383us) service_pool.cc:224] Handling call
0709 12:10:35.170901 (+2175355us) spinlock_profiling.cc:243] Waited 965 us on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:35.172301 (+  1400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219264}
I20260709 12:10:35.173062 24541 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:35.170765 24471 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:35.179322 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.148037 24657 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.180701 24549 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.153342 24588 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:35.142503 24565 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:35.138512 24666 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:35.232933 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 98241.9us
W20260709 12:10:35.205942 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.309577 21818 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:35.352093 24645 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:35.375631 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:35.298362 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.181155 24224 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:35.372530 24471 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:35.378619 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 69128.2us
I20260709 12:10:35.181257 24549 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:35.378211 21846 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:35.200320 21845 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:35.371352 24553 consensus_meta.cc:287] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.001s
I20260709 12:10:35.379545 21850 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:35.388581 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 277398us
I20260709 12:10:35.390134 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:35.378216 24533 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:35.202539 24536 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:35.249872 24171 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:35.311506 24445 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:35.390859 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:35.613281 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.752691 21852 raft_consensus.cc:2368] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
W20260709 12:10:35.672430 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 227839us
W20260709 12:10:35.445246 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 75779.1us
I20260709 12:10:35.394340 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:35.479652 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 87333.4us
I20260709 12:10:35.763463 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:35.424286 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.766291 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:35.399397 21850 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:35.760876 21846 raft_consensus.cc:2410] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:35.766637 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.768126 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:35.765584 21844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 376) took 3815 ms (client timeout 1782 ms). Trace:
I20260709 12:10:35.384799 24657 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:35.767082 21845 raft_consensus.cc:2376] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5. Re-sending same reply.
I20260709 12:10:35.789747 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:35.435992 24505 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:35.749120 24677 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:35.748514 24666 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:35.729403 24565 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:35.432358 24549 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:35.825953 21845 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.394388 24553 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:35.768262 24674 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.829914 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:35.772720 24536 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:35.772046 21844 rpcz_store.cc:269] 0709 12:10:31.949669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.949809 (+   140us) service_pool.cc:224] Handling call
0709 12:10:35.765423 (+3815614us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b540017e8d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:35.765513 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1916828544}
I20260709 12:10:35.472654 24630 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:35.782927 24657 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:35.842934 21845 raft_consensus.cc:1240] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.406932 24448 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:35.998807 24657 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.999032 24448 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:35.844046 21918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1970) took 2925 ms (client timeout 1749 ms). Trace:
W20260709 12:10:36.000176 21918 rpcz_store.cc:269] 0709 12:10:32.918615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.931928 (+ 13313us) service_pool.cc:224] Handling call
0709 12:10:35.843839 (+2911911us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b54001937d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:35.843982 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136613760}
I20260709 12:10:35.829274 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.003813 24630 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:36.004405 21892 leader_election.cc:336] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.774s (SENT)
W20260709 12:10:36.005213 21892 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.776s (SENT)
I20260709 12:10:36.005528 21924 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:10:36.005633 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:36.013293 24630 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.014206 24612 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:36.014688 21892 leader_election.cc:336] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.811s (SENT)
I20260709 12:10:35.902915 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 351) took 3491 ms. Trace:
I20260709 12:10:35.891896 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 596) took 1331 ms. Trace:
I20260709 12:10:36.026087 22577 rpcz_store.cc:276] 0709 12:10:34.560675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.561331 (+   656us) service_pool.cc:224] Handling call
0709 12:10:35.891674 (+1330343us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540046fd54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:35.891804 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481973632}
I20260709 12:10:35.844745 24670 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.844982 24675 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.840392 24677 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:35.869271 24445 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:35.840572 24680 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.880393 21847 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:36.034560 21892 leader_election.cc:400] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
W20260709 12:10:35.875505 24669 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.652s	user 0.003s	sys 0.001s
I20260709 12:10:35.985869 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:36.035951 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 557) took 1395 ms. Trace:
I20260709 12:10:36.036276 22578 rpcz_store.cc:276] 0709 12:10:34.642328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.654183 (+ 11855us) service_pool.cc:224] Handling call
0709 12:10:35.985629 (+1331446us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b58001b8d98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:10:36.035892 (+ 50263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3332352}
I20260709 12:10:35.986162 21850 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:35.870069 24615 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.824195 24635 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.030772 24448 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.043445 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:36.044056 21847 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.044318 21818 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:36.044895 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:35.441808 24559 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:35.993302 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 163488us
I20260709 12:10:36.027446 21923 rpcz_store.cc:276] 0709 12:10:32.412278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.580802 (+2168524us) service_pool.cc:224] Handling call
0709 12:10:34.587230 (+  6428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.638468 (+ 51238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:34.734111 (+ 95643us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.971195 (+237084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.971252 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:34.971309 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.901416 (+930107us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18004402c0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c7c2a6 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419
0709 12:10:35.902637 (+  1221us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54003e6cd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:35.902688 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.902839 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104777,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":72,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4403,"spinlock_wait_cycles":120278528,"thread_start_us":324356,"threads_started":2,"wal-append.queue_time_us":311833}
I20260709 12:10:36.033104 21918 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:35.871107 24682 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.991623 24674 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.052639 24696 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:36.053082 24598 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:36.038179 24277 consensus_queue.cc:1059] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:36.055799 24277 raft_consensus.cc:3055] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.056253 24277 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:36.056964 24585 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:36.057368 24277 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.041404 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:35.994516 24549 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.041404 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:35.974263 24643 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.017s	sys 0.018s
I20260709 12:10:36.047385 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:36.073038 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:36.060564 24682 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.073596 24679 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.041911 24615 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:36.034328 24630 consensus_queue.cc:1059] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 12:10:35.872867 24624 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.892s	user 0.003s	sys 0.021s
I20260709 12:10:36.053138 24696 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:36.077859 24696 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.077898 24615 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:36.075268 24697 log.cc:927] Time spent T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:10:36.079118 24615 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.074898 24553 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:36.079988 24553 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.061563 21850 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:36.081485 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 381) took 2779 ms. Trace:
I20260709 12:10:36.081873 21848 rpcz_store.cc:276] 0709 12:10:33.302042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.879933 (+577891us) service_pool.cc:224] Handling call
0709 12:10:33.907595 (+ 27662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.908084 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:33.925001 (+ 16917us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.982398 (+ 57397us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.987142 (+  4744us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.987778 (+   636us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:33.988255 (+   477us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.017149 (+ 28894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.017228 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.261863 (+244635us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b180047ba80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:34.973312 (+711449us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b180047ba80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae522 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:35.872156 (+898844us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:36.081274 (+209118us) raft_consensus.cc:1685] finished
0709 12:10:36.081293 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.081427 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14269,"prepare.queue_time_us":31791,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":92,"raft.queue_time_us":20918,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":12404,"spinlock_wait_cycles":298070016,"thread_start_us":50002,"threads_started":1,"wal-append.queue_time_us":49329}
W20260709 12:10:36.062307 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.048611 22584 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:36.085690 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.032014 24670 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:36.072069 24643 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.019s	sys 0.018s
I20260709 12:10:36.089646 21847 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:36.043278 24445 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:36.046779 24636 consensus_queue.cc:1059] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:10:36.038265 24680 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.033380 24675 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.049103 24448 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.115276 24636 raft_consensus.cc:3055] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.115742 24636 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:36.117276 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 560) took 1195 ms. Trace:
I20260709 12:10:36.047156 24635 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.118750 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.119413 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.125114 21850 raft_consensus.cc:2393] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:36.117666 22579 rpcz_store.cc:276] 0709 12:10:34.922361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.922728 (+   367us) service_pool.cc:224] Handling call
0709 12:10:34.923293 (+   565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.923800 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:35.022551 (+ 98751us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.311459 (+288908us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.318551 (+  7092us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.318778 (+   227us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:35.318828 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.318930 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.874741 (+555811us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:36.116977 (+242236us) raft_consensus.cc:1685] finished
0709 12:10:36.117070 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.117215 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":148905,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2198,"raft.queue_time_us":53142,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":6207,"spinlock_wait_cycles":16667520,"thread_start_us":365656,"threads_started":3,"wal-append.queue_time_us":110744}
I20260709 12:10:36.094000 24277 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.120041 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1762) took 2874 ms. Trace:
I20260709 12:10:36.101470 24630 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.126579 21924 rpcz_store.cc:276] 0709 12:10:33.245467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.754023 (+1508556us) service_pool.cc:224] Handling call
0709 12:10:35.843968 (+1089945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.006240 (+162272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.117457 (+111217us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54001937d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:36.119842 (+  2385us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001937d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:36.119981 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2876724480}
I20260709 12:10:36.127107 21847 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.133587 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.136114 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:36.139144 21850 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:36.143550 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 91126.4us
I20260709 12:10:36.119458 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:36.090531 24553 consensus_queue.cc:1059] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:36.116540 24670 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:36.145967 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 71631.5us
I20260709 12:10:36.155026 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.155684 22549 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:36.108081 24674 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:36.100807 24657 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.155871 21852 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:36.165596 24438 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.166252 24438 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:36.168991 24438 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:36.169786 24585 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.170405 24585 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.170881 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.171535 21999 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:36.174841 24657 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:36.156122 24691 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:36.180672 24691 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.181133 24691 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.142805 24679 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:36.190680 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:36.192812 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.196769 21995 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:36.197773 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.195160 22581 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:36.198200 21964 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:36.148347 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:36.200168 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:36.200347 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 44896.5us
W20260709 12:10:36.267743 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.284263 22581 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.298131 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:36.297984 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:36.298552 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.285087 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:36.299075 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.299364 21992 raft_consensus.cc:2410] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:36.135386 24630 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.287897 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:36.171535 24448 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:36.130373 24699 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:10:36.283818 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.116552 24636 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.297922 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.164353 24549 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.299026 22580 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:36.304268 22577 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:36.289258 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:36.298796 21999 raft_consensus.cc:2376] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6. Re-sending same reply.
I20260709 12:10:36.189248 24682 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:36.306475 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 182164us
W20260709 12:10:36.307056 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.318791 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.319705 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:36.320324 22582 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:36.316809 22578 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.321859 21994 raft_consensus.cc:2368] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6.
W20260709 12:10:36.314107 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.331768 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:36.332238 24675 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:36.332944 24674 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.333431 24674 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:36.300824 24612 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.334973 24612 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:36.311055 24703 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:36.335843 24612 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.336678 24696 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.337783 21848 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:36.339067 24696 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:36.339498 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.341102 24283 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:36.348169 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1523) took 3895 ms. Trace:
I20260709 12:10:36.348667 21996 rpcz_store.cc:276] 0709 12:10:32.452325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.462483 (+ 10158us) service_pool.cc:224] Handling call
0709 12:10:32.462759 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.955111 (+2492352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.347883 (+1392772us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b5400221d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:36.348098 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5728177408}
W20260709 12:10:36.352639 24655 log.cc:927] Time spent T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 1.372s	user 0.014s	sys 0.004s
I20260709 12:10:36.355221 24502 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.355921 24621 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.355819 24502 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.302316 24536 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.366809 24536 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:36.301338 24677 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:36.367429 24559 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:36.367785 24536 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.359139 21997 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:36.370814 21995 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:36.371551 24622 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:36.373234 24459 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.375167 21849 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.313891 24635 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:36.377044 22579 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:36.377338 24708 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:36.378086 24708 consensus_queue.cc:1243] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:36.305845 24292 consensus_queue.cc:1059] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:10:36.379578 24292 raft_consensus.cc:3055] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:36.380020 24292 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:36.380470 24657 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.380980 24657 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.381014 24292 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.313571 24438 consensus_queue.cc:1059] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:10:36.383558 24438 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:36.383985 24438 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:36.385939 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:36.384050 21849 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:10:36.386998 21849 pending_rounds.cc:85] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 5
I20260709 12:10:36.387252 21849 pending_rounds.cc:107] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 12:10:36.387578 21849 raft_consensus.cc:2917] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 12:10:36.356402 24621 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.388164 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:36.385124 24438 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.388965 22580 raft_consensus.cc:2410] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:36.301424 24585 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:36.362825 22575 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:36.310889 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.389470 24621 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:36.390031 24680 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:36.389724 22575 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:36.387480 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:36.390105 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.389426 24438 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.390831 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:36.400687 21994 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:10:36.391311 24702 log.cc:927] Time spent T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:10:36.402398 24657 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:36.403117 21992 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:36.334246 24674 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.397120 24645 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:36.404686 24645 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:36.408191 24701 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:10:36.389783 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:36.412405 22580 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.401610 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:36.391311 22584 raft_consensus.cc:2376] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7. Re-sending same reply.
W20260709 12:10:36.391775 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.393177 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:36.306948 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 98400.5us
I20260709 12:10:36.417135 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.417457 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:36.397241 21849 raft_consensus.cc:2889] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:36.419225 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.420964 22578 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
W20260709 12:10:36.423014 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 223294us
W20260709 12:10:36.427277 22549 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.660s (SENT)
I20260709 12:10:36.427804 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:36.430951 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 282663us
I20260709 12:10:36.307232 24228 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.433149 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:36.433558 21892 leader_election.cc:336] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.815s (SENT)
W20260709 12:10:36.434130 22549 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.870s (SENT)
I20260709 12:10:36.438546 22000 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:36.420015 21992 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
W20260709 12:10:36.446630 22549 leader_election.cc:336] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.871s (SENT)
I20260709 12:10:36.446756 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:36.447422 22549 leader_election.cc:336] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.922s (SENT)
I20260709 12:10:36.447440 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:36.448421 22549 leader_election.cc:336] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.923s (SENT)
I20260709 12:10:36.448933 22549 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:36.451332 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:36.451465 21892 leader_election.cc:336] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.849s (SENT)
I20260709 12:10:36.451721 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.452117 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:36.454671 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:36.459030 21967 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:36.467114 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:36.468225 21996 raft_consensus.cc:2410] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:36.471391 22580 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:36.477015 21992 raft_consensus.cc:3055] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.477684 21992 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:36.478683 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.480844 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.481866 21994 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:36.483099 21997 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:36.484387 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.485096 21997 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:36.486522 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:36.487617 22580 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:36.425706 24615 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:36.431289 24292 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:36.519559 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 60619us
W20260709 12:10:36.491282 21892 leader_election.cc:336] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.924s (SENT)
I20260709 12:10:36.442494 24691 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.450016 24559 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:36.521764 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 90343.4us
I20260709 12:10:36.491896 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.491521 24679 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.492915 24502 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:36.493445 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:36.498531 21993 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:36.573791 22584 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.478645 21992 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.574725 21992 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.518949 24438 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.507284 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.508278 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.583889 21846 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:36.509065 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:36.551821 21893 connection.cc:256] RPC call timeout handler was delayed by -1.7983998299998802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 12:10:36.584757 21893 connection.cc:256] RPC call timeout handler was delayed by -1.6957998299999417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:10:36.585233 21893 connection.cc:256] RPC call timeout handler was delayed by -1.6138998299998093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 12:10:36.585620 21893 connection.cc:256] RPC call timeout handler was delayed by -1.1269998299999315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2316s for a response
I20260709 12:10:36.472675 24610 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.556541 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.551898 22580 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:36.558904 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:36.473690 24700 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.523501 24615 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.572686 24442 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:36.430960 24704 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:10:36.489001 24675 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.503823 24670 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:36.566840 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 46097.9us
W20260709 12:10:36.572101 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 96679.6us
I20260709 12:10:36.572587 22000 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:36.506440 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 77195.1us
I20260709 12:10:36.575582 22578 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.466051 24228 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.636453 24228 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:36.474700 24585 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:10:36.590091 21926 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:36.639355 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.640811 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.590950 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.601941 21922 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.643399 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.643572 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.602231 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.644709 21923 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:36.645474 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:36.602965 21994 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:10:36.650673 21994 pending_rounds.cc:85] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 3
I20260709 12:10:36.651007 21994 pending_rounds.cc:107] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:10:36.651291 21994 raft_consensus.cc:2889] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:36.600811 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.601116 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.652909 21924 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:36.653988 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.655265 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.656442 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.657560 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.601423 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.659356 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.610505 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.661422 21925 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:36.597474 21852 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
W20260709 12:10:36.621786 22576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.004s	sys 0.016s
I20260709 12:10:36.645843 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:36.662683 22576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.005s	sys 0.016s
I20260709 12:10:36.644727 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:36.652036 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.666320 21927 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:36.667887 21927 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:36.668511 21925 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:36.669229 21927 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.660547 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.664019 21923 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:36.670254 21920 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:10:36.670356 21923 pending_rounds.cc:85] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 6
I20260709 12:10:36.670869 21923 pending_rounds.cc:107] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:36.671150 21923 raft_consensus.cc:2889] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:36.642045 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.613687 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.672487 21848 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
W20260709 12:10:36.672780 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.658219 21924 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:36.691649 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.696002 22578 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:36.699649 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.700342 21918 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:36.702920 22584 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:36.706370 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.707269 21993 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:36.602366 24615 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:36.718616 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 87605.7us
I20260709 12:10:36.718951 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.719584 21924 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 3.
W20260709 12:10:36.720774 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.623515 24670 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.598322 24630 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:36.722920 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1737) took 1995 ms. Trace:
I20260709 12:10:36.728750 21817 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:36.732292 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.733060 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.733747 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:36.603535 24565 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
W20260709 12:10:36.740190 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 289646us
I20260709 12:10:36.610466 24438 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.610936 24442 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.588449 24710 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 12:10:36.735854 21849 rpcz_store.cc:276] 0709 12:10:34.727848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.793542 (+ 65694us) service_pool.cc:224] Handling call
0709 12:10:34.793825 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.374137 (+1580312us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b580037a6d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4cf70aa 00007f3be4d79447 00007f3be4d91fe7 00007f3be4d937de 00007f3be4d9db49 00007f3be4d9e416 00007f3be4d9ad8f 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4
0709 12:10:36.375113 (+   976us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b2400349a30. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d79462 00007f3be4d91fe7 00007f3be4d937de 00007f3be4d9db49 00007f3be4d9e416 00007f3be4d9ad8f 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62
0709 12:10:36.418566 (+ 43453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.722636 (+304070us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54000933d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:36.722852 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3185197568}
I20260709 12:10:36.744431 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:36.606154 24645 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.746838 22549 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:36.747874 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.735381 24670 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.752617 22549 leader_election.cc:400] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7.
I20260709 12:10:36.753049 22549 leader_election.cc:403] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.754308 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:36.756390 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:36.749629 21918 raft_consensus.cc:2393] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:36.750684 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:36.759289 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 206684us
I20260709 12:10:36.767932 21994 raft_consensus.cc:2410] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:36.768759 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 247757us
W20260709 12:10:36.769436 21892 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.966s (SENT)
W20260709 12:10:36.770694 21892 leader_election.cc:336] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.025s (SENT)
W20260709 12:10:36.771654 21892 leader_election.cc:336] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.105s (SENT)
W20260709 12:10:36.772567 21892 leader_election.cc:336] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.210s (SENT)
W20260709 12:10:36.773417 21892 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.233s (SENT)
W20260709 12:10:36.776813 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 144685us
I20260709 12:10:36.697578 24675 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.743990 24673 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.778915 24586 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:10:36.787688 24654 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:36.788120 24654 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:36.788496 24654 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.789896 24636 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.792155 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.793579 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:36.794858 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:36.795416 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.795897 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:36.787194 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 58536.2us
I20260709 12:10:36.751587 24549 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.801765 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:36.766387 24424 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.804764 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.809208 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.809587 21924 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:36.806874 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.766577 24623 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7.
I20260709 12:10:36.807487 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.776250 24559 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.807384 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:36.766697 24283 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:36.817466 21817 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:36.828677 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:36.829293 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.751777 24482 consensus_queue.cc:1059] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:10:36.818058 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:36.830652 21849 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:10:36.867023 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 49634.1us
W20260709 12:10:36.844947 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.871887 21924 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
W20260709 12:10:36.876366 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 58391.8us
I20260709 12:10:36.834185 24508 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:36.878155 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:36.879355 24714 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.876612 21817 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:36.884522 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.885259 21923 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:36.887069 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.818161 24598 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.830400 24505 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.831621 24635 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.899034 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:36.883304 24459 consensus_meta.cc:287] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.001s
I20260709 12:10:36.915584 21998 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
W20260709 12:10:36.903113 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.915822 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.916435 24611 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.906745 24277 consensus_meta.cc:287] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.002s
I20260709 12:10:36.917002 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.917325 21922 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:36.907572 22000 raft_consensus.cc:2410] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:36.895387 24719 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.881255 24622 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.927361 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.927942 21893 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:36.908298 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.890954 24660 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.909366 24674 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:36.934585 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.935818 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.888929 24630 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:36.910777 24716 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:36.948988 24438 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:36.910796 24654 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:36.910776 24720 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:36.912510 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:36.936573 21927 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
W20260709 12:10:36.955971 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 43549.4us
I20260709 12:10:36.956326 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.957283 21923 raft_consensus.cc:2410] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:36.961046 21845 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.873132 24727 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.918627 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.922005 21992 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:36.908164 24469 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.797125 24673 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:36.928601 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 203134us
I20260709 12:10:36.929406 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.932380 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:36.934432 24502 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:10:36.945850 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:36.930516 24719 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:36.926883 24666 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.947263 24713 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.948084 24674 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:36.902746 24508 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.954123 21815 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.649s (SENT) [suppressed 66 similar messages]
I20260709 12:10:36.963073 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:36.964532 22579 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.926813 24635 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.889103 24714 consensus_queue.cc:1059] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:10:36.972308 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:36.916913 24611 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:36.964929 22547 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:36.973680 21920 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:37.078794 21998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 476) took 2958 ms (client timeout 1922 ms). Trace:
I20260709 12:10:37.192379 21919 raft_consensus.cc:1813] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Handling vote request from an unknown peer 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:37.193383 21919 raft_consensus.cc:2410] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:10:37.193825 21998 rpcz_store.cc:269] 0709 12:10:34.120774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.658326 (+537552us) service_pool.cc:224] Handling call
0709 12:10:37.078566 (+2420240us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b540018e7d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:37.078692 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5140447488}
W20260709 12:10:37.194737 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.096511 24688 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:37.195217 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:37.198523 21924 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:37.195930 24674 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:37.196610 22577 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:37.199877 21845 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:36.991480 24691 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:37.196527 24666 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:37.201272 24688 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:36.987589 24654 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:37.203603 24666 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:37.197383 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 435667us
I20260709 12:10:37.206128 21966 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:37.197656 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:37.103116 24734 log.cc:927] Time spent T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.155s	user 0.000s	sys 0.002s
I20260709 12:10:36.960122 24645 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:37.207382 21846 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:37.090600 24646 raft_consensus.cc:3055] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:37.208549 24646 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:37.200080 24674 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.210099 24674 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.209599 24646 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.211398 24646 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.971488 24622 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:37.212788 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 247940us
I20260709 12:10:37.006058 24727 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.072603 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 606) took 1033 ms. Trace:
W20260709 12:10:37.170032 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.177512 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:37.181834 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 211496us
I20260709 12:10:37.021885 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:37.217185 21850 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:36.984098 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:36.998696 21967 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:37.219738 24714 consensus_queue.cc:1243] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:37.223500 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:37.224416 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:36.991139 24723 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:37.255877 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1558) took 1062 ms. Trace:
W20260709 12:10:37.256551 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 257907us
I20260709 12:10:37.256409 22001 rpcz_store.cc:276] 0709 12:10:36.193260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.311720 (+118460us) service_pool.cc:224] Handling call
0709 12:10:36.391645 (+ 79925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.392008 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.392039 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.392504 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.625552 (+233048us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:36.828623 (+203071us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.255444 (+426821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.255552 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.255610 (+    58us) raft_consensus.cc:1685] finished
0709 12:10:37.255629 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.255802 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94692,"prepare.queue_time_us":283156,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":79710,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146,"thread_start_us":743309,"threads_started":3,"wal-append.queue_time_us":403055}
I20260709 12:10:37.231426 22547 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:37.231704 21845 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.091341 24707 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.082774 24442 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:37.220306 24713 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.241012 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 308793us
I20260709 12:10:37.281011 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:37.241382 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.244587 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.235267 22576 rpcz_store.cc:276] 0709 12:10:36.039523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.039658 (+   135us) service_pool.cc:224] Handling call
0709 12:10:36.039965 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.665448 (+625483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.665491 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.666091 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.810294 (+144203us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.810332 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.072079 (+261747us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b54004d12d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:37.072141 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.072206 (+    65us) raft_consensus.cc:1685] finished
0709 12:10:37.072226 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.072523 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16705,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3302,"spinlock_wait_cycles":79671680,"thread_start_us":734037,"threads_started":2,"wal-append.queue_time_us":376654}
W20260709 12:10:37.245812 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.238857 21847 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:37.283646 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59307.1us
W20260709 12:10:37.285846 21892 leader_election.cc:336] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.684s (SENT)
I20260709 12:10:37.286582 24671 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.287014 24671 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.287358 24671 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.239396 21927 raft_consensus.cc:2410] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:37.247257 21918 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:36.982116 24469 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.262310 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:37.219019 24645 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.291006 24469 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.290546 24630 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:37.295027 21892 leader_election.cc:336] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.966s (SENT)
I20260709 12:10:37.299715 21893 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:37.299899 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:37.302328 22001 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.303365 21893 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:37.234437 24622 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.277081 24610 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.218003 24635 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.219249 24508 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:37.233675 24505 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:10:37.276974 24707 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:37.228332 24716 consensus_queue.cc:1059] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:10:37.296427 24585 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:37.301376 24696 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.341482 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 79254.7us
W20260709 12:10:37.322739 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.085424 22575 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.276428 24485 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:37.349885 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 46630.8us
I20260709 12:10:37.361577 21893 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:37.295960 24553 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.279104 24700 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.299875 21847 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:10:37.342633 24565 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:37.357854 21922 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.335532 24719 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:37.305441 24636 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:37.337852 24670 consensus_meta.cc:287] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.003s
I20260709 12:10:37.364854 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:37.356652 22001 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:37.327973 24228 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.304795 24713 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:37.333997 24726 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.336189 24675 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:37.333674 24727 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:37.350706 24622 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.350791 24610 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:37.358227 24712 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:37.385823 21997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.014s	sys 0.013s
I20260709 12:10:37.367800 24585 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:37.376808 22575 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.372123 24553 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:37.365892 24442 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:37.362986 24696 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:37.378553 24565 raft_consensus.cc:697] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:37.385152 24726 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.342751 24688 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:37.387765 24459 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:37.384088 24670 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.390341 24610 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:37.420670 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 466551us
I20260709 12:10:37.464779 24459 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:37.474301 24459 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.381783 21893 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:37.371667 24469 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:37.479899 24469 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:37.397080 24636 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.385134 24228 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:37.483170 24228 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:37.484812 24636 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.485320 24636 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.485769 24636 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.487785 24713 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:37.489223 24553 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:37.394124 24663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.009s	sys 0.022s
W20260709 12:10:37.490960 24663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.009s	sys 0.023s
W20260709 12:10:37.484531 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 102811us
W20260709 12:10:37.497437 22549 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.721s (SENT)
I20260709 12:10:37.497968 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:37.372473 24700 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.498340 21893 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:37.406761 24727 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 12:10:37.474231 21815 leader_election.cc:336] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.749s (SENT)
W20260709 12:10:37.511598 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.522311 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:37.528903 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:37.530481 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56320.3us
I20260709 12:10:37.444392 24726 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.538439 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:37.587080 24742 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:10:37.534364 24228 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.511621 24688 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.585700 24565 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.510632 24663 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:37.590349 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 208033us
W20260709 12:10:37.688644 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.690732 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:37.691262 21918 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:37.691851 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:37.692454 21922 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:37.692708 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:37.693295 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:37.689365 21817 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:37.651986 22576 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:37.534528 24674 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.444890 24740 consensus_queue.cc:1059] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:10:37.694192 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:37.707497 24630 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.708101 21918 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:37.708060 24630 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.710371 24630 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:37.710939 24630 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:37.711232 24674 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.711858 24674 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.696285 21893 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:37.713238 21893 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:37.715777 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:37.694542 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:37.650743 22549 leader_election.cc:336] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.850s (SENT)
I20260709 12:10:37.711504 24630 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:37.652980 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 55351.8us
W20260709 12:10:37.741835 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.734942 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:37.534091 24713 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 12:10:37.758682 22579 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:37.443559 24707 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.749025 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:37.765725 21997 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:37.751425 24740 consensus_queue.cc:1243] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:37.753088 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:37.772746 21995 raft_consensus.cc:2410] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:37.754849 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:37.773833 21994 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.755765 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:37.764230 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:37.775405 21996 raft_consensus.cc:2410] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:37.688304 24635 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:37.527029 24585 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.781050 24292 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:37.794939 24707 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:37.795598 24743 log.cc:927] Time spent T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 12:10:37.799090 24746 log.cc:927] Time spent T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:10:37.798830 24636 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:37.800185 24750 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:10:37.800654 24508 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:37.781850 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 92596.5us
W20260709 12:10:37.819209 21999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.003s	sys 0.023s
I20260709 12:10:37.850534 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:37.856734 21994 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:37.857450 21850 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:37.830545 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.844494 21852 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:37.856539 21999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.004s	sys 0.023s
I20260709 12:10:37.861610 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 388) took 2099 ms. Trace:
I20260709 12:10:37.862006 21843 rpcz_store.cc:276] 0709 12:10:35.762430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.899541 (+137111us) service_pool.cc:224] Handling call
0709 12:10:35.899899 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.579717 (+679818us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:36.579763 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.579883 (+   120us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:36.579943 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.861399 (+1281456us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400208854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:37.861447 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.861556 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97733,"raft.queue_time_us":35375,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":27070,"spinlock_wait_cycles":515418880,"thread_start_us":455185,"threads_started":1}
W20260709 12:10:37.863380 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.848776 21815 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:37.801280 24740 raft_consensus.cc:3055] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.806483 24710 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:37.862259 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1559) took 1668 ms. Trace:
I20260709 12:10:37.817433 24469 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:37.781773 24612 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:37.868958 21890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.022s
W20260709 12:10:37.869508 21890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.006s	sys 0.023s
W20260709 12:10:37.879398 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.867877 21999 rpcz_store.cc:276] 0709 12:10:36.193595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.317547 (+123952us) service_pool.cc:224] Handling call
0709 12:10:36.333630 (+ 16083us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.334060 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.334098 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.334699 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.716895 (+382196us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:36.819668 (+102773us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.861948 (+1042280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.862034 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.862079 (+    45us) raft_consensus.cc:1685] finished
0709 12:10:37.862092 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.862206 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34792,"prepare.queue_time_us":192204,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":88712,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":185,"spinlock_wait_cycles":701184,"thread_start_us":1462619,"threads_started":3,"wal-append.queue_time_us":478804}
I20260709 12:10:37.874164 21817 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:37.889194 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:37.894927 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:37.864579 24615 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.864893 24760 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.865724 24719 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.874763 24504 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.870596 24696 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:37.911113 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 387964us
I20260709 12:10:37.866385 24740 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:37.880430 24710 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:37.882682 24670 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:37.925601 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:37.900518 24643 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:37.935760 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.901085 24756 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:37.956809 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.877729 24469 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.929379 24630 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:37.877410 24612 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.930991 24553 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:37.975689 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 274417us
I20260709 12:10:37.979652 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2057) took 1082 ms. Trace:
I20260709 12:10:37.980108 21993 rpcz_store.cc:276] 0709 12:10:36.897254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.915577 (+ 18323us) service_pool.cc:224] Handling call
0709 12:10:36.915896 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:36.916240 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.916266 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:36.916849 (+   583us) log.cc:844] Serialized 52 byte log entry
0709 12:10:37.353808 (+436959us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:37.368977 (+ 15169us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.369953 (+   976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.370018 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.979388 (+609370us) raft_consensus.cc:1685] finished
0709 12:10:37.979413 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.979562 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15022,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":642,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":6562,"thread_start_us":436638,"threads_started":1,"wal-append.queue_time_us":594270}
I20260709 12:10:37.921552 24719 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:37.972101 24744 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:10:37.914471 24760 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:37.989033 24718 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.997575 24718 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:37.931815 24759 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:10:37.998435 24718 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.999469 24718 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.999718 24759 consensus_queue.cc:1059] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:37.990633 24710 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:37.982510 24747 log.cc:927] Time spent T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:10:37.970748 24643 raft_consensus.cc:697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:38.015501 24643 consensus_queue.cc:237] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:37.995460 24740 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:37.973079 24700 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:37.998204 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1657) took 1011 ms. Trace:
I20260709 12:10:38.018994 24740 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.018589 21844 rpcz_store.cc:276] 0709 12:10:36.986999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.208561 (+221562us) service_pool.cc:224] Handling call
0709 12:10:37.208917 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.278381 (+ 69464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.278435 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.278987 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.736929 (+457942us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:37.736974 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.737059 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.997994 (+260935us) raft_consensus.cc:1685] finished
0709 12:10:37.998015 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.998150 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89245,"raft.queue_time_us":69949,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":8774,"thread_start_us":405637,"threads_started":1,"wal-append.queue_time_us":650005}
W20260709 12:10:37.991958 24671 consensus_meta.cc:287] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.704s	user 0.006s	sys 0.005s
W20260709 12:10:38.020720 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.985178 24171 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.029464 24469 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:38.040659 22575 consensus_meta.cc:287] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.009s
I20260709 12:10:38.026515 24671 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:38.080538 24622 consensus_meta.cc:287] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.000s
I20260709 12:10:38.080749 24726 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.081157 24622 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:38.082018 24712 consensus_meta.cc:287] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 12:10:38.082497 21925 raft_consensus.cc:2368] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7.
I20260709 12:10:38.082669 24719 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.084404 24712 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:38.085078 24622 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.087528 24674 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.097090 24674 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.092568 24671 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.070124 24636 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.028291 24765 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:38.033794 24727 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:10:38.098963 24766 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:38.099355 24766 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:38.100203 24766 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.097680 21851 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:38.102137 24673 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.034535 24761 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 12:10:38.102603 24763 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:10:38.103479 24769 raft_consensus.cc:3055] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:38.103963 24769 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:38.035895 24753 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:10:38.104875 24769 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:38.110402 24646 consensus_meta.cc:287] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.833s	user 0.012s	sys 0.001s
I20260709 12:10:38.110795 22575 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:38.102811 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1629) took 2897 ms. Trace:
W20260709 12:10:38.111413 24600 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:38.111897 21918 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:38.111478 21851 rpcz_store.cc:276] 0709 12:10:35.205108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.205276 (+   168us) service_pool.cc:224] Handling call
0709 12:10:35.232731 (+ 27455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.101652 (+2868921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.102584 (+   932us) spinlock_profiling.cc:243] Waited 2.86 s on lock 0x7b54003e17d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:38.102757 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6588077440}
I20260709 12:10:38.111487 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 561) took 3188 ms. Trace:
I20260709 12:10:38.112768 24438 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:38.102650 24612 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.113308 24438 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:38.113154 22575 rpcz_store.cc:276] 0709 12:10:34.922686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.925206 (+  2520us) service_pool.cc:224] Handling call
0709 12:10:34.925602 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.362717 (+1437115us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400655a20. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d12dc0 00007f3be4d9d1c0 00007f3be4d9e231 00007f3be4d9ad8f 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c
0709 12:10:37.084918 (+722201us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4c0027ce40. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3067a20 00007f3be3078a29 00007f3be303e644 00007f3be3065f2d 00007f3be3065b93 00007f3be4d9618b 00007f3be4d96cb5 00007f3be4d91f30 00007f3be4d937de 00007f3be4d9db49 00007f3be4d9e416
0709 12:10:38.111209 (+1026291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.111432 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259917824}
W20260709 12:10:38.118116 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 143931us
I20260709 12:10:38.103070 24524 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.117570 24766 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:38.147029 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 386819us
I20260709 12:10:38.147151 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:38.151672 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.155076 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.140893 24726 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:38.156502 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 505774us
W20260709 12:10:38.159268 22549 leader_election.cc:336] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.896s (SENT)
I20260709 12:10:38.167337 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:38.168010 22580 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:38.169008 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:38.169564 22584 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:38.117640 24438 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.144958 24524 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:38.177201 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 947735us
I20260709 12:10:38.177536 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 1992) took 1265 ms. Trace:
I20260709 12:10:38.178258 21966 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.178139 21920 rpcz_store.cc:276] 0709 12:10:36.912366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.917783 (+  5417us) service_pool.cc:224] Handling call
0709 12:10:36.918025 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.191911 (+273886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.177301 (+985390us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b54002e6154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:38.177482 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127057152}
I20260709 12:10:38.179944 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:38.180454 21966 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:38.188072 22549 leader_election.cc:336] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.012s (SENT)
I20260709 12:10:38.188639 22549 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.189275 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:38.191200 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:38.193048 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.195371 24769 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.195803 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.196789 24726 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:38.197702 24726 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.198221 24726 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:38.198278 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.199641 24726 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.205374 22576 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.208202 21893 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:38.209921 24716 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.190083 22583 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 2.
I20260709 12:10:38.210466 24716 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.210863 24700 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:38.211081 24716 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:38.217590 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.201655 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:38.218757 21920 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.220968 24716 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.201731 24645 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:38.222878 21966 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:38.225116 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 246662us
I20260709 12:10:38.243434 21964 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:38.171156 24740 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.228499 24438 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:38.231307 24610 consensus_meta.cc:287] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.002s
I20260709 12:10:38.223157 24770 consensus_queue.cc:1059] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 12:10:38.239792 24728 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:10:38.243168 24611 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.247437 24645 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.253180 24740 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:38.279183 24774 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:10:38.292366 24645 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:38.294275 24688 raft_consensus.cc:3055] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:38.294759 24688 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:38.295607 24716 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.302937 24714 raft_consensus.cc:3055] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:38.303493 24714 raft_consensus.cc:740] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:38.304545 24714 consensus_queue.cc:260] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.305899 24714 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.309810 24740 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:38.310889 24688 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.313644 24760 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:38.349191 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 453919us
I20260709 12:10:36.030648 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:38.351226 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.355774 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.358089 21815 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.360301 21815 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:38.362761 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.364959 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.367063 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.385161 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 394) took 1596 ms. Trace:
I20260709 12:10:38.387346 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:38.385782 21849 rpcz_store.cc:276] 0709 12:10:36.788475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.791012 (+  2537us) service_pool.cc:224] Handling call
0709 12:10:36.791360 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:36.830489 (+ 39129us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:36.897598 (+ 67109us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.112949 (+215351us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b48000030d8. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be9cc4aa1 00007f3be9cbbb37 00007f3be9cbb9ca 00007f3be9db326f 00007f3be9db2f37 00007f3be9dc755c 00007f3be9dc7508 00007f3be9dc7488 00007f3be9dc7443 00007f3be9dc66ec 00007f3be8cf0a96
0709 12:10:37.394473 (+281524us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:37.407320 (+ 12847us) log.cc:844] Serialized 52 byte log entry
0709 12:10:37.407480 (+   160us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:37.407513 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.384191 (+976678us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b5400208d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:38.384326 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.384484 (+   158us) raft_consensus.cc:1685] finished
0709 12:10:38.384528 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.384917 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143848,"raft.queue_time_us":17018,"raft.run_cpu_time_us":2716,"raft.run_wall_time_us":293184,"spinlock_wait_cycles":76392448,"thread_start_us":467744,"threads_started":1,"wal-append.queue_time_us":605384}
I20260709 12:10:38.388881 21851 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
W20260709 12:10:38.390700 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.393366 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.393615 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.394186 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.395413 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 172979us
I20260709 12:10:38.396337 21921 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:38.400496 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:38.401373 21893 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:38.403195 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:38.403652 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:38.404557 21844 raft_consensus.cc:2410] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:38.404994 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.406242 21851 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:38.406489 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 374) took 1060 ms. Trace:
W20260709 12:10:38.406683 21919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1776) took 1819 ms (client timeout 1799 ms). Trace:
W20260709 12:10:38.407083 21919 rpcz_store.cc:269] 0709 12:10:36.587489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.600550 (+ 13061us) service_pool.cc:224] Handling call
0709 12:10:38.406256 (+1805706us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54001923d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:38.406497 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241406720}
I20260709 12:10:38.406967 21923 rpcz_store.cc:276] 0709 12:10:37.346344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.346520 (+   176us) service_pool.cc:224] Handling call
0709 12:10:37.361083 (+ 14563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.361333 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:37.658058 (+296725us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.405632 (+747574us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:38.405760 (+   128us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:38.405905 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.406064 (+   159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.406274 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":605288,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":137360,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":1031355,"threads_started":3,"wal-append.queue_time_us":431934}
I20260709 12:10:38.408982 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.409992 21919 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:38.410808 21918 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:38.411331 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.400521 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.244791 21966 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:38.402061 21849 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:38.427390 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:38.427985 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.428653 21919 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:38.429679 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.430395 21919 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:38.439324 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:38.449074 21922 raft_consensus.cc:2368] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6.
I20260709 12:10:38.433094 24482 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.448472 24768 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:10:38.462443 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:38.433959 24643 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.463418 22581 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.439553 24171 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:38.447576 21924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1989) took 1536 ms (client timeout 1695 ms). Trace:
I20260709 12:10:38.464396 24171 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:38.464612 21924 rpcz_store.cc:269] 0709 12:10:36.911465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.918345 (+  6880us) service_pool.cc:224] Handling call
0709 12:10:38.447097 (+1528752us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54003e5dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:38.447320 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535443840}
I20260709 12:10:38.466105 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.432550 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 1994) took 1519 ms. Trace:
I20260709 12:10:38.467305 21925 rpcz_store.cc:276] 0709 12:10:36.912907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.918279 (+  5372us) service_pool.cc:224] Handling call
0709 12:10:38.432170 (+1513891us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54001928d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:38.432382 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048337792}
W20260709 12:10:38.468542 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.470446 24171 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.434346 24660 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.471168 24565 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.484329 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:38.485703 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 240875us
I20260709 12:10:38.487418 22581 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
W20260709 12:10:38.490345 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.265774 24610 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.260449 24459 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:38.433676 24508 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:38.434942 24793 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.499912 24793 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.500946 24756 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:38.502208 24759 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:38.502561 24713 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.503055 24759 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.504570 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:38.505244 24688 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.490720 24691 consensus_queue.cc:1059] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:38.433557 24504 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:38.498782 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 69792.6us
I20260709 12:10:38.434226 24469 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.449606 24696 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.508865 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:38.513454 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:38.516227 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.516839 24691 raft_consensus.cc:3055] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:38.517320 24691 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:38.440321 24670 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:10:38.518764 24691 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.521921 22001 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:38.523696 21851 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:38.524626 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:38.525265 21844 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:38.526618 24459 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:38.527231 24459 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.527410 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:38.526669 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:38.529716 21850 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.496454 24508 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.505805 24759 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.540524 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:38.540715 24760 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:38.536590 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 124992us
I20260709 12:10:38.541251 21848 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.506582 24740 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.543254 24726 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.546519 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.537149 24508 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.546589 21852 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.549089 21849 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:38.549747 24766 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.506022 24727 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:38.547073 24726 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.548130 24696 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.555006 24691 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.559569 24696 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.550199 24766 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.554219 24726 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:38.545959 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:38.558257 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59333.8us
I20260709 12:10:38.544490 24740 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:38.545435 24793 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.557835 24759 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.562554 24766 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.570257 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.567428 24740 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.580912 24741 raft_consensus.cc:1064] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
W20260709 12:10:38.581447 24741 raft_consensus.cc:1068] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Unable to promote non-voter ac07267c8cab47d4b59dc27d6fe9a386: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:38.582489 24610 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.613683 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.611735 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:38.614588 21924 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:38.618119 21849 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:38.621569 21852 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:38.623333 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 126168us
I20260709 12:10:38.624737 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:38.626302 24759 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.629523 24759 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.630553 21925 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:38.649298 24508 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.651381 21847 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:38.655369 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 93695.6us
I20260709 12:10:38.664201 21920 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:38.668817 24727 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:38.670739 24760 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:38.671128 24760 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:38.672130 24760 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.673874 24760 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.677134 24524 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:38.679564 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 54979.9us
W20260709 12:10:38.707417 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.691489 24741 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.718380 24228 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.726058 21850 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:38.716256 24726 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:38.732924 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 124395us
I20260709 12:10:38.742600 21848 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
W20260709 12:10:38.744648 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.755877 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 116548us
I20260709 12:10:38.757941 24771 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.758704 24704 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:38.758510 24771 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.759167 24553 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.759402 24704 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.759840 24553 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.761461 24771 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.761919 24704 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:38.762353 24559 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:38.763007 24559 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.765244 24559 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.766500 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:38.766922 22575 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:38.767131 21966 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:38.768116 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:38.768853 22577 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:38.769578 24787 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.767287 22582 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
W20260709 12:10:38.775228 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.783916 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.785058 21892 leader_election.cc:336] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.545s (SENT)
I20260709 12:10:38.785746 24766 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.768781 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.788432 24740 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.786549 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:38.791563 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:38.804427 24793 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:38.802829 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46115.2us
I20260709 12:10:38.798557 24726 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:38.820228 24682 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:38.831561 24682 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.833957 24646 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:10:38.830279 21850 pending_rounds.cc:85] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 4
W20260709 12:10:38.829463 22549 leader_election.cc:336] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.569s (SENT)
I20260709 12:10:38.827193 24787 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.835373 21850 pending_rounds.cc:107] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:10:38.841157 21850 raft_consensus.cc:2889] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:38.828994 24691 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.836572 24682 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.839504 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.847582 24485 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 12:10:38.852193 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 301271us
I20260709 12:10:38.853067 21818 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.844873 24793 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.855232 24696 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:38.855408 24793 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.855850 24696 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:38.852463 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.857024 24696 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.858398 24726 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.858853 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.859108 24756 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:38.852305 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 83717us
I20260709 12:10:38.859790 24756 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:38.860355 21924 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.862012 21966 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.862876 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.859187 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.858888 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.865406 21920 raft_consensus.cc:2410] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:38.864468 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:38.866582 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 308897us
I20260709 12:10:38.868697 22581 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:38.868979 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:38.853120 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.870349 24635 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.870855 21923 raft_consensus.cc:2410] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:38.870991 24635 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:38.873383 24635 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:38.873775 24660 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:38.873893 24635 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:38.839040 24508 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:38.895008 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.924247 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:38.924696 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.924944 22581 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:38.925786 24438 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.581s	user 0.015s	sys 0.000s
I20260709 12:10:38.926431 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:38.926621 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 197963us
I20260709 12:10:38.927814 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.928496 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.927337 21922 raft_consensus.cc:2368] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7.
I20260709 12:10:38.837565 24459 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.879905 24635 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.938890 24553 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:38.939894 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.939967 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.941092 24766 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:38.941045 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:38.941967 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 77804.4us
I20260709 12:10:38.938782 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:38.939006 21918 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:38.874701 24513 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.930116 24793 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.958035 24635 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:38.972148 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 106143us
I20260709 12:10:38.921494 21750 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 4 to 5, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 5 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:38.957914 24688 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.975744 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.971024 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:38.983467 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.984467 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:38.973033 24714 consensus_meta.cc:287] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.008s
I20260709 12:10:38.986346 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.974762 24643 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.995275 21920 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:38.992324 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 97461.1us
I20260709 12:10:38.998096 21966 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:38.998675 21747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58722 (request call id 271) took 11027 ms. Trace:
I20260709 12:10:38.996404 21925 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:39.006810 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:39.007943 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:38.980051 24766 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.981405 24610 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.970870 24485 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:39.024454 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 226897us
I20260709 12:10:38.954603 24660 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:38.996567 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:39.027678 21926 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:39.021406 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:39.039746 21925 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:39.048038 21918 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
I20260709 12:10:39.047315 21922 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:39.024056 24740 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:39.065727 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44757.4us
I20260709 12:10:38.990926 24688 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.065120 24710 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.061437 24565 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:39.083833 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 117153us
I20260709 12:10:39.068701 24600 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.081375 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 370) took 1672 ms. Trace:
I20260709 12:10:39.047746 24513 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:39.095750 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.096251 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.086323 21923 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:39.077726 24793 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.100293 21925 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:39.058764 24610 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.117086 21920 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:39.127720 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 128300us
I20260709 12:10:39.092669 24485 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.134145 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:39.092592 21927 rpcz_store.cc:276] 0709 12:10:37.298370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.298540 (+   170us) service_pool.cc:224] Handling call
0709 12:10:38.453309 (+1154769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.454050 (+   741us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:38.454076 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:38.454982 (+   906us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.482770 (+ 27788us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:38.482807 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.495038 (+ 12231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.634473 (+139435us) raft_consensus.cc:1685] finished
0709 12:10:38.634492 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.943116 (+308624us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003e5dd0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:38.970638 (+ 27522us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8470,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":286,"spinlock_wait_cycles":2630922624,"thread_start_us":27214,"threads_started":1,"wal-append.queue_time_us":163301}
I20260709 12:10:39.140872 21920 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:39.142132 22547 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:39.142958 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 207358us
I20260709 12:10:39.146449 21923 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:39.086761 24766 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:10:39.158679 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.140295 24485 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:39.167820 21892 leader_election.cc:336] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.934s (SENT)
I20260709 12:10:39.169323 22547 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:38.999161 21747 rpcz_store.cc:276] 0709 12:10:27.971294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.010506 (+ 39212us) service_pool.cc:224] Handling call
0709 12:10:38.998439 (+10987933us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:33.078353 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:33.079318 (+   965us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:33.079388 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:10:33.079417 (+    29us) tablet.cc:662] Decoding operations
0709 12:10:33.081918 (+  2501us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:33.082051 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:33.082104 (+    53us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:10:33.774603 (+692499us) tablet.cc:701] Row locks acquired
0709 12:10:33.793355 (+ 18752us) write_op.cc:260] PREPARE: finished
0709 12:10:33.804600 (+ 11245us) write_op.cc:270] Start()
0709 12:10:33.804751 (+   151us) write_op.cc:276] Timestamp: P: 1783599033804526 usec, L: 0
0709 12:10:33.804774 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:33.805549 (+   775us) log.cc:844] Serialized 8181 byte log entry
0709 12:10:34.264135 (+458586us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be1c910ac 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b
0709 12:10:35.082994 (+818859us) op_driver.cc:464] REPLICATION: finished
0709 12:10:35.149391 (+ 66397us) write_op.cc:301] APPLY: starting
0709 12:10:35.149518 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:35.152042 (+  2524us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:35.152080 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:35.397736 (+245656us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:35.398175 (+   439us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:10:35.409837 (+ 11662us) write_op.cc:312] APPLY: finished
0709 12:10:35.434734 (+ 24897us) log.cc:844] Serialized 145 byte log entry
0709 12:10:35.434948 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:35.435131 (+   183us) write_op.cc:454] Released schema lock
0709 12:10:35.435203 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:35.442897 (+  7694us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:35.442944 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":64410,"apply.run_cpu_time_us":7507,"apply.run_wall_time_us":293468,"num_ops":21,"prepare.queue_time_us":235878,"prepare.run_cpu_time_us":36126,"prepare.run_wall_time_us":1593913,"raft.queue_time_us":311244,"raft.run_cpu_time_us":21695,"raft.run_wall_time_us":106839,"replication_time_us":1243756,"spinlock_wait_cycles":15306624,"thread_start_us":1299935,"threads_started":4,"wal-append.queue_time_us":755330,"wal-append.run_cpu_time_us":26660,"wal-append.run_wall_time_us":1871372}]]}
I20260709 12:10:39.149809 24553 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.172747 21750 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 3 to 5, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 5 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.158728 24459 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:39.182363 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.179407 22549 leader_election.cc:336] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.969s (SENT)
I20260709 12:10:39.128026 24565 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.191079 22581 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:39.173146 24485 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.191067 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 48169.4us
I20260709 12:10:39.192590 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:39.196033 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:39.179077 24553 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.144634 24793 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.128175 24600 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.203584 21750 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 4 to 5, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 5 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.195062 24814 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.205181 24553 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:39.223040 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 68501.5us
W20260709 12:10:39.226022 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 229553us
I20260709 12:10:39.222954 21967 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:39.233717 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:39.213426 24704 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.235571 24704 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:39.237761 24808 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 12:10:39.237901 24704 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.239269 24600 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:39.226951 24768 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.242588 24688 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:39.243844 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 68191.4us
I20260709 12:10:39.248631 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:39.249233 24665 raft_consensus.cc:2764] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:39.250116 24665 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:39.251206 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.250240 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:39.237788 24513 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:39.230294 24772 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:39.230695 24660 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:39.230284 24482 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:39.261683 21892 leader_election.cc:336] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.998s (SENT)
I20260709 12:10:39.265030 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:39.265513 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.271975 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.261694 24772 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.259871 24768 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:39.261456 24459 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.279356 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.279246 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.264716 24482 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:39.276032 24821 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
W20260709 12:10:39.284705 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 113726us
I20260709 12:10:39.279148 24824 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.230235 24815 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:10:39.286657 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:39.288501 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:39.292155 24760 consensus_meta.cc:287] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.618s	user 0.014s	sys 0.003s
I20260709 12:10:39.293164 24824 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:39.294776 24816 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:10:39.297699 24817 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:39.298609 24799 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.299062 24793 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:39.289822 24482 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.302717 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 52620.8us
I20260709 12:10:39.282298 24772 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:39.287776 24768 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.319701 24610 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:39.325238 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.325299 24818 raft_consensus.cc:1064] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:10:39.326018 21998 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:39.277925 21750 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.285589 24459 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.326856 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.311022 22581 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:39.335146 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 148461us
I20260709 12:10:39.314540 24824 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.327397 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.335425 22577 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.303303 24565 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:39.353636 21815 leader_election.cc:400] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7.
I20260709 12:10:39.354193 21815 leader_election.cc:403] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:10:39.335427 24818 raft_consensus.cc:1068] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Unable to promote non-voter ac07267c8cab47d4b59dc27d6fe9a386: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:39.335505 22575 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.358067 24646 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 12:10:39.380074 21892 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.874s (SENT)
I20260709 12:10:39.360710 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.362196 24829 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.362825 24832 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.363391 24820 log.cc:927] Time spent T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
I20260709 12:10:39.366613 24768 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:39.384773 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.372236 24485 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:39.341466 24459 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.348884 21750 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 1 to 5, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 5 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.359025 21893 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:39.367151 21994 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.340867 24682 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.396014 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:39.400192 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 68425.1us
W20260709 12:10:39.402547 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 64498.7us
I20260709 12:10:39.403460 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:39.405813 24610 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.383785 24799 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7.
I20260709 12:10:39.409328 24635 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:39.410548 24829 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:39.413281 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.414595 21998 raft_consensus.cc:2410] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:39.414779 24829 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:39.411572 24485 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:39.417811 24635 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:39.418540 24635 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.419139 24635 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.421592 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:39.438553 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 86610.5us
I20260709 12:10:39.439320 21843 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:39.443872 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:39.445127 21924 raft_consensus.cc:2410] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:39.412904 21994 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:39.421779 24635 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:39.412492 24835 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:10:39.453469 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 50114.5us
I20260709 12:10:39.455519 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:39.403364 21750 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 5, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 5 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.458158 22582 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:10:39.468353 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.476537 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:39.476711 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.477809 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:39.479487 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 78256.4us
I20260709 12:10:39.480783 21847 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:39.481271 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.482661 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.486541 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:39.472580 24691 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.003s
I20260709 12:10:39.481068 21750 catalog_manager.cc:5697] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 1 to 4, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 4 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.490729 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.497032 21845 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:39.497215 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:39.497965 21927 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:39.499140 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.501368 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:39.495584 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.446736 24553 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.503638 21925 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.503760 22001 raft_consensus.cc:2410] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:39.504107 21815 leader_election.cc:400] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6.
W20260709 12:10:39.504782 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.490492 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:39.509369 21999 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:39.506278 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:39.513017 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:39.513512 21996 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:39.508581 24829 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:39.514696 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:39.515398 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.515487 21851 raft_consensus.cc:2376] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8. Re-sending same reply.
I20260709 12:10:39.515913 24829 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:39.516073 21843 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:39.516572 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.516474 24829 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:39.517289 21851 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:39.514885 21847 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:39.484886 24818 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:39.514346 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.518828 24818 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.521530 24818 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:39.477284 24809 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.525010 21964 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:39.525879 24740 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.498202 24691 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.527174 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.504674 21750 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.526569 24740 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.554502 21852 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:39.558071 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.558672 21994 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:39.563338 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 66686.7us
I20260709 12:10:39.564599 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.565155 21925 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:39.565505 22576 raft_consensus.cc:2410] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:39.519539 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.575141 21964 leader_election.cc:400] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7.
I20260709 12:10:39.575568 21964 leader_election.cc:403] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:39.580888 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:39.582579 21921 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:39.584442 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.585588 22576 raft_consensus.cc:2410] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:39.587755 21844 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:10:39.592322 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:39.514396 24682 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:39.580260 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.596653 22001 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.599740 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.600373 22001 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:39.598555 22580 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:10:39.602394 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:39.568535 24793 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.607317 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.603716 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.609463 21994 raft_consensus.cc:2410] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:39.611940 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:39.613801 21998 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.614737 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:39.616156 21999 raft_consensus.cc:2393] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:39.617317 21920 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.597139 24818 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.623502 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:39.624186 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:39.634932 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:39.639804 24482 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:39.641594 21848 raft_consensus.cc:2368] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:39.644889 22575 raft_consensus.cc:2410] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:39.646593 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.646824 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.653053 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:39.657800 24810 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.658663 24831 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:39.659458 24831 raft_consensus.cc:697] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:39.660856 24831 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.662487 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:39.663429 21846 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
W20260709 12:10:39.664696 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 173512us
I20260709 12:10:39.665599 24682 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:39.665903 22576 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:39.665757 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:39.666220 24682 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.666646 21750 catalog_manager.cc:5697] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.668537 24682 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:39.670756 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:39.671875 24696 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:39.672605 24696 consensus_queue.cc:1059] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:39.673614 24696 raft_consensus.cc:3055] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:39.673957 24696 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:39.611613 24829 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:39.674156 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 109671us
I20260709 12:10:39.675127 24829 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.676101 24829 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:39.676226 21964 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:39.676750 24829 consensus_queue.cc:1243] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:39.680917 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:39.683030 24809 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.683383 24809 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:39.683310 24665 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:39.684085 24809 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.684852 24665 raft_consensus.cc:3055] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.685351 24665 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:39.687903 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.688704 24710 consensus_queue.cc:1059] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:39.689585 24799 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:39.689917 24799 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:39.690665 24799 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:39.693149 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.694641 24815 consensus_queue.cc:1059] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:39.694813 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.695590 24815 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.696354 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.697000 24482 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:39.669113 21750 catalog_manager.cc:5697] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 3 to 5, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 5 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.697644 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.698206 22577 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:39.698833 24459 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:39.702637 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 100653us
I20260709 12:10:39.703395 21818 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:39.704453 24482 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:39.704815 24809 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.626272 24793 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.708220 24710 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:39.708539 24793 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:39.709246 24513 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:39.710062 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.696444 24815 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:39.710810 22001 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:39.695657 24799 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.677933 21964 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:39.714028 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 43692.7us
I20260709 12:10:39.719975 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:39.736037 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 58235.8us
I20260709 12:10:39.738281 24553 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:39.736847 21964 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:39.739938 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:39.742489 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 425206us
I20260709 12:10:39.678128 24829 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 12:10:39.745831 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.712327 24815 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:39.762913 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.762864 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.737159 24482 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.705873 24772 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:39.767606 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 47727.5us
I20260709 12:10:39.762116 22577 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:39.625370 24691 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 12:10:39.786098 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:39.760494 24756 consensus_meta.cc:287] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.900s	user 0.009s	sys 0.005s
I20260709 12:10:39.801002 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.803771 21999 raft_consensus.cc:2410] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:39.809254 21995 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:39.839740 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:39.810760 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 65957.3us
I20260709 12:10:39.814793 21818 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:39.822897 21997 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:39.824669 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.766964 24740 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:39.739697 24704 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.770085 24485 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.830267 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.826314 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:39.834641 22549 leader_election.cc:336] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.641s (SENT)
I20260709 12:10:39.851559 22001 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:39.851821 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:39.853241 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 145699us
I20260709 12:10:39.854256 21818 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:39.837596 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:39.844255 21999 raft_consensus.cc:2410] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:39.849726 22583 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:39.758889 24824 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.846702 21994 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:39.726789 24665 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:39.885053 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:39.885103 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.886650 21995 raft_consensus.cc:2368] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7.
I20260709 12:10:39.857645 21998 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:39.878996 22000 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
W20260709 12:10:39.882977 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 52738.1us
I20260709 12:10:39.888415 24553 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.878113 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:39.859118 24815 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:39.897931 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.898180 24459 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:39.774750 24696 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.880576 24810 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.850961 24485 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.913352 21997 raft_consensus.cc:2410] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:10:39.902802 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 348552us
I20260709 12:10:39.829761 24726 consensus_queue.cc:1059] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:10:39.967383 24485 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.967751 22578 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:39.960989 24787 consensus_queue.cc:1175] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" responder_term: 6 status { last_received { term: 6 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 6 index: 8 } }
I20260709 12:10:39.968713 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.957695 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:39.969543 22000 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:39.824402 24756 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:39.971609 24756 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:39.972402 24459 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.972879 24459 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:39.973311 24459 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.980249 24824 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:39.981050 24824 consensus_queue.cc:1059] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.986917 24696 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.831691 24766 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
W20260709 12:10:39.990024 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.960099 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:39.932910 24809 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:39.889042 24710 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:39.934456 24832 consensus_meta.cc:287] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.546s	user 0.003s	sys 0.007s
I20260709 12:10:40.003727 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:39.935122 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 143562us
I20260709 12:10:39.994683 21994 raft_consensus.cc:2368] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5.
I20260709 12:10:39.966277 21893 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:40.010686 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:39.887852 24740 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.957801 24513 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:39.990379 24704 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:39.994174 24665 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.033428 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:40.037111 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.041828 21921 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.014221 24818 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7.
I20260709 12:10:40.013124 24815 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.044250 21918 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:40.045444 21844 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:40.019219 24756 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:40.042371 21921 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:40.049724 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:40.019399 24832 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.018939 24740 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.057168 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:40.024693 24809 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:40.065519 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:40.068957 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 395283us
I20260709 12:10:40.069169 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:40.045933 24691 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.073742 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:40.039654 24810 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:40.060657 24756 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.080113 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:40.082166 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:40.059252 21921 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:40.078763 24849 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.091565 24772 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:40.067740 24818 raft_consensus.cc:3055] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:40.099946 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 247911us
I20260709 12:10:40.101006 21921 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.108189 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:40.109462 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.094739 24756 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:40.118191 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.071347 24809 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:40.143745 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:40.098929 24818 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:40.146142 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.110378 24610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.016s	sys 0.006s
I20260709 12:10:40.159631 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:40.082865 24691 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.159715 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:40.091226 24810 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:40.165473 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:40.161916 21844 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 3.
W20260709 12:10:40.166456 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 96474.9us
I20260709 12:10:40.166446 21846 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
W20260709 12:10:40.160116 24610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.017s	sys 0.006s
W20260709 12:10:40.164408 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 246562us
W20260709 12:10:40.174873 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 263667us
W20260709 12:10:40.176131 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.175211 24772 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:40.176929 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:40.180074 22549 leader_election.cc:336] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.239s (SENT)
I20260709 12:10:40.180999 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:40.090240 24849 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.201861 24849 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:40.182422 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 356147us
I20260709 12:10:40.183471 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:40.205470 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:40.184057 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:40.187570 21996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.013s	sys 0.007s
W20260709 12:10:40.208184 21996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.013s	sys 0.007s
I20260709 12:10:40.209900 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:40.223155 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 47126.8us
I20260709 12:10:40.169298 24610 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:40.226567 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:40.231323 21994 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:40.233919 24726 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:40.235564 24726 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:40.233953 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:40.238587 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:40.241223 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:40.237636 21844 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
W20260709 12:10:40.225749 24846 log.cc:927] Time spent T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:10:40.247210 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:40.247848 21852 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.248148 22000 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:40.219956 24710 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.249367 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:40.229621 24860 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:40.306928 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 205818us
I20260709 12:10:40.252879 24809 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:40.308777 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:40.309512 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:40.311914 22000 raft_consensus.cc:2410] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:40.313199 21849 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:40.259068 24860 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:40.343098 24846 log.cc:927] Time spent T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:10:40.352427 21921 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:40.352991 21815 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:40.353591 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:40.354493 24822 consensus_queue.cc:1059] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 12:10:40.220196 24818 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.311208 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:40.357276 21846 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:40.375062 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:10:40.377285 24863 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:40.386531 24841 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:40.387182 24841 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:40.419823 24836 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.797s	user 0.005s	sys 0.000s
I20260709 12:10:40.422515 24787 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.423121 24787 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:40.425998 24833 log.cc:927] Time spent T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.851s	user 0.000s	sys 0.004s
I20260709 12:10:40.428246 24610 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:40.434535 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.439664 24691 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:40.441170 24860 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.442595 24860 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.443591 24818 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.449062 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:40.356371 24864 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.450847 24864 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.451161 24864 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.451527 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 589) took 1153 ms. Trace:
I20260709 12:10:40.451885 22578 rpcz_store.cc:276] 0709 12:10:39.297801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.303415 (+  5614us) service_pool.cc:224] Handling call
0709 12:10:39.316777 (+ 13362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.968228 (+651451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.451295 (+483067us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400070654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:40.451452 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177906560}
I20260709 12:10:40.453420 24832 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:40.454012 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 393) took 1013 ms. Trace:
I20260709 12:10:40.454383 21923 rpcz_store.cc:276] 0709 12:10:39.440995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.441136 (+   141us) service_pool.cc:224] Handling call
0709 12:10:39.441438 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.441653 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:39.753971 (+312318us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.110646 (+356675us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.453109 (+342463us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b1800050ec0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be4d93060 00007f3be4da5716 00007f3be4db6287 00007f3be4db6208
0709 12:10:40.453431 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.453612 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:40.453655 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:40.453708 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.453770 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.453951 (+   181us) inbound_call.cc:177] Queueing success response
0709 12:10:40.454011 (+    60us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b1800050ec0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c7c2a6 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1
0709 12:10:40.454524 (+   513us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b1800050ec0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
Metrics: {"mutex_wait_us":355922,"prepare.queue_time_us":322084,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":92,"raft.queue_time_us":355620,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":8495,"spinlock_wait_cycles":93911936,"thread_start_us":658675,"threads_started":2,"wal-append.queue_time_us":493527}
W20260709 12:10:40.455166 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 282651us
I20260709 12:10:40.455875 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 386) took 1520 ms. Trace:
I20260709 12:10:40.475147 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:40.480517 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 105507us
I20260709 12:10:40.481580 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:40.483065 21848 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:40.489969 21852 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:40.491791 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:40.460191 21926 rpcz_store.cc:276] 0709 12:10:38.935407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.065816 (+130409us) service_pool.cc:224] Handling call
0709 12:10:39.080826 (+ 15010us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.186590 (+105764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:39.186622 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:39.204195 (+ 17573us) log.cc:844] Serialized 26 byte log entry
0709 12:10:39.390464 (+186269us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:39.390506 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.521441 (+130935us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b54003e71d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:39.521494 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.631392 (+109898us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b48000627d8. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be9cc4aa1 00007f3be9cbbb37 00007f3be9cbb9ca 00007f3be9db326f 00007f3be9db2f37 00007f3be9dc755c 00007f3be9dc7508 00007f3be9dc7488 00007f3be9dc7443 00007f3be9dc66ec 00007f3be8cf0a96
0709 12:10:40.419196 (+787804us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:40.455696 (+ 36500us) raft_consensus.cc:1685] finished
0709 12:10:40.455715 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.455825 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16892,"raft.queue_time_us":35997,"raft.run_cpu_time_us":4440,"raft.run_wall_time_us":565125,"spinlock_wait_cycles":619551872,"thread_start_us":214733,"threads_started":2,"wal-append.queue_time_us":402928}
I20260709 12:10:40.492553 22583 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.456255 24822 consensus_queue.cc:1243] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:40.531751 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:40.532547 21996 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:10:40.534991 24766 raft_consensus.cc:3055] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.535394 24766 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:40.536226 24766 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.537685 24766 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.538687 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:40.539989 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 58517.8us
W20260709 12:10:40.476182 24485 consensus_meta.cc:287] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
W20260709 12:10:40.488808 24482 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.714s	user 0.003s	sys 0.007s
W20260709 12:10:40.529106 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.531248 24862 log.cc:927] Time spent T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:10:40.553965 24726 consensus_queue.cc:1059] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:40.554971 24822 raft_consensus.cc:3055] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:40.555349 24822 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:40.556212 24822 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.472818 24841 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:40.527868 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:40.479485 24513 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:40.488574 24459 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.006s
I20260709 12:10:40.473882 24710 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:40.525472 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:40.582113 22578 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.581720 21846 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:10:40.552294 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.552696 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 65383us
I20260709 12:10:40.569051 21852 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:40.578562 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:40.553225 24850 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.287s	user 0.003s	sys 0.003s
I20260709 12:10:40.585069 21996 raft_consensus.cc:2376] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7. Re-sending same reply.
W20260709 12:10:40.561111 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.559111 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:40.581969 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:40.581691 24513 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.550269 24866 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:40.582432 21848 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.539291 22584 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:40.586472 21994 raft_consensus.cc:2410] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:10:40.565218 24799 consensus_meta.cc:287] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.840s	user 0.006s	sys 0.005s
I20260709 12:10:40.564831 24696 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.607328 21893 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:40.542646 24485 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:40.609501 22582 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:40.586385 24513 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.560102 24482 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:40.612264 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.614435 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2026) took 1135 ms. Trace:
I20260709 12:10:40.614823 24810 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:40.615540 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:40.616351 24740 consensus_meta.cc:287] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.000s
I20260709 12:10:40.583071 24688 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 12:10:40.618829 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.591137 22575 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:40.632907 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:40.568955 24635 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:10:40.591738 24841 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:10:40.629840 21924 rpcz_store.cc:276] 0709 12:10:39.479476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.484783 (+  5307us) service_pool.cc:224] Handling call
0709 12:10:39.500727 (+ 15944us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.893565 (+392838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:39.893609 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:39.983295 (+ 89686us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.257106 (+273811us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:40.307687 (+ 50581us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.551427 (+243740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.551500 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.614216 (+ 62716us) raft_consensus.cc:1685] finished
0709 12:10:40.614235 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.614362 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":243474,"prepare.queue_time_us":50741,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":323015,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":3049,"thread_start_us":646485,"threads_started":2,"wal-append.queue_time_us":611763}
W20260709 12:10:40.639176 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 330309us
I20260709 12:10:40.641448 21850 raft_consensus.cc:2410] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:40.589776 24459 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.586625 24832 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:10:40.627807 24818 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:40.647001 21998 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:40.683501 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:40.627584 24851 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.645162 21818 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:40.689927 21964 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:40.694664 21893 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:40.637836 24829 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 12:10:40.642364 24665 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
W20260709 12:10:40.699385 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 158155us
I20260709 12:10:40.644202 24772 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.679857 24866 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.680264 24482 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.701963 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 56877.8us
I20260709 12:10:40.643967 24855 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:40.683252 24818 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:40.694878 24851 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.637980 24740 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:40.699822 24853 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:40.718551 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 85721.2us
I20260709 12:10:40.727607 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:40.690760 21846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:40.702327 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:40.751734 21846 raft_consensus.cc:606] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:40.701767 24710 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:40.757999 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 44186.7us
I20260709 12:10:40.719563 24855 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:40.759122 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56878.3us
I20260709 12:10:40.769035 21818 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:40.769381 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 311923us
I20260709 12:10:40.769696 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:40.774788 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.722095 24851 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.726583 24853 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.784870 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:40.787025 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:40.723459 24874 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:40.791241 24842 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.791781 24842 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:40.792128 24842 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.793210 21994 raft_consensus.cc:2393] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:40.710341 24713 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 12:10:40.794950 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 77202.4us
I20260709 12:10:40.768231 24876 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.802542 22584 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:40.774663 24714 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.722514 24866 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.718631 24482 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.775578 24855 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.768169 24831 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:40.794713 22575 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:40.752352 24772 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:10:40.791311 24845 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.691s	user 0.003s	sys 0.014s
I20260709 12:10:40.796674 24853 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.795424 24810 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.784677 24878 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.820508 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:40.787060 24879 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.848327 21999 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:40.838042 22583 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:40.846623 22578 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:40.852591 21966 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:40.805110 24882 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.801648 24881 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.851191 21967 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:40.858620 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:40.863250 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 173392us
W20260709 12:10:40.870860 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 51967.2us
I20260709 12:10:40.795040 24818 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.815713 24714 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.804242 24874 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.853884 24710 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 12:10:40.925164 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 90629.9us
I20260709 12:10:40.903991 24610 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.868542 24665 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:10:40.912425 24704 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:40.937249 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:40.937247 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:40.927501 24873 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:10:40.940745 21845 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:40.944659 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:40.945299 21847 raft_consensus.cc:606] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:40.852399 24878 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:40.938700 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 142092us
W20260709 12:10:40.940114 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 135704us
I20260709 12:10:40.945749 21847 raft_consensus.cc:614] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:40.854245 24831 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.920135 24799 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.919835 24818 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:40.937815 24815 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.875s	user 0.011s	sys 0.000s
I20260709 12:10:40.977653 24815 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.978693 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:40.979844 24713 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:40.980358 24713 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:40.982836 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:40.986606 24799 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:40.987766 24870 log.cc:927] Time spent T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:10:40.922973 24459 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:40.992379 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:40.921298 24877 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.925032 24879 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:40.931501 24610 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:40.975672 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 124615us
I20260709 12:10:40.944511 24848 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:40.976814 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:40.989780 21995 raft_consensus.cc:2410] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:40.936411 24881 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:40.992552 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:40.946307 24889 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.978137 24815 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.002000 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:40.948154 24704 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.020031 24815 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:41.020737 24704 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.021505 24704 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:41.022907 24880 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:10:41.025218 24815 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.007705 24787 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:41.026187 24787 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:40.991499 24841 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:41.028496 24841 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:41.009539 24864 consensus_meta.cc:287] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.001s
I20260709 12:10:41.030705 24864 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.031411 24841 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.032752 24864 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:41.012462 24696 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:41.015131 24886 log.cc:927] Time spent T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:41.015300 24831 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:41.015900 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46080us
I20260709 12:10:41.016466 24832 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.003494 24879 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.002064 24610 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.034296 24714 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:41.035037 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:41.035780 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:41.080871 22575 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.037443 24822 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.044994 24513 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.004390 24901 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:41.010812 24482 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:41.050805 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.002216 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 137984us
I20260709 12:10:41.085076 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:40.982352 24713 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:41.058385 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:41.047384 24848 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.001235 24824 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:40.995488 24829 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:41.025034 24842 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.077571 21848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:41.098831 21848 raft_consensus.cc:606] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:41.099176 21848 raft_consensus.cc:614] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:41.094271 21817 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:41.099855 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:41.100387 21918 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.083439 21849 raft_consensus.cc:2410] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:10:41.055223 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 202716us
I20260709 12:10:41.085345 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.086241 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:41.087185 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.101492 21926 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:41.085129 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.101657 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:41.088052 21921 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:41.090317 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.088953 22582 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:41.046908 24459 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:10:41.070118 24849 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:41.096346 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:41.105890 22583 raft_consensus.cc:2393] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:41.075106 24815 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:41.101540 22584 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.082703 24841 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:41.000844 24877 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.109445 21818 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:41.115692 24815 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.119021 24841 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.119594 24848 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:41.121178 24878 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:41.121277 21918 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
W20260709 12:10:41.121786 24766 consensus_meta.cc:287] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.005s
I20260709 12:10:41.093277 24832 raft_consensus.cc:697] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:41.132148 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:41.122407 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:41.122871 24904 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:41.123088 24893 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:10:41.124140 24874 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:41.124675 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.151326 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50145.6us
I20260709 12:10:41.125227 24513 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.125381 22580 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.126706 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:41.139350 21817 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:41.142590 22584 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:41.154274 22582 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.165632 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:41.102589 24866 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:41.173410 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.174894 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.180393 21918 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:41.177625 22575 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:41.182929 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:41.184363 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:41.185127 22584 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:41.130744 24824 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.188220 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:41.121495 24841 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:41.103163 24829 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.113404 24901 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:41.151140 24799 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:41.179229 24696 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.201349 24696 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.201558 24874 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:41.201754 24696 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:41.194790 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 94629.7us
W20260709 12:10:41.193883 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 201561us
I20260709 12:10:41.110838 24849 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.195341 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:41.211221 24485 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:41.212037 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 58968.4us
I20260709 12:10:41.154827 24881 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.214208 24853 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.215420 24901 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.206804 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:41.178999 24635 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.217519 21918 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.217904 21966 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:41.185197 24810 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.225826 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:41.235816 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.236567 21848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:41.238078 21848 raft_consensus.cc:606] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
W20260709 12:10:41.238157 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.238498 21848 raft_consensus.cc:614] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:41.241850 24879 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.243278 24740 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:41.244024 24740 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.246569 24877 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.237051 24841 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.247432 24841 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:41.229364 24635 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:41.247859 24841 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.248116 24635 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.249357 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:41.253916 21918 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:41.254328 22549 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:41.262425 21919 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:41.218489 24874 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:41.195143 24824 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:41.237574 24860 consensus_meta.cc:287] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.795s	user 0.007s	sys 0.005s
W20260709 12:10:41.271366 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 53540.8us
I20260709 12:10:41.275790 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:41.282699 21966 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:41.272222 24810 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:41.253427 24876 consensus_queue.cc:1059] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:10:41.291195 24876 raft_consensus.cc:3055] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.291566 24876 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:41.327061 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47373.4us
I20260709 12:10:41.327898 21966 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:41.292712 24876 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.332789 24876 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.335019 24911 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:41.335649 24756 consensus_meta.cc:287] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.172s	user 0.012s	sys 0.000s
I20260709 12:10:41.336171 24756 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.337193 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:41.338665 21927 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
W20260709 12:10:41.339138 24906 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:41.339599 24907 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.276949 24851 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.344583 24851 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:41.345726 24842 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.338227 24756 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:41.347002 24874 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.283996 24860 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.284076 24793 raft_consensus.cc:2764] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:10:41.396142 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 120417us
I20260709 12:10:41.397301 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:41.397466 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 167135us
I20260709 12:10:41.399501 24829 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:41.398532 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 134028us
I20260709 12:10:41.406009 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:41.389484 24855 consensus_meta.cc:287] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.005s
W20260709 12:10:41.408005 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 56053.5us
I20260709 12:10:41.409257 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:41.409464 21852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:41.404999 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:41.410081 21852 raft_consensus.cc:606] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:41.412566 21852 raft_consensus.cc:614] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:41.350807 24831 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.415736 21966 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:41.416373 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.394196 24882 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.335700 24911 raft_consensus.cc:697] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:41.499357 24871 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.500018 24911 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.500700 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:41.501860 22582 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:41.448571 24888 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.417s	user 0.004s	sys 0.000s
I20260709 12:10:41.413565 24714 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:41.455895 24907 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:41.456620 24849 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.406246 24726 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:41.457391 24917 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:41.459517 22547 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:41.464224 24829 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:41.464462 24904 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.465428 24824 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:41.465977 24912 consensus_queue.cc:1059] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:41.276259 24832 consensus_queue.cc:237] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.401041 24740 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.402963 24866 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:41.469265 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 50396.2us
I20260709 12:10:41.471238 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:41.394325 24809 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.511999 24907 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.487279 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:41.489862 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.491466 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.400372 24810 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.497599 24882 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.532033 24829 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:41.518947 21892 leader_election.cc:336] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.246s (SENT)
I20260709 12:10:41.416756 24815 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
W20260709 12:10:41.510939 24818 consensus_meta.cc:287] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.002s
W20260709 12:10:41.542666 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 83237.3us
W20260709 12:10:41.484499 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 68863.3us
I20260709 12:10:41.511212 24714 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:41.550570 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 148356us
I20260709 12:10:41.568130 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2036) took 1547 ms. Trace:
I20260709 12:10:41.580123 22577 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.579957 21927 rpcz_store.cc:276] 0709 12:10:40.021081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.062344 (+ 41263us) service_pool.cc:224] Handling call
0709 12:10:40.081819 (+ 19475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.339053 (+1257234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.567887 (+228834us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000500d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:41.568073 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889907072}
I20260709 12:10:41.568095 21919 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.483505 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:41.416096 24855 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:41.582307 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 98916.9us
I20260709 12:10:41.571144 21924 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:41.517213 24831 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:41.575882 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:41.573179 24829 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:41.549856 24740 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.576998 21966 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:41.541474 24726 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.600060 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.575536 24907 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.551749 24809 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.582114 24714 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:41.637782 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.642189 24909 log.cc:927] Time spent T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:10:41.649554 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.651878 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:41.570144 24881 consensus_queue.cc:1059] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:41.591589 24740 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.585078 24904 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.639933 21923 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:41.646695 24897 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.678580 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 101730us
W20260709 12:10:41.683786 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 103859us
W20260709 12:10:41.685328 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 108410us
I20260709 12:10:41.687716 21918 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:41.697240 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:41.697890 24853 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:41.698237 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 186913us
I20260709 12:10:41.700847 24930 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.702556 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:41.704377 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:41.584623 24610 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:41.721725 21966 leader_election.cc:400] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:41.688117 24889 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.725178 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:41.726955 24855 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.656592 24920 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.655897 24841 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.733237 24726 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:41.716073 24904 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:41.743440 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:41.735205 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:41.736522 24766 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:41.719008 21892 connection.cc:256] RPC call timeout handler was delayed by -1.7819091300000309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 12:10:41.738641 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:41.739053 24882 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.740291 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:41.740942 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:41.742398 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.750089 21919 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:41.731170 24831 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.734992 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:41.691382 24635 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.769315 21920 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:41.884059 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:41.885916 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 189617us
I20260709 12:10:41.884837 21996 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:41.864168 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:41.886888 21848 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:41.887710 21993 raft_consensus.cc:2410] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:10:41.812167 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 59136.7us
W20260709 12:10:41.809842 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 51502.5us
W20260709 12:10:41.885339 21892 connection.cc:256] RPC call timeout handler was delayed by -1.7222420699997656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30360000000000004s for a response
I20260709 12:10:41.885524 21992 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:41.884752 21847 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:41.892297 21892 connection.cc:256] RPC call timeout handler was delayed by -1.6361091300000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 12:10:41.892709 21892 connection.cc:256] RPC call timeout handler was delayed by -1.5920091299999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 12:10:41.893015 21892 connection.cc:256] RPC call timeout handler was delayed by -1.5872420699997747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3186s for a response
I20260709 12:10:41.893090 21999 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:41.893437 21892 connection.cc:256] RPC call timeout handler was delayed by -1.5614091299999018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:10:41.893822 21892 connection.cc:256] RPC call timeout handler was delayed by -1.5549025169998458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2857s for a response
W20260709 12:10:41.894120 21892 connection.cc:256] RPC call timeout handler was delayed by -1.4951113540000733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24620000000000003s for a response
W20260709 12:10:41.894373 21892 connection.cc:256] RPC call timeout handler was delayed by -1.490530384000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 12:10:41.894793 21892 connection.cc:256] RPC call timeout handler was delayed by -1.4582063850000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:10:41.895095 21892 connection.cc:256] RPC call timeout handler was delayed by -1.4379701810000824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2913s for a response
W20260709 12:10:41.896328 21892 connection.cc:256] RPC call timeout handler was delayed by -1.3615085339999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 12:10:41.897017 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:41.898321 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:41.932437 22549 leader_election.cc:336] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.962s (SENT)
I20260709 12:10:41.933071 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:41.935509 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:41.735033 24809 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:41.960251 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 597) took 1188 ms. Trace:
I20260709 12:10:41.960345 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:41.961097 22583 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:41.961429 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:41.962280 21892 connection.cc:256] RPC call timeout handler was delayed by -1.266430383999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2413s for a response
I20260709 12:10:41.744963 24876 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:41.964226 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:41.811712 24482 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.965525 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 67048.5us
I20260709 12:10:41.870751 24459 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.970350 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1172950200000287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
I20260709 12:10:41.970954 21852 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:41.976482 21892 connection.cc:256] RPC call timeout handler was delayed by -1.0749950199999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 12:10:41.963063 22547 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.196s (SENT) [suppressed 42 similar messages]
W20260709 12:10:41.958287 24696 consensus_meta.cc:287] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.756s	user 0.013s	sys 0.007s
I20260709 12:10:41.967543 22581 rpcz_store.cc:276] 0709 12:10:40.772089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.772217 (+   128us) service_pool.cc:224] Handling call
0709 12:10:40.774021 (+  1804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:40.774251 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:40.786529 (+ 12278us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.714218 (+927689us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b18003225a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cab455 00007f3be4d93060 00007f3be4da5716 00007f3be4db6287 00007f3be4db6208
0709 12:10:41.959843 (+245625us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:41.959898 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:41.959954 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.960022 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.960177 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9755,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":7957,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":6782848,"thread_start_us":190445,"threads_started":1}
I20260709 12:10:41.978893 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:41.978278 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:41.981215 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:41.981611 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:41.981838 21993 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:41.981807 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.982337 24459 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.981765 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:41.875185 24513 consensus_queue.cc:1059] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:10:41.983050 21926 raft_consensus.cc:2393] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:41.982034 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:41.964249 24855 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:41.965375 24704 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.004662 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.007642 21997 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:42.008836 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:41.927101 24766 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:42.010262 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.014736 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:42.015580 21918 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.972738 24860 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.931478 24726 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:10:41.944222 24829 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.972589 24871 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.744585 24897 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.025028 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.040326 21844 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:42.025830 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:42.019620 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:42.040205 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:42.035362 21997 raft_consensus.cc:2410] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:41.972506 24815 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 12:10:42.046681 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.046765 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.058037 21926 raft_consensus.cc:2393] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:42.056206 24871 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:42.067838 22582 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.002s
I20260709 12:10:42.068738 22582 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:42.073552 21844 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:42.075635 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.076489 21996 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:41.985461 24482 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:41.978924 24876 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:41.992595 24696 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.080090 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:42.062961 24894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.007s	sys 0.012s
W20260709 12:10:42.078655 24932 log.cc:927] Time spent T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 12:10:42.019035 24855 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.132361 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:42.124985 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 165791us
I20260709 12:10:42.125434 21926 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:42.071602 24930 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.069725 24682 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.040019 24860 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.082918 24936 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:42.138038 21919 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:42.148887 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.149437 21852 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:42.150020 21919 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:42.111793 24894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.008s	sys 0.012s
I20260709 12:10:42.075655 24513 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.204493 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 65064.4us
W20260709 12:10:42.145783 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 213376us
I20260709 12:10:42.133152 21996 raft_consensus.cc:2376] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8. Re-sending same reply.
I20260709 12:10:42.146579 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.205758 21817 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:42.212749 21817 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:42.204629 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 82402.7us
I20260709 12:10:42.214273 21918 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:42.127138 24610 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:42.216313 21817 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:42.227886 21817 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:42.234047 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.237970 21996 raft_consensus.cc:2410] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:10:42.148069 24936 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:42.208735 24877 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.081503 24904 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:42.248479 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.248967 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:42.251747 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.262687 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.240622 24891 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.270303 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.272099 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:42.251652 24946 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.231619 24513 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:42.243572 24635 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:42.290512 21852 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:42.268265 24891 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.248332 24877 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:42.300561 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 65965.1us
W20260709 12:10:42.303205 24943 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:10:42.284106 24931 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 12:10:42.315959 21845 raft_consensus.cc:1240] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.327118 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:42.336002 21849 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1785) took 1759 ms (client timeout 2064 ms). Trace:
I20260709 12:10:42.336265 21996 raft_consensus.cc:2410] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:10:42.336422 21849 rpcz_store.cc:269] 0709 12:10:40.558474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.558813 (+   339us) service_pool.cc:224] Handling call
0709 12:10:42.315596 (+1756783us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400115654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:42.318210 (+  2614us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143157120}
I20260709 12:10:42.339040 24635 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:42.329236 24936 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:42.340972 24635 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:42.326983 24945 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:42.317335 24891 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.290772 24947 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.352931 24897 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.338171 24894 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:42.285327 24946 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:42.407058 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 179252us
I20260709 12:10:42.350741 24945 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.348897 24829 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:42.409253 21999 consensus_meta.cc:287] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.003s
I20260709 12:10:42.416955 21999 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:42.412658 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:42.362452 24696 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.418432 24920 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:42.428968 24740 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.000s
I20260709 12:10:42.416469 24945 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.439180 24810 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:42.439775 24810 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.440368 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:42.441834 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:42.417094 24871 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.445186 24766 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:42.449210 24946 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.413090 24894 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.451834 24894 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.418576 24855 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.463481 24877 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.464463 24877 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:10:42.466120 24877 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:42.466568 24877 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:42.468824 24459 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.469544 24459 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.471308 24714 consensus_meta.cc:287] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.002s
I20260709 12:10:42.476714 24513 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:42.479115 24635 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:42.470130 24459 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.485842 24459 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.429503 24740 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:42.512133 24740 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:42.512952 22000 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:42.431514 24951 log.cc:927] Time spent T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:10:42.472111 24714 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.433708 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 777) took 1033 ms. Trace:
I20260709 12:10:42.491106 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:42.492609 24841 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:42.493667 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1840) took 1277 ms. Trace:
I20260709 12:10:42.537922 22583 rpcz_store.cc:276] 0709 12:10:41.399983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.400141 (+   158us) service_pool.cc:224] Handling call
0709 12:10:41.400443 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.970025 (+569582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.433472 (+463447us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400733054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:42.433649 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230219136}
I20260709 12:10:42.541229 21923 rpcz_store.cc:276] 0709 12:10:41.216738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.249077 (+ 32339us) service_pool.cc:224] Handling call
0709 12:10:42.493442 (+1244365us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400170cd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:42.493596 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881181056}
I20260709 12:10:42.471246 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.498831 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:42.430502 21850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.015s	sys 0.007s
I20260709 12:10:42.500413 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.500510 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.500063 24936 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.556345 24866 raft_consensus.cc:3055] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:42.556833 24866 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:42.558995 21849 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.559319 24848 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:42.560252 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 69257us
I20260709 12:10:42.502293 24855 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:42.560984 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:42.490993 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.562214 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.562995 21852 raft_consensus.cc:2410] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:42.563683 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:42.564085 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.564182 21852 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.505438 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:42.520274 24891 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:42.523638 24933 log.cc:927] Time spent T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.811s	user 0.001s	sys 0.005s
I20260709 12:10:42.501945 21921 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:42.566655 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2046) took 1346 ms. Trace:
I20260709 12:10:42.543332 21927 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:42.568215 24822 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.501222 21893 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:42.568979 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 67806.7us
I20260709 12:10:42.568760 24822 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:42.569407 24928 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.892s	user 0.000s	sys 0.005s
I20260709 12:10:42.570484 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.570704 24824 raft_consensus.cc:3055] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:42.571102 24824 raft_consensus.cc:740] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:42.571866 24824 consensus_queue.cc:260] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.572285 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.573058 22000 raft_consensus.cc:2410] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:42.572841 24824 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:42.573532 24665 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:42.573642 24829 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:42.573915 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.549957 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:42.574569 24688 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:42.574733 21997 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.574977 24688 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:42.557740 24866 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.550496 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1842) took 1062 ms. Trace:
I20260709 12:10:42.575814 21920 rpcz_store.cc:276] 0709 12:10:41.488270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.488459 (+   189us) service_pool.cc:224] Handling call
0709 12:10:41.488859 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.886396 (+397537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.550185 (+663789us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54001a3954. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:42.550404 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644301056}
I20260709 12:10:42.575901 24688 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.577255 24688 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.560174 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.561156 24855 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.572800 24920 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.578485 24855 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:42.578778 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:42.568369 24944 log.cc:927] Time spent T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 12:10:42.578765 24920 raft_consensus.cc:697] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:42.442147 24810 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.579602 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:42.431690 24704 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:42.580143 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:42.579411 21847 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.579392 24855 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.580160 21919 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.581380 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.567107 21922 rpcz_store.cc:276] 0709 12:10:41.220299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.250595 (+ 30296us) service_pool.cc:224] Handling call
0709 12:10:41.250924 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.397266 (+146342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.397302 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.407474 (+ 10172us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.547474 (+140000us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:41.547553 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.548138 (+   585us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.486271 (+938133us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:42.566311 (+ 80040us) raft_consensus.cc:1685] finished
0709 12:10:42.566339 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.566586 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15775,"raft.queue_time_us":42873,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":13609,"spinlock_wait_cycles":5007104,"thread_start_us":162021,"threads_started":2,"wal-append.queue_time_us":239363}
I20260709 12:10:42.582527 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.583199 21918 raft_consensus.cc:2368] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9.
I20260709 12:10:42.579452 24740 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.583334 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:42.581532 24855 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.583835 24740 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.584784 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.585915 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.586704 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.587271 21921 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:42.587893 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.580260 24704 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.586678 21920 raft_consensus.cc:2393] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:42.589172 21918 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:42.592639 21997 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:42.593741 21852 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:42.595249 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:42.595403 21847 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:42.596195 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.596362 21964 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:42.596748 21847 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
W20260709 12:10:42.543850 21850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.015s	sys 0.007s
I20260709 12:10:42.597517 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.598059 21847 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:42.598889 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:42.601471 21843 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.006s	sys 0.010s
W20260709 12:10:42.601795 21843 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.006s	sys 0.010s
W20260709 12:10:42.456643 24907 consensus_meta.cc:287] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.762s	user 0.007s	sys 0.003s
I20260709 12:10:42.620024 21919 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:42.603940 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:42.598192 22001 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.001s	sys 0.014s
I20260709 12:10:42.609397 22575 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:42.622815 22001 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.002s	sys 0.015s
I20260709 12:10:42.617996 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.574112 24665 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:42.699628 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.770929 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.748174 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:42.775588 21847 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:42.757216 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.648594 21923 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:42.650216 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:42.747474 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:42.778163 22583 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.648308 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.780957 21966 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:42.626360 21926 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:42.782403 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:42.666173 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:42.755923 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:42.633746 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.783957 21919 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
W20260709 12:10:42.784083 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 161009us
I20260709 12:10:42.777879 22579 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:42.628182 22575 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:42.644177 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.774327 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.713702 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:42.786924 22582 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:42.787712 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:42.788295 22578 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
W20260709 12:10:42.783566 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 188625us
I20260709 12:10:42.783183 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.793226 21997 raft_consensus.cc:2410] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:10:42.786007 21920 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:42.801097 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.807538 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.812786 21997 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:42.813089 22584 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
W20260709 12:10:42.814040 21995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1591) took 2549 ms (client timeout 1676 ms). Trace:
I20260709 12:10:42.813508 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:42.817986 21995 rpcz_store.cc:269] 0709 12:10:40.223496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.223624 (+   128us) service_pool.cc:224] Handling call
0709 12:10:42.771496 (+2547872us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54002dfad4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:42.773085 (+  1589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1725455232}
I20260709 12:10:42.626461 24889 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:42.826848 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:42.626013 24459 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:42.834467 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:42.834462 21849 raft_consensus.cc:2410] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:42.835143 21920 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:42.649006 24710 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.830575 24848 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.838949 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2109) took 1107 ms. Trace:
I20260709 12:10:42.838999 24871 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.850800 21998 rpcz_store.cc:276] 0709 12:10:41.731307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.739642 (+  8335us) service_pool.cc:224] Handling call
0709 12:10:41.739914 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.012559 (+272645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.012619 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:42.012673 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:42.012719 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.838609 (+825890us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54000d2d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:42.838672 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.838847 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626477952}
I20260709 12:10:42.759320 24553 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:42.833352 24889 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.841369 24714 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.842165 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.626274 24907 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:42.843744 24952 log.cc:927] Time spent T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:42.844601 21964 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:42.832118 24897 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.812374 24810 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.846903 24914 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 1.391s	user 0.004s	sys 0.000s
I20260709 12:10:42.848613 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:42.784257 24881 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.849781 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:42.855069 21815 leader_election.cc:400] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9.
I20260709 12:10:42.878202 21815 leader_election.cc:403] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:42.879107 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:42.603037 24877 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:42.857059 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.881124 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:42.859454 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 193407us
I20260709 12:10:42.626242 24726 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.208s
I20260709 12:10:42.862576 21995 raft_consensus.cc:2410] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:42.843111 21923 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:42.862182 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:42.862962 21844 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.058s	sys 0.087s
W20260709 12:10:42.868472 22549 leader_election.cc:336] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.577s (SENT)
I20260709 12:10:42.815297 24815 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:10:42.801441 24766 consensus_queue.cc:1059] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:10:42.863348 24889 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.883728 21920 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:42.884215 22549 leader_election.cc:336] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.791s (SENT)
I20260709 12:10:42.857826 24459 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:42.884837 21844 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.058s	sys 0.087s
I20260709 12:10:42.901970 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:42.873046 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:42.885771 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:42.906461 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.784992 24920 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.911726 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:42.911664 22583 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
W20260709 12:10:42.913014 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.898788 24635 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9.
I20260709 12:10:42.901176 21996 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:10:42.905634 24901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.441s	user 0.006s	sys 0.039s
I20260709 12:10:42.926144 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:42.862042 24553 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.901312 24710 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.898240 24912 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:42.932236 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 48063.9us
I20260709 12:10:42.905776 24946 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.937114 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:42.921949 24904 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.921713 24881 raft_consensus.cc:3055] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.877317 24810 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.874715 24871 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:42.926376 24766 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:42.933146 24901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.006s	sys 0.039s
I20260709 12:10:42.923010 24822 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:42.945672 24946 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.943094 24841 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:42.943300 24958 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.922093 24809 consensus_queue.cc:1175] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 10 } }
I20260709 12:10:42.931010 24842 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.938448 24740 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:42.942828 24710 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:42.935954 24897 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.968595 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:42.968756 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1835) took 1878 ms. Trace:
I20260709 12:10:42.984561 21925 rpcz_store.cc:276] 0709 12:10:41.090647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.090770 (+   123us) service_pool.cc:224] Handling call
0709 12:10:41.091096 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.095525 (+  4429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.095555 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.101631 (+  6076us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.255766 (+154135us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:41.255808 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.255869 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.784457 (+1528588us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:42.962012 (+177555us) raft_consensus.cc:1685] finished
0709 12:10:42.962032 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.968692 (+  6660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4068,"raft.queue_time_us":11789,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":4731,"spinlock_wait_cycles":9852800,"thread_start_us":88227,"threads_started":1,"wal-append.queue_time_us":215077}
I20260709 12:10:42.947731 24881 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:42.971809 21994 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.944577 24772 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:42.965734 24904 raft_consensus.cc:697] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:42.929015 24945 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:42.942538 24912 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.967083 24766 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.966988 24682 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.968302 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:42.996438 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1686) took 1116 ms. Trace:
I20260709 12:10:42.984037 24897 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.969115 24935 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:10:42.998129 24881 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:42.998157 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:42.970535 24946 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.971268 24958 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.970904 24841 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:42.967952 24866 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.970214 24810 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.007958 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:42.986116 24710 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.011720 22549 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:43.036116 24897 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.014060 24766 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.010170 24665 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.008724 24879 raft_consensus.cc:3055] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.007700 24912 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.036309 24842 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.012355 21848 rpcz_store.cc:276] 0709 12:10:41.879780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.934661 (+ 54881us) service_pool.cc:224] Handling call
0709 12:10:41.960026 (+ 25365us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:42.069767 (+109741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.070977 (+  1210us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:42.071924 (+   947us) log.cc:844] Serialized 78 byte log entry
0709 12:10:42.371985 (+300061us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:42.864687 (+492702us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.864953 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.865046 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.996121 (+131075us) raft_consensus.cc:1685] finished
0709 12:10:42.996149 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.996361 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1408,"prepare.queue_time_us":631360,"raft.queue_time_us":4279,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":13219,"thread_start_us":783946,"threads_started":3,"wal-append.queue_time_us":587210}
I20260709 12:10:43.003872 24459 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:43.059719 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 48011.8us
I20260709 12:10:43.060253 24935 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.108809 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:43.086596 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 251888us
W20260709 12:10:43.062562 24959 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:10:43.068641 24759 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:43.073216 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.048791 24957 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:10:43.006079 24772 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:43.111254 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 255291us
I20260709 12:10:43.035931 24682 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:43.116994 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 306609us
I20260709 12:10:43.084021 24881 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:43.082273 24942 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.843s	user 0.006s	sys 0.005s
I20260709 12:10:43.114281 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:43.128356 21966 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:43.130525 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:43.133304 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:43.134536 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:43.110185 24855 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
W20260709 12:10:43.136850 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 52143.6us
I20260709 12:10:43.140312 21921 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.091030 24879 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:43.142925 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:43.144024 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:43.108520 24907 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:43.110642 24842 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:43.153497 21848 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.163255 21922 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:43.164768 21992 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:43.154655 24935 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.168604 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1691) took 1287 ms. Trace:
I20260709 12:10:43.181824 21992 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:10:43.160578 24842 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.198740 24710 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.200332 24958 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.200133 24879 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.131412 24904 consensus_queue.cc:237] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.201444 24879 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.201889 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1683) took 1340 ms. Trace:
I20260709 12:10:43.202246 21845 rpcz_store.cc:276] 0709 12:10:41.861792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.861918 (+   126us) service_pool.cc:224] Handling call
0709 12:10:42.315772 (+453854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.328493 (+ 12721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.201708 (+873215us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400115650. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:43.201833 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993136384}
I20260709 12:10:43.202849 24945 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:43.203995 24841 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:43.208685 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 430) took 1492 ms. Trace:
I20260709 12:10:43.191179 21921 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
W20260709 12:10:43.191972 24960 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 12:10:43.192348 24965 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:10:43.193240 24682 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:43.194775 24772 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:43.197089 24704 consensus_meta.cc:287] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 12:10:43.197441 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1685) took 1335 ms. Trace:
I20260709 12:10:43.230242 24710 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.170435 24855 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:43.159633 24553 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:43.228178 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.209162 21850 rpcz_store.cc:276] 0709 12:10:41.716617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.716754 (+   137us) service_pool.cc:224] Handling call
0709 12:10:41.745517 (+ 28763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.793579 (+ 48062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.793625 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.869976 (+ 76351us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.597397 (+727421us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:42.597451 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.597539 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.208473 (+610934us) raft_consensus.cc:1685] finished
0709 12:10:43.208492 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.208617 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47556,"raft.queue_time_us":65988,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":15180,"thread_start_us":726966,"threads_started":1,"wal-append.queue_time_us":846452}
I20260709 12:10:43.178280 24892 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.246634 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1684) took 1384 ms. Trace:
I20260709 12:10:43.234948 21843 rpcz_store.cc:276] 0709 12:10:41.879271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.888956 (+  9685us) service_pool.cc:224] Handling call
0709 12:10:41.960111 (+ 71155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.602111 (+642000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.602138 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.792977 (+190839us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.104076 (+311099us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:43.161869 (+ 57793us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.162167 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.162284 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.197238 (+ 34954us) raft_consensus.cc:1685] finished
0709 12:10:43.197256 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.197384 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4735,"prepare.queue_time_us":57455,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":11884,"raft.queue_time_us":20176,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":38192,"thread_start_us":886098,"threads_started":2,"wal-append.queue_time_us":369669}
I20260709 12:10:43.206987 24482 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:43.239976 24688 consensus_meta.cc:287] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.662s	user 0.014s	sys 0.004s
I20260709 12:10:43.289252 21843 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:43.234954 24962 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:10:43.297921 22001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.020s	sys 0.018s
W20260709 12:10:43.300901 22001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.020s	sys 0.018s
W20260709 12:10:43.313939 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.231017 24841 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:43.266125 21851 rpcz_store.cc:276] 0709 12:10:41.862127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.862273 (+   146us) service_pool.cc:224] Handling call
0709 12:10:41.884045 (+ 21772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.891404 (+  7359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.891448 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.588157 (+696709us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b2c00014b88. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:10:42.588563 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.027111 (+438548us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:43.058373 (+ 31262us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.058694 (+   321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.058772 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.246143 (+187371us) raft_consensus.cc:1685] finished
0709 12:10:43.246277 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.246550 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4156,"prepare.queue_time_us":26105,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":10943,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":34397,"spinlock_wait_cycles":12796800,"thread_start_us":438116,"threads_started":1,"wal-append.queue_time_us":571218}
I20260709 12:10:43.321839 21848 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:43.322167 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 213398us
I20260709 12:10:43.235293 24876 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.232252 24829 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:43.248198 24892 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:43.326435 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 191374us
W20260709 12:10:43.327947 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 185089us
I20260709 12:10:43.287755 24831 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.336680 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:43.240571 24897 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.234772 24704 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.344520 21848 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.345031 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:43.345257 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:43.346663 21843 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:43.347390 21851 raft_consensus.cc:2368] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
W20260709 12:10:43.348047 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.336982 24892 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.341540 24799 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:43.321362 24912 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.327311 24841 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.368798 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:43.369949 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:43.369150 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.371898 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:43.379070 21927 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.379776 21918 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.382071 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:43.382514 24935 consensus_queue.cc:1059] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:43.383610 24935 raft_consensus.cc:3055] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:43.384025 24935 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:43.384985 24935 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:43.393453 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.395103 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 519) took 1385 ms. Trace:
I20260709 12:10:43.420258 21999 rpcz_store.cc:276] 0709 12:10:42.009891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.432257 (+422366us) service_pool.cc:224] Handling call
0709 12:10:42.432630 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.432978 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.433006 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.433474 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.863997 (+430523us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:42.886697 (+ 22700us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.902172 (+ 15475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.902244 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.000431 (+ 98187us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b1800470020. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:43.394798 (+394367us) raft_consensus.cc:1685] finished
0709 12:10:43.394920 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.395050 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58658,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":26503,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":4675,"spinlock_wait_cycles":13098880,"thread_start_us":430129,"threads_started":1,"wal-append.queue_time_us":553477}
I20260709 12:10:43.404923 21817 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:43.405673 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 279439us
W20260709 12:10:43.406148 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 277873us
I20260709 12:10:43.435667 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:43.438037 21966 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:43.440826 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:43.409965 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2112) took 1677 ms. Trace:
I20260709 12:10:43.454926 21920 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.441879 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:43.386394 24935 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.449645 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:43.451278 21999 raft_consensus.cc:1240] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:43.455231 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:43.415952 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 302734us
I20260709 12:10:43.414764 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 520) took 1404 ms. Trace:
I20260709 12:10:43.456044 21926 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:43.457418 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 52553.8us
I20260709 12:10:43.446717 24972 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:43.465137 22000 raft_consensus.cc:2410] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:43.383555 24860 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.416206 24818 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:43.464394 21817 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:43.406316 24907 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:10:43.396512 24946 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.411253 24891 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:43.496562 24740 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.503212 24740 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.409860 24704 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:43.408660 24912 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.505260 24740 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:43.506155 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 68186.7us
W20260709 12:10:43.407235 24824 consensus_meta.cc:287] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.000s
I20260709 12:10:43.497020 24901 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:43.506950 24824 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.507052 24901 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.416663 24876 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.510865 24957 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:43.510684 24876 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.512311 24766 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.512929 24921 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:43.513396 24921 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:43.513468 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:43.455206 22001 rpcz_store.cc:276] 0709 12:10:41.732088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.742748 (+ 10660us) service_pool.cc:224] Handling call
0709 12:10:41.743032 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.743245 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:42.758437 (+1015192us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.409556 (+651119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.409618 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:43.409683 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.409781 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.409908 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108189,"prepare.queue_time_us":126858,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":110270,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":1422223,"threads_started":2,"wal-append.queue_time_us":579055}
I20260709 12:10:43.395429 24889 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.516340 21847 raft_consensus.cc:2368] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:43.444557 24842 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.517257 24946 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.551512 21927 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:43.521783 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:43.469732 21918 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:43.553297 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:43.553567 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:43.553942 21921 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.470475 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 523) took 1459 ms. Trace:
I20260709 12:10:43.554257 22582 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.554504 21995 rpcz_store.cc:276] 0709 12:10:42.011266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.938449 (+927183us) service_pool.cc:224] Handling call
0709 12:10:42.963284 (+ 24835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.963477 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:43.156338 (+192861us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.469969 (+313631us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.470045 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:43.470122 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.470259 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.470386 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37151,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":49327,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":457823,"threads_started":2}
I20260709 12:10:43.556341 21926 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:43.409240 24894 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:43.560835 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:43.519138 21997 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 3.
I20260709 12:10:43.462555 21998 rpcz_store.cc:276] 0709 12:10:42.010209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.916287 (+906078us) service_pool.cc:224] Handling call
0709 12:10:42.934708 (+ 18421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.936830 (+  2122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.936863 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.941473 (+  4610us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.275598 (+334125us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:43.275655 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.275747 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.414475 (+138728us) raft_consensus.cc:1685] finished
0709 12:10:43.414496 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.414702 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32519,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":287528,"threads_started":1,"wal-append.queue_time_us":432585}
I20260709 12:10:43.521610 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:43.557508 21964 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:43.455361 24983 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.399236 24841 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:43.463053 24954 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.552687 22578 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:43.406970 24881 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:43.568869 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 55493.8us
I20260709 12:10:43.591307 21966 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:43.570984 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2126) took 1022 ms. Trace:
I20260709 12:10:43.575990 21848 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:43.592862 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:43.517565 24766 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.577569 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:43.558274 21992 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.408794 24822 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:43.666338 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 75121.6us
I20260709 12:10:43.667260 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:43.498037 24972 raft_consensus.cc:697] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:43.668546 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:43.388865 24799 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:43.676994 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 222285us
I20260709 12:10:43.671322 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1610) took 1104 ms. Trace:
I20260709 12:10:43.561558 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:43.582948 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:43.681339 22584 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.399515 24897 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:43.583534 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:43.590008 24946 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.416421 24710 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.584860 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:43.688293 21851 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.410099 24936 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:43.558753 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:43.585654 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 121323us
I20260709 12:10:43.584518 21925 raft_consensus.cc:2393] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:43.586817 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:43.692404 22576 raft_consensus.cc:2410] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:43.692478 22583 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.551512 21920 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:43.407760 24971 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.496876 24459 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.588685 22582 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:43.592074 21993 rpcz_store.cc:276] 0709 12:10:42.548383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.462081 (+913698us) service_pool.cc:224] Handling call
0709 12:10:43.495291 (+ 33210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.558768 (+ 63477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.558793 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.558838 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:43.558871 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.558925 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.570896 (+ 11971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.559244 24904 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.513897 24892 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.599893 21921 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:43.466136 24772 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.133s
W20260709 12:10:43.669701 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 236872us
I20260709 12:10:43.573135 24891 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:43.585093 24947 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.583175 24740 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.587695 24860 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:43.683697 22579 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:43.455783 24635 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.679554 21992 rpcz_store.cc:276] 0709 12:10:42.507567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.456698 (+949131us) service_pool.cc:224] Handling call
0709 12:10:43.558115 (+101417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.612018 (+ 53903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.612295 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.590535 24881 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.557775 24818 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.695259 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:43.678217 24912 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.669677 24954 raft_consensus.cc:697] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:43.683441 24866 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:43.734269 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.683696 24726 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.589069 24894 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:43.742846 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 288561us
I20260709 12:10:43.745745 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:43.686718 24946 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:43.749975 24860 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:43.777285 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.887183 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:43.788662 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.699654 24897 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:43.528971 24921 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:43.873421 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 196156us
W20260709 12:10:43.873677 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 178500us
I20260709 12:10:43.751066 24714 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:43.871444 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:43.893886 21992 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.875748 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:43.746474 21892 connection.cc:256] RPC call timeout handler was delayed by -1.6366403229999378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:10:43.876629 24799 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.885871 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:43.898682 21993 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.678571 24822 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.865172 24881 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.587931 24983 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.685894 24815 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.185s
I20260709 12:10:43.698894 24936 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.865404 24635 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.699066 24710 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:43.739073 24459 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.899367 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:43.901342 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.889895 24946 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.880024 24971 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:43.907274 22584 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:43.747449 24891 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.896237 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:43.740319 24904 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.927919 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:43.933483 21852 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.909145 24740 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.939057 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 440) took 1024 ms. Trace:
I20260709 12:10:43.939639 21850 raft_consensus.cc:1240] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.939477 21847 rpcz_store.cc:276] 0709 12:10:42.914278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.007598 (+ 93320us) service_pool.cc:224] Handling call
0709 12:10:43.938848 (+931250us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400207454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:43.938998 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061539072}
I20260709 12:10:43.938635 24740 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:43.941995 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 444) took 1026 ms. Trace:
I20260709 12:10:43.937043 24822 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:43.942122 24740 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:43.942670 24996 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:43.942457 21850 rpcz_store.cc:276] 0709 12:10:42.915473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.241374 (+325901us) service_pool.cc:224] Handling call
0709 12:10:43.939459 (+698085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.940233 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.941803 (+  1570us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400207450. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:43.941938 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604679424}
I20260709 12:10:43.942971 21993 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
W20260709 12:10:43.945892 24995 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:10:43.946218 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:43.947938 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:43.949375 24635 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:43.949432 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:43.956202 24904 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:43.957176 21993 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:43.964634 21849 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:43.962460 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:43.954032 24842 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:43.927300 21967 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:43.881529 24947 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.915370 24810 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:43.982504 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:43.983286 22583 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.987283 22577 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:43.902582 24714 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.896283 24897 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:43.920706 24889 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:44.000353 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 73165.5us
I20260709 12:10:44.001757 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:44.003826 21993 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:44.007916 21993 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:44.003026 24810 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:43.908978 24988 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:10:44.010170 24810 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:44.021736 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 122449us
I20260709 12:10:44.016417 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:43.968461 24971 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:43.996565 24815 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:44.006436 24824 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.033761 22583 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:44.027103 24772 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.017122 24740 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.913534 24972 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:44.016772 24842 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.029917 24879 consensus_meta.cc:287] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.828s	user 0.012s	sys 0.000s
W20260709 12:10:44.043890 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 148706us
W20260709 12:10:44.046113 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 149962us
I20260709 12:10:44.029160 24889 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:43.963029 24860 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.030799 24986 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.959506 24954 consensus_queue.cc:237] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:44.047143 21892 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:44.056468 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:44.057849 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:44.068077 21847 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.062564 21851 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:10:44.073313 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:44.074167 21850 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:44.072654 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:44.075193 21851 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.048028 24740 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.047919 24815 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:44.051853 24889 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.099962 24889 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.104524 21992 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:44.085731 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:44.087536 24986 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.105901 24866 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.106308 24986 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.106427 24866 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:44.106945 24986 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.107913 24983 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:44.109423 22549 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.825s (SENT)
I20260709 12:10:44.040911 24824 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.119243 24871 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:44.119774 24871 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.119858 24815 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.121220 24710 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:44.121681 24766 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:44.121841 24971 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.122229 24766 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.053434 24842 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.125809 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:44.059262 25011 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:10:44.127197 25011 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:44.127570 25011 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:44.128377 25011 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:44.128896 25004 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:10:44.128976 24848 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:44.130527 24897 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:44.131356 24936 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:44.132448 21997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1604) took 1666 ms (client timeout 2213 ms). Trace:
W20260709 12:10:44.132838 21997 rpcz_store.cc:269] 0709 12:10:42.465592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.817889 (+352297us) service_pool.cc:224] Handling call
0709 12:10:44.132266 (+1314377us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54000d3254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:44.132365 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550348672}
I20260709 12:10:44.075501 24892 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:44.134114 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1846) took 1548 ms. Trace:
I20260709 12:10:44.134488 21922 rpcz_store.cc:276] 0709 12:10:42.585554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.586787 (+  1233us) service_pool.cc:224] Handling call
0709 12:10:42.587045 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.163793 (+576748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.133887 (+970094us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54002e7554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:44.134057 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308342528}
I20260709 12:10:44.136775 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:44.137488 21849 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:44.141083 24876 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:44.143050 24975 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.799s	user 0.004s	sys 0.000s
I20260709 12:10:44.096582 24891 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.097745 24894 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:44.086931 24740 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.099376 24714 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:44.050282 24772 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.160259 21850 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:44.160306 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 240592us
I20260709 12:10:44.161537 21817 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:44.158201 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 48805.9us
W20260709 12:10:44.160349 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 234080us
I20260709 12:10:44.167939 21847 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:44.171193 22581 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:44.157670 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 72026.4us
I20260709 12:10:44.180912 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:44.181552 22576 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:44.181881 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:44.179443 21851 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:44.182750 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:44.193039 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2121) took 1650 ms. Trace:
I20260709 12:10:44.193467 21999 rpcz_store.cc:276] 0709 12:10:42.542630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.461198 (+918568us) service_pool.cc:224] Handling call
0709 12:10:43.516442 (+ 55244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.735383 (+218941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.735430 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.735497 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:43.735555 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.192821 (+457266us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400222254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:44.192869 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.192986 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502887680}
I20260709 12:10:44.201006 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2108) took 2460 ms. Trace:
W20260709 12:10:44.201964 22549 leader_election.cc:336] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.919s (SENT)
I20260709 12:10:44.222671 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:44.201483 21994 rpcz_store.cc:276] 0709 12:10:41.730996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.739095 (+  8099us) service_pool.cc:224] Handling call
0709 12:10:41.739355 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.994012 (+1254657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.191134 (+1197122us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001f04d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:44.191324 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2833819392}
I20260709 12:10:44.207020 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:44.181640 25011 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.168805 24891 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:44.232285 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:44.234391 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:44.238230 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.239396 22001 raft_consensus.cc:2410] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:44.234541 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:44.243796 22549 leader_election.cc:336] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.932s (SENT)
I20260709 12:10:44.195047 24696 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:44.249352 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.255039 21998 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:44.201043 24714 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.249848 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.253213 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.256659 21994 raft_consensus.cc:2368] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:44.230677 25003 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.257542 25003 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.251394 24688 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:44.237041 24882 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.263300 24842 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:44.263583 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.264744 21994 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
W20260709 12:10:44.231670 24964 log.cc:927] Time spent T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:44.263376 24986 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.266760 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:44.267838 21818 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:44.271152 21992 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:44.274566 22001 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:44.263851 25003 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.281452 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.235865 24459 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:44.283185 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.285444 21994 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:44.285676 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:44.250304 25009 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:44.287240 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:44.287326 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.291208 21998 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.291263 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:44.292507 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.293102 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.289466 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:44.291347 21993 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:44.296082 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:44.298152 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.284927 24986 consensus_queue.cc:1059] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:44.299436 25012 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:44.299737 24986 raft_consensus.cc:3055] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.299984 25012 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:44.300319 24986 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:44.300573 25012 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.291646 24892 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.301347 24892 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:44.301304 24986 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:44.298987 25001 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.301980 24892 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.305998 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.306226 21998 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:10:44.306892 21999 raft_consensus.cc:2393] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:44.306962 24766 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.307899 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:44.299022 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.310441 24986 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.312801 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.312532 24740 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.313334 24714 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:10:44.314002 25015 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 12:10:44.292327 24935 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.007s
I20260709 12:10:44.325291 21993 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:44.319818 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:44.336005 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.334961 24842 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.339293 22575 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:44.319558 21892 leader_election.cc:400] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:44.290632 24947 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.269269 24696 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.344662 21892 leader_election.cc:403] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:44.350528 24688 raft_consensus.cc:3055] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.351159 24688 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:44.352394 24688 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:44.355486 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:44.357355 24696 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.359338 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:44.360155 22584 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:44.356670 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:44.365520 21922 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:44.367753 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:44.368079 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:44.368505 21921 raft_consensus.cc:2368] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:44.368784 21925 raft_consensus.cc:2368] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:44.370441 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:44.371220 21921 raft_consensus.cc:2376] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4. Re-sending same reply.
I20260709 12:10:44.357873 24831 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:44.376951 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.354118 24688 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.380245 21921 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:44.382175 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.382975 21925 raft_consensus.cc:2393] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:44.383147 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:44.380605 24829 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:44.388891 24740 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.389063 24772 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:44.357442 24759 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:44.396420 22582 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:44.380008 24714 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:44.412417 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.430590 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.519685 21925 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:44.490804 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.521148 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 513) took 2513 ms. Trace:
I20260709 12:10:44.530208 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.531198 21919 raft_consensus.cc:2393] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 3: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:44.531239 22582 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:44.526679 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.378747 25000 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:44.521561 21996 rpcz_store.cc:276] 0709 12:10:42.007844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.349073 (+341229us) service_pool.cc:224] Handling call
0709 12:10:42.351156 (+  2083us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:42.351709 (+   553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.351737 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:42.418806 (+ 67069us) log.cc:844] Serialized 608 byte log entry
0709 12:10:42.859595 (+440789us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:43.015731 (+156136us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.040096 (+ 24365us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.040525 (+   429us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.401256 (+360731us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18002a33a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be4d93060 00007f3be4da5716 00007f3be4db6287 00007f3be4db6208
0709 12:10:43.401440 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.401592 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.112619 (+711027us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b18002a33a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:44.520885 (+408266us) raft_consensus.cc:1685] finished
0709 12:10:44.520921 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.521061 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":352819,"prepare.queue_time_us":43421,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":100,"raft.queue_time_us":367677,"raft.run_cpu_time_us":509,"raft.run_wall_time_us":20256,"spinlock_wait_cycles":12897280,"thread_start_us":390611,"threads_started":1,"wal-append.queue_time_us":607930}
I20260709 12:10:44.335629 24881 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.294955 25009 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.553085 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:44.555848 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:44.541771 24892 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.556586 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.556805 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.557555 21920 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.561568 21918 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:44.558211 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:44.564459 21925 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.565163 22584 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:44.566639 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.567500 21926 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:44.561543 21927 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:44.622249 21921 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:44.616569 21920 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:44.630517 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.631592 21927 raft_consensus.cc:2368] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:44.548872 24831 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:44.564530 24958 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.649080 21925 raft_consensus.cc:2410] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:10:44.574877 24714 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.551380 25000 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:44.552642 24829 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:44.659988 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.666185 24958 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.556263 25013 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:10:44.671586 24958 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.672354 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.672884 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:44.673094 21996 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:44.673064 25028 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:44.673614 22584 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
W20260709 12:10:44.662899 24946 consensus_meta.cc:287] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.728s	user 0.005s	sys 0.009s
I20260709 12:10:44.682745 24946 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.685384 24946 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.685774 24877 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.662525 24710 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.680150 25024 log.cc:927] Time spent T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:10:44.668321 24714 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.678526 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:44.695312 22000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1611) took 2187 ms (client timeout 1898 ms). Trace:
I20260709 12:10:44.701397 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:44.698860 22000 rpcz_store.cc:269] 0709 12:10:42.507934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.583130 (+ 75196us) service_pool.cc:224] Handling call
0709 12:10:44.695091 (+2111961us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54002d0fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:44.695233 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025906944}
I20260709 12:10:44.707537 24829 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:44.709306 25012 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.710839 25000 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.711864 25000 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.712960 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:44.713694 21920 raft_consensus.cc:2368] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:44.714677 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:44.715559 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.716325 21851 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:44.716756 25009 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.717439 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:44.719547 24881 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.720716 21922 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:44.677480 24831 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:44.708312 24818 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:44.714781 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.716769 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.714737 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.737753 21921 raft_consensus.cc:2368] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:44.730195 22000 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:44.741050 21996 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:44.694694 25030 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:44.742607 21925 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:44.742929 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.745960 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.746829 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:44.748783 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 191446us
I20260709 12:10:44.752722 24986 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.692994 24710 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:44.751448 21892 connection.cc:256] RPC call timeout handler was delayed by -1.3097824240001046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 12:10:43.171576 21844 rpcz_store.cc:276] 0709 12:10:41.881346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.083348 (+202002us) service_pool.cc:224] Handling call
0709 12:10:42.131661 (+ 48313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.131911 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:42.902203 (+770292us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.167884 (+265681us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.168223 (+   339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.168276 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:43.168330 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.168422 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.168547 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2788,"prepare.queue_time_us":852722,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":262,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9682,"thread_start_us":953137,"threads_started":2}
W20260709 12:10:44.793694 24989 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 1.402s	user 0.007s	sys 0.005s
I20260709 12:10:44.824002 21997 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:44.768560 24986 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:44.829177 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 66461.9us
W20260709 12:10:44.837757 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.838388 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.749310 25030 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:44.822912 24936 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.001s	sys 0.020s
I20260709 12:10:44.826707 24831 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:44.823105 24946 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:10:44.841282 24889 consensus_meta.cc:287] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.000s
W20260709 12:10:44.848681 24936 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.001s	sys 0.020s
I20260709 12:10:44.850802 24682 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 12:10:44.867095 22575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 650) took 1308 ms (client timeout 1591 ms). Trace:
W20260709 12:10:44.867345 25029 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:44.857105 24946 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.859740 24889 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.860333 25012 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.861430 24901 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:44.867555 22575 rpcz_store.cc:269] 0709 12:10:43.558333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.558493 (+   160us) service_pool.cc:224] Handling call
0709 12:10:44.866893 (+1308400us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400548b54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:44.867010 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493639040}
I20260709 12:10:44.877266 24921 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.882879 24553 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.883455 24553 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.885545 24553 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:44.885917 24866 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:44.887445 24889 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.889267 24946 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:44.891780 25011 consensus_meta.cc:287] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.003s
I20260709 12:10:44.900012 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.901028 22000 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:44.901355 22001 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:44.897881 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:44.912532 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 159051us
W20260709 12:10:44.915123 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.914988 21964 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:44.919343 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:44.922442 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:44.857456 24831 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:10:44.935272 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:44.938014 21964 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:44.938565 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.938956 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:44.898365 24714 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:44.953361 25032 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:10:44.955533 25030 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:44.957235 24710 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.960315 24986 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:44.906699 24889 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:10:44.965297 24936 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:44.965775 24936 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:44.966142 24936 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.966737 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:44.967756 21992 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:44.951491 25011 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:44.949448 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2129) took 1253 ms. Trace:
I20260709 12:10:44.962370 24881 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.941238 25012 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:44.962993 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:44.982376 21845 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:10:44.984475 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:44.970113 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.975454 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.985193 21919 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.975792 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.989713 21922 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:44.976781 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.969563 21995 rpcz_store.cc:276] 0709 12:10:43.696187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.698513 (+  2326us) service_pool.cc:224] Handling call
0709 12:10:43.738456 (+ 39943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.934832 (+196376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.934855 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.934883 (+    28us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:43.934905 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.949229 (+1014324us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54002364d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:44.949272 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.949386 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451175808}
I20260709 12:10:44.978049 21920 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:44.978946 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:44.979336 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:44.993633 21966 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:44.968979 25011 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:44.940325 24815 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.995209 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.001420 21918 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:44.995579 21966 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:44.996049 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:44.978880 24946 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.003050 21926 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:45.011344 25013 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:45.011670 24824 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:45.011940 25009 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:44.978688 25015 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:44.978792 24881 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:45.014756 21918 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:44.986598 24696 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.021670 21919 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:10:44.994943 25008 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.995030 24818 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:45.024715 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:44.999697 24889 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:44.998617 24901 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:45.025806 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 198264us
I20260709 12:10:45.002537 24877 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.016299 24688 consensus_meta.cc:287] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 12:10:45.002137 24958 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:45.033476 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:45.040084 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:45.040194 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.040961 21918 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:45.041002 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:45.041867 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.042857 21921 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:45.047410 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:45.020190 24945 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.007462 24815 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.020049 24881 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.992266 25012 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.016605 25015 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:44.998157 24841 consensus_queue.cc:1059] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:45.048172 21919 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:45.055756 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.003711 24866 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:10:45.065433 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.067687 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.084347 21925 raft_consensus.cc:2410] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:45.025452 25009 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:45.028429 24901 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.085644 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.088029 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.089530 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.089905 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.090098 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.090700 21849 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:45.017508 24946 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.052874 24553 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.021392 25013 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.093986 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.050470 24877 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.095515 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:45.096311 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.096325 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:45.106328 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:45.107056 21848 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.097146 24841 raft_consensus.cc:3055] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.098783 24766 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:10:45.112928 24841 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:45.115310 25009 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.116134 24841 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.118480 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.068742 24889 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.023476 24696 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.059948 24824 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.128630 24824 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.129026 24824 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.060184 24740 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.130983 24740 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.131461 24740 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.133900 25012 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:45.113890 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.135196 21922 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:45.060531 24945 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.137349 24945 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:45.138396 21850 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:45.060276 24815 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.141378 22579 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:45.053646 24958 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.100374 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:45.032055 24818 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.143744 24958 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:45.144483 24818 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:45.126330 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:45.146297 21966 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.147022 24946 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:45.092878 24901 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.147727 24818 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.148206 24818 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.148407 25044 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.148610 24818 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.148206 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 47915.2us
I20260709 12:10:45.072184 25011 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.151357 24988 consensus_queue.cc:1059] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:45.152006 24988 consensus_queue.cc:1243] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:45.153437 24988 raft_consensus.cc:3055] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:45.154479 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.156247 21919 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:45.166822 21848 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:45.169068 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.140027 25013 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:45.171403 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:45.178794 21995 raft_consensus.cc:2376] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8. Re-sending same reply.
I20260709 12:10:45.174863 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:45.175617 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 74543.1us
I20260709 12:10:45.181485 21892 leader_election.cc:400] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:45.187803 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.190011 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:45.192828 21966 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.193364 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:45.194051 21995 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:45.125427 24889 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:45.153785 24988 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:45.171828 24972 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.200125 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:45.209694 21992 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:45.203114 21892 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.206475 21966 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.201071 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.211202 21919 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:45.213090 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.177802 25044 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:45.219739 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.220610 21847 raft_consensus.cc:2410] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:45.220938 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:45.197747 25048 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:10:45.224018 21926 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:45.189301 25042 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:45.200125 24822 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.208343 24889 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.233099 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:45.209153 25030 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:45.228559 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.197641 25038 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.235586 21847 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:45.193297 24986 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:45.237371 21848 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.225916 24714 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.238188 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.242924 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:45.244799 25007 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:45.245285 25007 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:45.246124 25007 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.246851 25030 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:45.247321 24740 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.247869 25030 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:45.250708 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.251349 24877 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:45.251542 21848 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:45.251780 24988 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.252969 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:45.253717 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 660) took 1343 ms. Trace:
I20260709 12:10:45.254065 22579 rpcz_store.cc:276] 0709 12:10:43.910256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.910642 (+   386us) service_pool.cc:224] Handling call
0709 12:10:45.253559 (+1342917us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540057c6d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:45.253666 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2781822208}
I20260709 12:10:45.252990 24988 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.254446 24815 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:45.256198 25015 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:45.256644 24815 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:45.237525 25038 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:45.257499 25038 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.261524 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.266235 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1698) took 1706 ms. Trace:
I20260709 12:10:45.266639 21852 rpcz_store.cc:276] 0709 12:10:43.559983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.560113 (+   130us) service_pool.cc:224] Handling call
0709 12:10:43.560393 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.934104 (+373711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.266010 (+1331906us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54001da1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:45.266174 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857408896}
I20260709 12:10:45.227494 24972 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.227809 25044 raft_consensus.cc:697] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:45.262267 21921 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 4: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:45.237900 25026 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.497s	user 0.004s	sys 0.000s
I20260709 12:10:45.273447 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.222611 25012 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:45.275673 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1812) took 1218 ms. Trace:
I20260709 12:10:45.275795 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.272557 21850 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.274154 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:45.268433 24818 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.275173 21844 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:45.270548 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:45.287287 24824 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:45.288556 21952 heartbeater.cc:646] Failed to heartbeat to 127.20.56.126:35507 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.56.126:35507 timed out after 15.000s (SENT)
I20260709 12:10:45.289649 24824 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:45.294260 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:45.294909 22582 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:45.295773 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:45.297816 21817 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.299335 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.300585 21817 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.306779 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:45.307371 22575 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.308271 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:45.309020 22582 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:45.312704 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.313244 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:45.313982 22577 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.318523 21848 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:45.319031 22582 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:45.276188 21846 rpcz_store.cc:276] 0709 12:10:44.057709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.141406 (+ 83697us) service_pool.cc:224] Handling call
0709 12:10:44.861135 (+719729us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:10:44.861349 (+   214us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:44.861745 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.861775 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:44.862457 (+   682us) log.cc:844] Serialized 52 byte log entry
0709 12:10:45.058812 (+196355us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:45.103534 (+ 44722us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.184387 (+ 80853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.184490 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.250197 (+ 65707us) raft_consensus.cc:1685] finished
0709 12:10:45.275472 (+ 25275us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.275621 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"prepare.queue_time_us":37189,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":41880,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":171,"spinlock_wait_cycles":38265600,"thread_start_us":276337,"threads_started":2,"wal-append.queue_time_us":266140}
I20260709 12:10:45.242944 25050 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:45.323308 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.324307 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:45.325281 22582 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:45.326700 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:45.273144 24740 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:45.273577 24772 consensus_queue.cc:1059] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:10:45.333112 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:45.315433 24936 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.331791 22575 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:45.317114 24945 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:45.389894 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56855us
I20260709 12:10:45.380095 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.380404 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.334306 21967 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.378261 21818 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:45.352695 21920 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:45.351894 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:45.367261 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:45.414971 22578 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:10:45.415174 21918 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.413802 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 79612.3us
I20260709 12:10:45.336326 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:45.352985 21922 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:45.394963 22547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.017s	sys 0.042s
I20260709 12:10:45.416815 22579 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
W20260709 12:10:45.417249 22547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.019s	sys 0.043s
I20260709 12:10:45.367339 21925 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:10:45.417615 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 577397us
I20260709 12:10:45.338200 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:45.337047 21921 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.419288 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:45.419518 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.419886 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:45.420538 21921 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:45.420868 22575 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.336404 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.374253 22577 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:45.334595 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:45.389165 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:45.427515 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 89426.9us
I20260709 12:10:45.427975 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:45.428471 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:45.428798 22577 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.430955 22582 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
W20260709 12:10:45.431138 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.426607 22580 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
W20260709 12:10:45.434727 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 103744us
I20260709 12:10:45.320052 24904 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.325126 24710 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.436444 21817 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:45.449369 21817 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.379788 24824 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:45.448385 24710 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:45.454293 24710 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.456825 22577 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:45.434964 22547 leader_election.cc:400] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:45.459681 22547 leader_election.cc:403] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:45.460345 24772 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5.
I20260709 12:10:45.461796 22547 leader_election.cc:400] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:45.462154 22547 leader_election.cc:403] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:45.462744 24772 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:45.462654 24822 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:10:45.463955 25059 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.464399 25059 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.379662 25042 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:10:45.464690 24822 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:45.465766 22547 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.466681 24947 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:45.383266 25046 log.cc:927] Time spent T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.213s	user 0.003s	sys 0.000s
I20260709 12:10:45.442206 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:45.431630 24988 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.437383 25013 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.467675 24988 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.436859 24815 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.469074 24815 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:45.469539 24815 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.458880 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.472345 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.473397 21923 raft_consensus.cc:2410] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:45.325381 25058 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 12:10:45.379595 24818 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:45.476164 24877 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:45.410720 24912 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.425020 24726 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.468101 25013 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.462168 24710 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.436574 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:45.503129 21926 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.377576 24972 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 12:10:45.434255 25031 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.323961 25015 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 12:10:45.442750 24740 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:45.424605 25050 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:45.319672 25012 consensus_queue.cc:1243] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:45.495034 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:45.459003 22575 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:45.468420 22547 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:45.534457 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 66089.8us
I20260709 12:10:45.535185 22547 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:45.536265 22547 leader_election.cc:400] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:45.537003 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.495827 24824 raft_consensus.cc:697] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:45.450047 25051 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.464708 25059 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.437644 24901 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.496006 24912 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.525655 21918 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:45.531827 21926 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:45.503461 25013 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.439925 24889 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.542491 22547 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.518618 24892 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:45.476167 25005 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 12:10:45.546079 21845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 447) took 2171 ms (client timeout 1986 ms). Trace:
W20260709 12:10:45.557861 21845 rpcz_store.cc:269] 0709 12:10:43.368524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.379810 (+ 11286us) service_pool.cc:224] Handling call
0709 12:10:45.539645 (+2159835us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54001bc6d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:45.539756 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3678604544}
I20260709 12:10:45.470307 24988 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:45.551487 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 345121us
I20260709 12:10:45.559918 21892 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.562623 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:45.541225 24772 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.558909 21924 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:45.543458 24842 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:45.386862 25044 consensus_queue.cc:237] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.545644 25047 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:45.567647 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 189471us
I20260709 12:10:45.544050 25008 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.543891 24740 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:45.545373 25051 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.570086 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:45.572137 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 137940us
I20260709 12:10:45.524438 25011 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:10:45.574308 22001 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.578485 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.580154 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:45.581029 21997 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:45.582602 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:45.583385 21994 raft_consensus.cc:2368] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:45.583611 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:45.584367 21995 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:45.567058 25012 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.566879 24818 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.612193 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.571774 24726 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.573551 24921 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.618438 21999 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:45.577455 25051 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.619668 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:45.619000 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:45.618193 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:45.610724 24822 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.622903 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44507.9us
I20260709 12:10:45.630203 21845 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:45.644402 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.613813 25008 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.613375 25009 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:45.645210 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 194078us
I20260709 12:10:45.645958 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.617458 24892 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.673835 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:45.623723 24818 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.644294 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:45.700448 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 69346us
I20260709 12:10:45.673327 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:45.670312 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 107790us
I20260709 12:10:45.627163 24726 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.615749 24824 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.645257 24822 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.709077 25078 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:45.706172 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:45.717139 21999 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:45.644044 25012 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.656155 24936 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:45.724129 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 78251.5us
I20260709 12:10:45.647125 25067 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:45.777515 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 76341.2us
I20260709 12:10:45.781127 21892 leader_election.cc:400] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:45.781442 21892 leader_election.cc:403] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:45.716567 25038 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.777690 24688 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.785090 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.671602 25009 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.679845 24740 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.630381 25050 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:45.875427 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 94421.6us
W20260709 12:10:45.731273 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 68516.5us
W20260709 12:10:45.885519 25063 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 12:10:45.882016 24688 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:45.886343 24688 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:45.887004 25075 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:10:45.723423 25066 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:10:45.889977 21892 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:45.891280 25071 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:10:45.729504 25008 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.895634 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.895848 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.904858 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:45.896849 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:45.907213 21843 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.898545 21852 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:45.894819 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 109833us
I20260709 12:10:45.899431 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:45.908565 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:45.729918 25074 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:45.723655 25068 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:45.904054 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:45.785712 24881 consensus_meta.cc:287] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260709 12:10:45.706818 24829 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.943190 21848 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:45.782549 25078 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.871503 24815 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:45.913201 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:45.913261 21817 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:45.913518 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:45.839336 24901 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:45.866205 25012 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6.
I20260709 12:10:45.782380 25067 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:45.829798 24912 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:45.839404 24710 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:45.779218 24892 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.126s
W20260709 12:10:45.917223 25076 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:10:45.917562 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.917999 25090 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:45.920671 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:45.915822 24904 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:45.953620 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:45.941416 24829 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:45.716331 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:45.942481 24881 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:45.989074 24945 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.015878 24945 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:45.962307 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 392395us
I20260709 12:10:45.985649 25090 consensus_queue.cc:1243] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:45.963575 25082 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:45.954811 25089 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.985773 25012 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 12:10:46.015959 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 102777us
W20260709 12:10:46.018862 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 302601us
I20260709 12:10:46.022513 22547 leader_election.cc:400] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:46.015949 25079 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:46.024842 25086 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:10:45.986260 25080 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.984248 24710 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.958513 25067 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:46.249794 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 336934us
W20260709 12:10:46.293826 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 389805us
I20260709 12:10:46.384366 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:46.384918 21892 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:46.385842 21815 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:46.057188 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:46.042088 21999 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:46.386942 22547 leader_election.cc:403] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:46.052577 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:46.387921 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 365578us
I20260709 12:10:46.388315 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:46.388655 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:46.382002 21891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.000s	sys 0.014s
W20260709 12:10:46.389374 21891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.000s	sys 0.014s
W20260709 12:10:46.374146 22581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.004s	sys 0.011s
I20260709 12:10:46.390055 22547 leader_election.cc:400] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:46.392531 22547 leader_election.cc:403] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:46.383037 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.013996 24904 raft_consensus.cc:697] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:46.014951 24829 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:46.390286 22581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.004s	sys 0.011s
I20260709 12:10:46.083835 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:46.297757 25059 consensus_meta.cc:287] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.000s
I20260709 12:10:46.023299 25044 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:46.023590 24726 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:46.057439 24714 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.029706 25073 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.448377 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:46.027568 25078 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:46.032042 25055 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.856s	user 0.003s	sys 0.000s
I20260709 12:10:46.022354 24945 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.398360 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:46.471625 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 73363us
I20260709 12:10:46.399375 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:46.030383 25038 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:46.048648 24881 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:46.391033 24772 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:10:46.046780 24871 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:46.049629 24815 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:46.213188 25074 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:46.029564 24842 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:46.447607 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:46.491662 21999 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:46.453732 25051 consensus_meta.cc:287] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.001s
W20260709 12:10:46.455848 21998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.025s	sys 0.023s
I20260709 12:10:46.270358 25090 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.026185 24822 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:46.462230 21843 consensus_meta.cc:287] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.002s
I20260709 12:10:46.556893 21843 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:46.462563 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 629) took 1158 ms. Trace:
I20260709 12:10:46.558095 22581 rpcz_store.cc:276] 0709 12:10:45.292939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.316215 (+ 23276us) service_pool.cc:224] Handling call
0709 12:10:45.316467 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.316662 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:45.578626 (+261964us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.451193 (+872567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.451261 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:46.451324 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.451412 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.451561 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50433,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"thread_start_us":1112612,"threads_started":3,"wal-append.queue_time_us":891794}
I20260709 12:10:46.057289 25009 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:46.214195 24682 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:46.469733 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:46.460417 24714 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.480454 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1814) took 1396 ms. Trace:
I20260709 12:10:46.580699 21851 rpcz_store.cc:276] 0709 12:10:45.084132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.084267 (+   135us) service_pool.cc:224] Handling call
0709 12:10:45.084621 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.084845 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.084872 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.085322 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.183053 (+ 97731us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:45.183106 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.183174 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.031334 (+848160us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:46.480062 (+448728us) raft_consensus.cc:1685] finished
0709 12:10:46.480098 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.480377 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54051200,"thread_start_us":87152,"threads_started":1,"wal-append.queue_time_us":79915}
I20260709 12:10:46.391312 25099 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.212510 25082 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.481750 21846 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.383420 24688 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:46.541023 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 95276.2us
I20260709 12:10:46.588934 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:46.590013 22547 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:46.475538 25044 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.529292 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.551303 21998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.031s	sys 0.042s
I20260709 12:10:46.445796 25059 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.577800 21923 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:46.394707 25092 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.495450 25050 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:10:46.395700 25080 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.493299 24772 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
W20260709 12:10:46.583855 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 190710us
I20260709 12:10:46.600237 21924 raft_consensus.cc:2410] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:46.600371 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:46.604523 21925 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:46.549750 24815 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.605883 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:46.549499 25051 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.593736 25044 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.621627 25091 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:46.621102 25113 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:46.583930 25097 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.622538 25101 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.647521 25101 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.649291 24841 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.629463 21920 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:46.607649 24892 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.641911 25104 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.255s
I20260709 12:10:46.632002 25096 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.623122 25110 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.651420 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:46.631458 21849 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:10:46.658869 21844 raft_consensus.cc:2368] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8.
I20260709 12:10:46.659507 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:46.608438 25013 consensus_meta.cc:287] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.041s	user 0.009s	sys 0.003s
I20260709 12:10:46.549028 25074 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.641657 24842 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.577137 24904 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.584121 24682 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.630019 24958 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:46.650375 25101 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:46.635624 24824 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:46.599473 25092 consensus_queue.cc:1059] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:10:46.653887 25096 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:46.695771 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 222944us
I20260709 12:10:46.654214 25109 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:46.634214 24815 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.665537 25104 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:46.650494 25112 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.691169 25079 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:46.691095 25009 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:46.651212 25102 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.253s
I20260709 12:10:46.712957 21849 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:46.633846 25090 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.665026 25013 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.650645 25118 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:10:46.696679 25119 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.720011 25079 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.721287 25080 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:46.722142 25098 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.698122 24824 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.665446 25110 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.723726 24815 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:46.659099 25097 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.727983 25067 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.751187 25051 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:46.752095 25090 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:46.655270 25113 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.728964 25044 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:46.695999 24958 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:46.726898 25121 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:46.710749 25104 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.729956 25059 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:46.655088 25091 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.750084 24682 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:46.730034 24688 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:46.788317 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 78225.9us
I20260709 12:10:46.776628 24945 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.707103 25109 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.743393 25082 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:46.715231 25009 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.702625 25096 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:46.740823 25119 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.323211 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:47.328652 21993 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.006s	sys 0.024s
I20260709 12:10:46.817581 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:47.393023 21993 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.010s	sys 0.024s
W20260709 12:10:47.140311 21966 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.562s (SENT) [suppressed 13 similar messages]
I20260709 12:10:46.818758 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:46.750130 25125 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.777807 24892 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:47.392313 21846 consensus_meta.cc:287] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.015s
I20260709 12:10:47.407299 21846 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:46.887306 21923 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:47.408962 21923 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:47.399739 21996 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.399801 21992 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.393097 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:46.815155 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1895) took 1229 ms. Trace:
I20260709 12:10:47.410669 21926 rpcz_store.cc:276] 0709 12:10:45.585684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.586619 (+   935us) service_pool.cc:224] Handling call
0709 12:10:45.586948 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.629056 (+ 42108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.629090 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.629154 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:45.629188 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.814928 (+1185740us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b54002e7554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:46.814971 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.815093 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96419712}
W20260709 12:10:47.355597 25090 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.009s	sys 0.023s
I20260709 12:10:46.997464 25042 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.999361 25098 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.907684 25099 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.912680 24829 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.413872 21850 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.194186 24822 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.911989 24553 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:46.997159 24766 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:47.457834 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:47.458861 21926 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.242690 24688 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:47.098189 25118 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:47.397562 24958 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.395906 24824 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:47.113986 25102 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:47.437793 25042 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:47.442935 21892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.013s	sys 0.007s
W20260709 12:10:47.477681 21892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.013s	sys 0.007s
I20260709 12:10:46.789456 25121 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.444262 21996 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
W20260709 12:10:47.432248 25090 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.009s	sys 0.024s
I20260709 12:10:47.445303 21851 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.449451 21992 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:47.422863 21923 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.480134 21923 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.795204 25091 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:47.395141 25110 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:47.441495 24904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.002s	sys 0.020s
I20260709 12:10:47.457536 24553 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.484277 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2161) took 1095 ms. Trace:
I20260709 12:10:47.499049 21992 rpcz_store.cc:276] 0709 12:10:46.389185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.483201 (+1094016us) service_pool.cc:224] Handling call
0709 12:10:47.483607 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.483854 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.483894 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.483950 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.484000 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.484072 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.484206 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.502007 25127 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.487499 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2160) took 1099 ms. Trace:
I20260709 12:10:47.502609 25127 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.502753 21996 rpcz_store.cc:276] 0709 12:10:46.388465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.486792 (+1098327us) service_pool.cc:224] Handling call
0709 12:10:47.487071 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.487231 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.487254 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.487291 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.487319 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.487364 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.487451 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.504752 21996 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.504848 25127 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.505591 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2163) took 1115 ms. Trace:
W20260709 12:10:47.507580 25043 log.cc:927] Time spent T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 2.337s	user 0.010s	sys 0.009s
I20260709 12:10:47.508162 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1903) took 1459 ms. Trace:
I20260709 12:10:47.508388 21920 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:47.508563 21924 rpcz_store.cc:276] 0709 12:10:46.049180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.399118 (+349938us) service_pool.cc:224] Handling call
0709 12:10:47.507951 (+1108833us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54003610d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:47.508106 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288677632}
I20260709 12:10:47.508963 25129 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:47.509718 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.509598 25129 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.510097 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.506186 21996 rpcz_store.cc:276] 0709 12:10:46.390376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.504105 (+1113729us) service_pool.cc:224] Handling call
0709 12:10:47.504520 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.505282 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.505507 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.511418 24841 raft_consensus.cc:3055] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:47.511855 25129 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:47.512148 24841 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:47.513209 24841 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.515069 24841 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:47.515700 25087 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.960s	user 0.005s	sys 0.008s
I20260709 12:10:47.516017 25096 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:47.520714 21923 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:47.521492 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1902) took 1472 ms. Trace:
I20260709 12:10:47.521884 21923 rpcz_store.cc:276] 0709 12:10:46.048816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.593746 (+544930us) service_pool.cc:224] Handling call
0709 12:10:46.594067 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.887203 (+293136us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54004a2f20. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d12dc0 00007f3be4d9d1c0 00007f3be4d9e231 00007f3be4d9ad8f 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c
0709 12:10:47.521170 (+633967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.521425 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286109952}
I20260709 12:10:47.423436 25125 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:47.498498 24904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.002s	sys 0.021s
I20260709 12:10:47.527712 21923 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:47.481137 24824 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:47.533921 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2164) took 1143 ms. Trace:
I20260709 12:10:47.534451 21996 rpcz_store.cc:276] 0709 12:10:46.390932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.516758 (+1125826us) service_pool.cc:224] Handling call
0709 12:10:47.533299 (+ 16541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.533523 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.533560 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.533612 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:47.533665 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.533734 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.533854 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.537815 21926 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:47.539644 21926 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:47.469190 24766 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.472647 25118 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.472431 24688 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.505548 25127 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:47.526531 24848 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:10:47.464880 24822 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.481361 25102 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.553887 21996 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.556928 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2165) took 1164 ms. Trace:
I20260709 12:10:47.557441 21996 rpcz_store.cc:276] 0709 12:10:46.392541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.535589 (+1143048us) service_pool.cc:224] Handling call
0709 12:10:47.553665 (+ 18076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.556639 (+  2974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.556859 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:47.555178 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 163392us
I20260709 12:10:47.583240 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:47.585433 21926 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.605834 25109 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:47.606572 25109 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:47.607110 25109 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.607539 25001 raft_consensus.cc:3055] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.607972 25001 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:47.608825 25001 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.609362 25109 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.553076 25127 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:47.610126 25001 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.610553 25030 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.610967 25129 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.611191 25125 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:47.610131 25127 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.613289 25096 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:47.613339 24945 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:47.614046 25091 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:47.616940 25009 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:47.616351 21996 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:10:47.618558 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.546020 24824 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.620050 25084 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:47.639931 21926 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
W20260709 12:10:47.642197 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 249150us
I20260709 12:10:47.614814 24904 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.613643 24818 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:47.614359 25121 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.655345 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:47.622535 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 482258us
I20260709 12:10:47.648702 25119 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.692158 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.694123 21926 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:47.695609 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:47.698478 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:47.699136 21996 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.651904 25137 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:47.701553 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.650380 25090 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.707258 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.715341 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.716414 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.717015 21926 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:10:47.708645 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:47.713481 21845 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:47.687412 25141 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:47.708024 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:47.642058 25129 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.723919 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:47.724517 21847 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:47.735651 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.736383 21926 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:47.693238 24829 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.748705 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2158) took 1361 ms. Trace:
I20260709 12:10:47.737108 25090 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.751917 25079 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.752609 25139 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.745309 25141 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.706619 25109 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:47.756577 25134 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:47.639734 25030 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.759689 21993 rpcz_store.cc:276] 0709 12:10:46.387177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.587473 (+200296us) service_pool.cc:224] Handling call
0709 12:10:46.589126 (+  1653us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:46.589478 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.589509 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:46.593790 (+  4281us) log.cc:844] Serialized 52 byte log entry
0709 12:10:46.737783 (+143993us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:47.393537 (+655754us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.562098 (+168561us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.562606 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.562702 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.748399 (+185697us) raft_consensus.cc:1685] finished
0709 12:10:47.748429 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.748626 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":976,"prepare.queue_time_us":735352,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":20586,"raft.queue_time_us":133108,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":17998,"thread_start_us":963648,"threads_started":3,"wal-append.queue_time_us":900326}
W20260709 12:10:47.780972 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 133521us
I20260709 12:10:47.781663 21922 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:47.787103 24766 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:47.786548 25079 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:47.788190 25130 log.cc:927] Time spent T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:10:47.867353 25141 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:47.788843 25126 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:10:47.721414 25137 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.711485 25119 consensus_queue.cc:1059] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:10:47.792033 25102 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.687719 24904 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.902254 24904 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.794859 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:47.903240 21843 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:47.689308 25084 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.795274 25127 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.904369 25074 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:47.905964 25057 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 2.729s	user 0.004s	sys 0.017s
I20260709 12:10:47.906742 25127 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:47.907493 25127 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.909317 25127 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.784090 25038 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.656780 25091 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.816736 25125 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:47.920580 25125 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:47.921126 21848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1826) took 2024 ms (client timeout 1730 ms). Trace:
W20260709 12:10:47.921567 21848 rpcz_store.cc:269] 0709 12:10:45.896522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.896631 (+   109us) service_pool.cc:224] Handling call
0709 12:10:47.920915 (+2024284us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b54000a87d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:47.921057 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81395968}
I20260709 12:10:47.924765 25090 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:47.926815 25042 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.828006 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1721) took 1125 ms. Trace:
I20260709 12:10:47.932482 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1628) took 2346 ms. Trace:
I20260709 12:10:47.932773 21851 rpcz_store.cc:276] 0709 12:10:46.702256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.702465 (+   209us) service_pool.cc:224] Handling call
0709 12:10:46.702735 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.478847 (+776112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.827656 (+348809us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b5400049a54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:47.827925 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707363072}
I20260709 12:10:47.831893 25104 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:47.833230 25134 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.738910 25121 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:47.907569 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 799) took 2885 ms. Trace:
I20260709 12:10:47.809719 25139 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.931123 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:47.954648 21996 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:47.957358 22582 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:10:47.809280 25049 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 2.639s	user 0.000s	sys 0.014s
I20260709 12:10:47.826761 25097 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:47.934334 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:47.932914 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:47.811472 24822 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:47.932889 22000 rpcz_store.cc:276] 0709 12:10:45.586258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.586370 (+   112us) service_pool.cc:224] Handling call
0709 12:10:45.586657 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.586856 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:45.687138 (+100282us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.931974 (+2244836us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b180044f320. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be49434bc 00007f3be1c9148b 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b23a
0709 12:10:47.932161 (+   187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.932209 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.932257 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.932332 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.932430 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142694,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"spinlock_wait_cycles":71732096,"thread_start_us":169426,"threads_started":2,"wal-append.queue_time_us":192091,"wal-append.run_cpu_time_us":10893,"wal-append.run_wall_time_us":1513380}
I20260709 12:10:47.970142 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:47.970440 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:47.971050 22584 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:47.944243 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1899) took 1896 ms. Trace:
I20260709 12:10:47.947523 22581 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:47.950345 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:47.950877 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2096) took 1306 ms. Trace:
I20260709 12:10:47.951556 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:47.951759 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:47.952633 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:47.954124 22583 rpcz_store.cc:276] 0709 12:10:45.022275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.022477 (+   202us) service_pool.cc:224] Handling call
0709 12:10:45.022834 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:45.033636 (+ 10802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.033671 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:45.051873 (+ 18202us) log.cc:844] Serialized 52 byte log entry
0709 12:10:45.174543 (+122670us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.224127 (+ 49584us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.224506 (+   379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.224569 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.905252 (+2680683us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:47.907264 (+  2012us) raft_consensus.cc:1685] finished
0709 12:10:47.907348 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.907483 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12661,"prepare.queue_time_us":95057,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":315,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":8461,"spinlock_wait_cycles":54246144,"thread_start_us":124182,"threads_started":2,"wal-append.queue_time_us":104931}
I20260709 12:10:47.972566 21920 rpcz_store.cc:276] 0709 12:10:46.644333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.511159 (+866826us) service_pool.cc:224] Handling call
0709 12:10:47.511425 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.581226 (+ 69801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.581268 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.581328 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.581383 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.823537 (+242154us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b54002e6154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:47.823607 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.950823 (+127216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159944064}
I20260709 12:10:47.653214 25096 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:47.961898 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.973280 22577 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.973994 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.967203 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:47.979162 22582 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:47.980095 21920 raft_consensus.cc:2393] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:47.968843 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:47.943356 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:47.973446 22576 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
I20260709 12:10:47.984601 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:47.985432 22579 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:47.987197 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:47.988919 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:47.989615 22000 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:47.971846 21918 rpcz_store.cc:276] 0709 12:10:46.047746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.474782 (+427036us) service_pool.cc:224] Handling call
0709 12:10:46.491289 (+ 16507us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:46.636200 (+144911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.636233 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:46.660525 (+ 24292us) log.cc:844] Serialized 52 byte log entry
0709 12:10:46.791969 (+131444us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:46.792009 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.792075 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.869196 (+1077121us) raft_consensus.cc:1685] finished
0709 12:10:47.869226 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.944178 (+ 74952us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":161992,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":235472,"threads_started":2,"wal-append.queue_time_us":788990}
I20260709 12:10:47.992796 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:47.994503 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:47.965181 21817 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:48.001791 22577 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:48.002805 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:48.042528 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:48.042377 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:48.003662 21926 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:48.004099 21999 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:48.043789 22577 raft_consensus.cc:2376] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6. Re-sending same reply.
I20260709 12:10:47.858363 25109 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:47.954069 25030 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:47.995239 22000 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:48.009711 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:48.013725 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.045632 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:47.967721 24904 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.047945 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:47.966387 25121 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:48.015498 22583 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:48.019316 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:47.984622 24710 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:48.024148 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 59020.8us
I20260709 12:10:48.025455 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.067250 22581 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:48.028497 21993 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
W20260709 12:10:48.010926 25047 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.401s	user 0.030s	sys 0.030s
I20260709 12:10:48.029165 25098 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.029930 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:48.084302 21843 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:48.045258 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.046393 22000 raft_consensus.cc:2393] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:48.040442 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:48.014590 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.048765 21852 raft_consensus.cc:2393] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:48.039470 24688 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:48.085726 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.052760 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:48.054147 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.055531 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.020830 24958 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:48.063436 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:48.065734 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.071152 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:48.089564 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.071321 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:48.034354 24696 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:48.081614 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:48.082580 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:48.087172 22583 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.087591 22582 raft_consensus.cc:2376] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6. Re-sending same reply.
W20260709 12:10:48.068852 25143 log.cc:927] Time spent T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:10:48.092909 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.013973 25133 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:10:48.072551 25008 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.119639 22577 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:48.117383 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:48.120450 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:48.122277 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 166659us
I20260709 12:10:48.132480 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.132779 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:48.133466 22577 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:48.131969 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:48.122856 22581 raft_consensus.cc:2376] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8. Re-sending same reply.
I20260709 12:10:48.134608 22000 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:10:48.123539 21993 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.135691 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:48.136337 22000 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.063971 25030 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:48.124805 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 84443.6us
W20260709 12:10:48.083204 25047 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.481s	user 0.030s	sys 0.030s
I20260709 12:10:48.129528 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.079113 25125 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:48.134690 21818 leader_election.cc:336] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Timed out: RequestConsensusVote RPC to 127.20.56.68:40043 timed out after 1.591s (SENT)
I20260709 12:10:48.129344 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.072193 25129 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:48.150838 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.155763 21852 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:48.161486 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:48.145998 24553 consensus_meta.cc:287] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 12:10:48.067698 24904 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:48.146968 24822 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.183642 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:48.083103 24710 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:48.184140 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:48.151958 24841 consensus_meta.cc:287] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.001s
I20260709 12:10:48.185880 22581 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.183660 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.146740 25008 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.165140 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:48.203368 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 113018us
I20260709 12:10:48.204932 22000 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:48.130364 25009 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:48.146260 24688 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.091892 25015 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:10:48.147606 25047 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:48.118490 24958 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:48.052589 24988 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:48.280478 21995 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:48.282809 21852 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:48.355641 21844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1824) took 2460 ms (client timeout 1562 ms). Trace:
I20260709 12:10:48.294198 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:48.446079 21844 rpcz_store.cc:269] 0709 12:10:45.895196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.895327 (+   131us) service_pool.cc:224] Handling call
0709 12:10:48.355357 (+2460030us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b5400215f54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:48.355553 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730464512}
I20260709 12:10:48.378901 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.447763 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.448422 21919 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:48.327220 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1629) took 2740 ms. Trace:
I20260709 12:10:48.305783 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2095) took 1671 ms. Trace:
I20260709 12:10:48.350481 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 462) took 1746 ms. Trace:
I20260709 12:10:48.449112 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.402930 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:48.449942 21844 raft_consensus.cc:2368] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8.
I20260709 12:10:48.445411 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1637) took 1734 ms. Trace:
I20260709 12:10:48.450789 21995 rpcz_store.cc:276] 0709 12:10:46.711489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.279792 (+1568303us) service_pool.cc:224] Handling call
0709 12:10:48.280111 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.445150 (+165039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.445357 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.363582 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2151) took 3235 ms. Trace:
I20260709 12:10:48.449553 21850 rpcz_store.cc:276] 0709 12:10:46.604493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.605054 (+   561us) service_pool.cc:224] Handling call
0709 12:10:46.605350 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.439684 (+834334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.350167 (+910483us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54003e3ad4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:48.350389 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858371456}
I20260709 12:10:48.452025 22001 rpcz_store.cc:276] 0709 12:10:45.128472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.129707 (+  1235us) service_pool.cc:224] Handling call
0709 12:10:45.130009 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.577793 (+447784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.363288 (+2785495us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54000d3754. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:48.363507 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021343488}
I20260709 12:10:48.452605 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.453557 21850 raft_consensus.cc:2393] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:48.277596 22584 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:48.448299 22580 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:48.301719 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1881) took 3303 ms. Trace:
I20260709 12:10:48.176893 22583 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:48.366668 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:48.446560 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 152465us
I20260709 12:10:48.209755 21993 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:48.512588 22549 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:48.450563 21921 rpcz_store.cc:276] 0709 12:10:46.637326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.925201 (+1287875us) service_pool.cc:224] Handling call
0709 12:10:47.925527 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.017657 (+ 92130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.017687 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.017726 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:48.017754 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.305456 (+287702us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b5400360454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:48.305521 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.305703 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211442048}
I20260709 12:10:48.331670 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 802) took 2950 ms. Trace:
I20260709 12:10:48.455966 21927 rpcz_store.cc:276] 0709 12:10:44.998510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.998680 (+   170us) service_pool.cc:224] Handling call
0709 12:10:45.001880 (+  3200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.112738 (+110858us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:45.120121 (+  7383us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.610781 (+2490660us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b1800309e80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b23a 00007f3be4da5a2a
0709 12:10:47.780068 (+169287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.780508 (+   440us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:47.780583 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.288489 (+507906us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b1800309e80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:48.299964 (+ 11475us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800309e80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c7c2a6 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419
0709 12:10:48.301367 (+  1403us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003606d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:48.301423 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.301605 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18245,"prepare.queue_time_us":6596,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":75437,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":42302,"spinlock_wait_cycles":309460352,"thread_start_us":150704,"threads_started":2,"wal-append.queue_time_us":2615450}
I20260709 12:10:48.510340 22582 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.513489 22578 rpcz_store.cc:276] 0709 12:10:45.381287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.381430 (+   143us) service_pool.cc:224] Handling call
0709 12:10:45.414608 (+ 33178us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:45.415373 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.331386 (+2916013us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b540054db50. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:48.331591 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75243264}
I20260709 12:10:48.403513 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2098) took 1694 ms. Trace:
I20260709 12:10:48.514751 21924 rpcz_store.cc:276] 0709 12:10:46.709024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.512012 (+802988us) service_pool.cc:224] Handling call
0709 12:10:47.512265 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.516707 (+  4442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.516733 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.516775 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:47.516812 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.403230 (+886418us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b54003e7bd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:48.403289 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.403444 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9776896}
W20260709 12:10:48.458031 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 71263.3us
I20260709 12:10:48.297339 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:48.164739 25001 consensus_meta.cc:287] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.003s
I20260709 12:10:48.526293 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.211155 21996 pending_rounds.cc:85] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 5
I20260709 12:10:48.527230 22000 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.527526 21996 pending_rounds.cc:107] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:10:48.527839 21996 raft_consensus.cc:2889] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.525987 22001 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:48.528617 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.528873 22000 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:48.365785 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.532114 21845 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:48.533020 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:48.533102 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:48.533576 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.535233 21993 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:48.535526 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.533174 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:48.536434 22583 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:48.536024 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.534749 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.538313 22575 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:48.366255 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:48.284598 21851 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.540071 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:48.279268 21846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1827) took 2381 ms (client timeout 2140 ms). Trace:
I20260709 12:10:48.211308 21999 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:48.540683 22581 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:10:48.540967 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.541358 21845 raft_consensus.cc:2368] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:48.454653 21998 rpcz_store.cc:276] 0709 12:10:45.586708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.587017 (+   309us) service_pool.cc:224] Handling call
0709 12:10:45.617753 (+ 30736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.913685 (+295932us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:45.942222 (+ 28537us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.594711 (+652489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.594758 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:46.594811 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.326900 (+1732089us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b540018fbd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:48.326962 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.327143 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28756,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":4645,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5238,"spinlock_wait_cycles":680056192,"thread_start_us":648360,"threads_started":1,"wal-append.queue_time_us":546872,"wal-append.run_cpu_time_us":1259,"wal-append.run_wall_time_us":1154485}
I20260709 12:10:48.541117 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1634) took 1837 ms. Trace:
W20260709 12:10:48.328095 21925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1897) took 2281 ms (client timeout 1864 ms). Trace:
I20260709 12:10:48.188659 25079 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:48.379850 25143 log.cc:927] Time spent T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:48.542689 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.164891 25152 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:48.274448 21923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.008s
I20260709 12:10:48.438575 25151 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.342120 25127 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:48.380836 25084 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:48.329825 25067 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:48.296615 25162 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:48.381332 25096 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:48.248481 25091 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:48.363006 24714 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:48.163357 25030 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:48.360183 24889 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:48.311414 24824 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:48.202256 24766 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.415s
W20260709 12:10:49.457528 21923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.693s	user 0.039s	sys 0.039s
I20260709 12:10:49.451458 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:48.568207 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.543102 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:49.445788 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.615903 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:49.444519 21848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.169s	user 0.003s	sys 0.022s
I20260709 12:10:48.626708 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:48.607817 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 90393.9us
I20260709 12:10:49.474020 25015 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:48.588891 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50487us
I20260709 12:10:49.475517 24759 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.475061 25152 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.476312 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:49.476732 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1728) took 1447 ms. Trace:
I20260709 12:10:49.476531 24759 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:49.477291 21852 rpcz_store.cc:276] 0709 12:10:48.029521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.156638 (+127117us) service_pool.cc:224] Handling call
0709 12:10:48.282613 (+125975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.450425 (+167812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.476205 (+1025780us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000933d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:49.476481 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288816512}
I20260709 12:10:48.332173 25139 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:48.824801 25001 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.160806 22549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.012s	sys 0.040s
W20260709 12:10:49.479766 22549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.012s	sys 0.065s
I20260709 12:10:49.479573 25001 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:49.480475 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 967895us
W20260709 12:10:49.482720 21925 rpcz_store.cc:269] 0709 12:10:46.046896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.083523 (+ 36627us) service_pool.cc:224] Handling call
0709 12:10:48.327814 (+2244291us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54001707d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:48.327945 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473000192}
I20260709 12:10:49.484930 21817 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:48.734361 21964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.016s	sys 0.007s
I20260709 12:10:49.486531 25114 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:49.486829 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2162) took 3096 ms. Trace:
I20260709 12:10:49.487360 25114 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:49.487466 21999 rpcz_store.cc:276] 0709 12:10:46.703402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.162811 (+1459409us) service_pool.cc:224] Handling call
0709 12:10:48.211081 (+ 48270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.540785 (+329704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.541047 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.582002 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:49.489415 22578 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:49.487358 21992 rpcz_store.cc:276] 0709 12:10:46.389777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.500564 (+1110787us) service_pool.cc:224] Handling call
0709 12:10:47.501047 (+   483us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:47.501531 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.501572 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:47.502383 (+   811us) log.cc:844] Serialized 52 byte log entry
0709 12:10:47.624468 (+122085us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.652486 (+ 28018us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.683695 (+ 31209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.683816 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.400216 (+716400us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b18004a2a80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae522 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:49.486074 (+1085858us) raft_consensus.cc:1685] finished
0709 12:10:49.486211 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.486500 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30919,"prepare.queue_time_us":30040,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2735,"raft.queue_time_us":38687,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":15141,"spinlock_wait_cycles":22754688,"thread_start_us":115306,"threads_started":1,"wal-append.queue_time_us":357285}
I20260709 12:10:49.490890 25038 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:49.491932 25001 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.491729 25114 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:48.543594 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.448549 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:48.525837 24822 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:49.494020 21850 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:49.494329 24822 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.494727 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1841) took 1129 ms. Trace:
I20260709 12:10:49.494948 25149 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:49.493090 21847 raft_consensus.cc:2393] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:49.496150 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1846) took 1115 ms. Trace:
I20260709 12:10:49.496485 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1850) took 1114 ms. Trace:
I20260709 12:10:49.496577 21851 rpcz_store.cc:276] 0709 12:10:48.380537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.541777 (+161240us) service_pool.cc:224] Handling call
0709 12:10:49.496066 (+954289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.012605 24710 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.497220 25072 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:49.498013 25072 raft_consensus.cc:697] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:49.446647 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1911) took 1519 ms. Trace:
W20260709 12:10:49.498383 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 337961us
I20260709 12:10:49.499596 25072 consensus_queue.cc:237] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:49.498741 21920 rpcz_store.cc:276] 0709 12:10:47.926897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.980693 (+ 53796us) service_pool.cc:224] Handling call
0709 12:10:47.980993 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.020484 (+ 39491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.020522 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.021012 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.435165 (+414153us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:48.435224 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.435324 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.445835 (+1010511us) raft_consensus.cc:1685] finished
0709 12:10:49.445912 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.446319 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33013,"raft.queue_time_us":42157,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":11272,"thread_start_us":413755,"threads_started":1,"wal-append.queue_time_us":975789}
W20260709 12:10:49.500772 21848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.004s	sys 0.023s
I20260709 12:10:49.500954 25001 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.502190 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1724) took 1489 ms. Trace:
I20260709 12:10:49.501901 25001 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.502614 21848 rpcz_store.cc:276] 0709 12:10:48.012337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.015677 (+  3340us) service_pool.cc:224] Handling call
0709 12:10:48.015934 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.016123 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:48.274792 (+258669us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.501602 (+1226810us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.501717 (+   115us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:49.501829 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.501960 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.502135 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":191100,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"thread_start_us":1471643,"threads_started":2}
I20260709 12:10:49.504842 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:49.505209 25001 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:49.505703 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1837) took 1141 ms. Trace:
W20260709 12:10:49.487056 21964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.349s	user 0.028s	sys 0.018s
I20260709 12:10:48.560077 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.718912 25047 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:49.506922 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 1.36929e+06us
I20260709 12:10:49.508169 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.059904 24945 raft_consensus.cc:3055] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:49.510603 24945 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:49.510378 25085 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:49.511531 25085 consensus_queue.cc:1243] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:49.512600 24945 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:49.495198 21850 rpcz_store.cc:276] 0709 12:10:48.365006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.555232 (+190226us) service_pool.cc:224] Handling call
0709 12:10:49.494597 (+939365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.638240 25050 consensus_queue.cc:1059] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.889s
I20260709 12:10:49.491863 25038 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:48.206067 25098 raft_consensus.cc:697] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:49.515244 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:49.507930 25149 consensus_queue.cc:1059] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:48.401023 25013 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.515574 21843 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:49.520117 25149 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:49.520404 25152 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.520574 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:49.521042 25152 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:49.520854 25149 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:48.337097 25137 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:49.194875 24866 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.002s	sys 0.006s
I20260709 12:10:48.637918 25058 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.879s
W20260709 12:10:49.523223 24866 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.006s	sys 0.006s
I20260709 12:10:49.498337 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:49.489971 22577 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.524389 21851 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:49.525143 25149 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:48.336586 25121 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:49.195070 21996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.002s	sys 0.006s
W20260709 12:10:49.527984 21996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.003s	sys 0.007s
I20260709 12:10:48.525936 25110 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.517660 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:49.524017 24759 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.529209 22581 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:49.492328 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 813) took 1163 ms. Trace:
I20260709 12:10:49.531168 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 816) took 1201 ms. Trace:
I20260709 12:10:49.531554 22581 rpcz_store.cc:276] 0709 12:10:48.329342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.543369 (+214027us) service_pool.cc:224] Handling call
0709 12:10:49.530959 (+987590us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b5400451854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:49.531092 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80938368}
I20260709 12:10:49.531904 21964 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:49.534173 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:49.530498 25058 raft_consensus.cc:3055] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.536194 25058 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:49.518100 25098 consensus_queue.cc:237] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:49.011499 25113 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.496929 21847 rpcz_store.cc:276] 0709 12:10:48.381725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.769937 (+388212us) service_pool.cc:224] Handling call
0709 12:10:49.496408 (+726471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.518836 25038 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.530857 22578 rpcz_store.cc:276] 0709 12:10:48.328390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.535814 (+207424us) service_pool.cc:224] Handling call
0709 12:10:49.492019 (+956205us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540057a3d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:49.492211 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189445376}
I20260709 12:10:49.517585 21850 raft_consensus.cc:2376] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8. Re-sending same reply.
W20260709 12:10:48.904785 22579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.011s	sys 0.018s
W20260709 12:10:49.538820 22579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.262s	user 0.014s	sys 0.037s
I20260709 12:10:49.538962 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.534699 24688 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.540179 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 680) took 1199 ms. Trace:
I20260709 12:10:49.540256 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:48.539145 25133 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.311230 25134 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.516258 25015 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.550094 25015 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:48.364207 25089 raft_consensus.cc:3055] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.551187 25089 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:49.551651 25015 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:48.542021 21846 rpcz_store.cc:269] 0709 12:10:45.897471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.897594 (+   123us) service_pool.cc:224] Handling call
0709 12:10:48.279056 (+2381462us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54000933d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:48.279190 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217848192}
I20260709 12:10:49.554222 25015 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.554875 21846 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:49.194694 24815 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.005s	sys 0.005s
I20260709 12:10:49.556751 25110 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:49.557106 24815 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.007s	sys 0.007s
I20260709 12:10:49.557363 25110 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.011678 24958 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:48.615481 25118 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:49.438107 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 1.14054e+06us
I20260709 12:10:49.557752 25058 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:49.560962 25058 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.562136 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:48.352818 24848 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:48.586884 25105 log.cc:927] Time spent T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 2.105s	user 0.006s	sys 0.011s
I20260709 12:10:49.563674 24848 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:48.339429 25109 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.517762 21845 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:49.521850 25152 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.566625 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1854) took 1024 ms. Trace:
I20260709 12:10:49.567066 21845 rpcz_store.cc:276] 0709 12:10:48.542669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.542880 (+   211us) service_pool.cc:224] Handling call
0709 12:10:49.566540 (+1023660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.535550 25125 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:49.570050 21847 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:49.569242 25125 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.525919 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:49.521529 21843 raft_consensus.cc:2376] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8. Re-sending same reply.
I20260709 12:10:49.535028 22581 raft_consensus.cc:2376] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7. Re-sending same reply.
W20260709 12:10:49.547569 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 62908.7us
I20260709 12:10:48.546494 24841 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:49.535030 25084 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:48.526473 25009 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:48.691924 24904 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:48.463016 25008 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.506207 21848 rpcz_store.cc:276] 0709 12:10:48.363852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.504371 (+1140519us) service_pool.cc:224] Handling call
0709 12:10:49.505614 (+  1243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.548131 22584 rpcz_store.cc:276] 0709 12:10:48.341081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.593893 (+252812us) service_pool.cc:224] Handling call
0709 12:10:49.540080 (+946187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.551213 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.579094 21851 raft_consensus.cc:1813] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Handling vote request from an unknown peer 73070a828b23480e9c3588e376bce2ab
W20260709 12:10:49.241755 24988 consensus_meta.cc:287] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 12:10:49.229931 25150 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:10:49.254446 25031 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.003s	sys 0.009s
W20260709 12:10:49.596235 25031 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.005s	sys 0.009s
I20260709 12:10:48.209983 24553 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.550056 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:49.556332 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1843) took 1176 ms. Trace:
I20260709 12:10:49.518455 25091 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 12:10:48.659490 25146 log.cc:927] Time spent T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.533s	user 0.001s	sys 0.000s
I20260709 12:10:49.581419 25084 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.600986 21851 raft_consensus.cc:2410] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:49.600617 21846 rpcz_store.cc:276] 0709 12:10:48.379506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.553578 (+1174072us) service_pool.cc:224] Handling call
0709 12:10:49.554188 (+   610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.555782 (+  1594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.556188 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.603148 22580 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:49.604786 21918 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:49.605638 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.605958 24710 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.606524 25084 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.606794 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 817) took 1120 ms. Trace:
I20260709 12:10:49.609931 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:49.610963 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:49.611184 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:49.611820 25009 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:49.611934 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:49.612521 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:49.613415 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:49.611980 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:49.614908 22578 rpcz_store.cc:276] 0709 12:10:48.486427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.605110 (+1118683us) service_pool.cc:224] Handling call
0709 12:10:49.606714 (+  1604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.546186 25151 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.620103 21995 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:49.622233 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.626803 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:49.620853 25152 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:49.628027 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:49.625226 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44604.5us
I20260709 12:10:49.633126 21997 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:49.633204 25150 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.581066 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:49.631219 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 435) took 1497 ms. Trace:
I20260709 12:10:49.638208 22000 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
W20260709 12:10:49.638433 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 814) took 1309 ms (client timeout 1616 ms). Trace:
I20260709 12:10:49.639698 25133 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:49.639947 22580 rpcz_store.cc:269] 0709 12:10:48.328715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.526065 (+197350us) service_pool.cc:224] Handling call
0709 12:10:49.638178 (+1112113us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000ffd54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:49.638320 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2466296064}
I20260709 12:10:49.639717 21817 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:49.643283 24958 consensus_queue.cc:1059] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:49.645725 25013 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:49.646459 25013 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:49.647034 22581 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.648056 25013 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.650838 25115 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:49.653143 25115 raft_consensus.cc:3055] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.653661 25115 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:49.654215 25125 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.654937 21998 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:10:49.655787 24710 consensus_queue.cc:1059] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:49.657430 25150 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:49.657781 25073 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.657998 24841 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:49.658313 25073 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:49.658574 24841 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.635042 21918 rpcz_store.cc:276] 0709 12:10:48.134072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.134197 (+   125us) service_pool.cc:224] Handling call
0709 12:10:49.630964 (+1496767us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540014bc54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:49.631130 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653104000}
I20260709 12:10:49.668444 25169 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.672405 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1838) took 1268 ms. Trace:
I20260709 12:10:49.672868 21844 rpcz_store.cc:276] 0709 12:10:48.364144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.542462 (+178318us) service_pool.cc:224] Handling call
0709 12:10:49.625202 (+1082740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.673885 25133 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:49.677066 22583 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:10:49.682564 25161 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:49.675457 24945 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.691960 24824 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:49.690577 25073 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:49.695683 22581 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:49.694280 25073 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.698897 24848 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:49.700094 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 138161us
I20260709 12:10:49.702872 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 688) took 1352 ms. Trace:
I20260709 12:10:49.703403 22581 rpcz_store.cc:276] 0709 12:10:48.456921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.587953 (+1131032us) service_pool.cc:224] Handling call
0709 12:10:49.696352 (+108399us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:49.705730 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 199388us
I20260709 12:10:49.706871 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:49.715054 25151 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.721887 22582 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:49.729880 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 683) took 1385 ms. Trace:
I20260709 12:10:49.736636 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.735598 22582 rpcz_store.cc:276] 0709 12:10:48.342072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.660322 (+1318250us) service_pool.cc:224] Handling call
0709 12:10:49.700902 (+ 40580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.726776 (+ 25874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.726980 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.738238 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:49.740502 22578 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEARNER]: Advancing to term 7
I20260709 12:10:49.742549 22584 raft_consensus.cc:2410] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:49.719887 25161 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:49.745132 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 682) took 1403 ms. Trace:
I20260709 12:10:49.745428 22584 rpcz_store.cc:276] 0709 12:10:48.341742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.730903 (+1389161us) service_pool.cc:224] Handling call
0709 12:10:49.745067 (+ 14164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.701787 25133 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:49.736636 25169 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.748605 25030 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:49.716809 25115 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:49.749945 24553 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:49.749979 25115 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.754479 25162 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:49.760542 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 127804us
I20260709 12:10:49.761550 21966 leader_election.cc:400] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8.
I20260709 12:10:49.761866 21966 leader_election.cc:403] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:49.763725 21849 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:49.765779 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:49.797953 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 91266.4us
I20260709 12:10:49.764860 25067 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.860399 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1842) took 1495 ms. Trace:
I20260709 12:10:49.860723 25031 raft_consensus.cc:3055] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.864445 25008 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.864712 24824 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:10:49.881083 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 82299.5us
I20260709 12:10:49.770877 25009 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8.
I20260709 12:10:49.865731 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:49.762267 25161 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:49.855284 24988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60614 (request call id 83) took 17587 ms. Trace:
I20260709 12:10:49.887563 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 685) took 1538 ms. Trace:
I20260709 12:10:49.901813 22580 rpcz_store.cc:276] 0709 12:10:48.342693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.641317 (+1298624us) service_pool.cc:224] Handling call
0709 12:10:49.641924 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.689779 (+ 47855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.689808 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.694606 (+  4798us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:49.694662 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.880775 (+186113us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b54004d12d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:49.880827 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.880972 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75022720}
I20260709 12:10:49.893796 25098 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:49.917479 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.862191 21852 rpcz_store.cc:276] 0709 12:10:48.365300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.570926 (+1205626us) service_pool.cc:224] Handling call
0709 12:10:49.607058 (+ 36132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.608312 (+  1254us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:49.676005 (+ 67693us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.859959 (+183954us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.860012 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:49.860088 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.860173 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.860313 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":147075,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":1101,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"thread_start_us":221686,"threads_started":2,"wal-append.queue_time_us":169167}
I20260709 12:10:49.917274 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1844) took 1537 ms. Trace:
I20260709 12:10:49.920182 25098 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:49.927155 25164 log.cc:927] Time spent T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 12:10:49.928129 25163 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:10:49.928457 24688 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:49.920672 22576 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:49.880430 25031 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:49.944188 22578 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:10:49.944275 22583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 811) took 1616 ms (client timeout 2089 ms). Trace:
I20260709 12:10:49.944994 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 812) took 1617 ms. Trace:
I20260709 12:10:49.945122 25113 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:49.945398 22578 rpcz_store.cc:276] 0709 12:10:48.328032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.667851 (+1339819us) service_pool.cc:224] Handling call
0709 12:10:49.704610 (+ 36759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.944720 (+240110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.944918 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137088}
I20260709 12:10:49.945957 22582 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 3.
W20260709 12:10:49.946532 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 374717us
I20260709 12:10:49.931366 22584 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:49.948108 22584 pending_rounds.cc:85] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 5
I20260709 12:10:49.904964 25150 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.937486 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:49.913334 25013 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.918169 25114 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.947490 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:49.944802 22583 rpcz_store.cc:269] 0709 12:10:48.327602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.559659 (+232057us) service_pool.cc:224] Handling call
0709 12:10:49.944071 (+1384412us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54004e9b54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:49.944215 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386386688}
I20260709 12:10:49.989840 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.948375 22584 pending_rounds.cc:107] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:49.993183 22584 raft_consensus.cc:2889] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:49.995101 25186 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:49.996165 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 807) took 1927 ms. Trace:
I20260709 12:10:49.996747 25110 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:49.998816 22581 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:49.894943 24988 rpcz_store.cc:276] 0709 12:10:32.267596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.547625 (+2280029us) service_pool.cc:224] Handling call
0709 12:10:34.632362 (+ 84737us) log.cc:844] Serialized 494 byte log entry
0709 12:10:35.165901 (+533539us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b18002d5a40. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:49.855023 (+14689122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3682,"raft.queue_time_us":5341,"raft.run_cpu_time_us":1572,"raft.run_wall_time_us":62909,"spinlock_wait_cycles":3475840,"thread_start_us":104219,"threads_started":1,"wal-append.queue_time_us":160117,"wal-append.run_cpu_time_us":1913,"wal-append.run_wall_time_us":1029938}
I20260709 12:10:49.991214 22580 raft_consensus.cc:2376] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7. Re-sending same reply.
I20260709 12:10:49.944417 25031 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:50.006671 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 278672us
W20260709 12:10:50.014256 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 148636us
I20260709 12:10:50.019264 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:50.015460 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 392833us
I20260709 12:10:50.005918 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.996608 22576 rpcz_store.cc:276] 0709 12:10:48.069247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.124449 (+ 55202us) service_pool.cc:224] Handling call
0709 12:10:49.995886 (+1871437us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400548b54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:49.996097 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4056886656}
I20260709 12:10:50.043816 22582 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:50.006878 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:50.014830 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:50.048506 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 101191us
W20260709 12:10:50.013863 25193 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:10:50.051196 22578 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:49.999730 25008 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:50.059033 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:50.008797 25031 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.011931 25125 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.065819 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.005092 24988 raft_consensus.cc:3055] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.011616 24553 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.055862 22577 consensus_meta.cc:287] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.003s
I20260709 12:10:50.073001 22577 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:50.076435 24841 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.078241 24815 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.078722 24815 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.078647 25050 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.079401 24815 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.079757 25050 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:50.082823 21918 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:50.084271 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 692) took 1468 ms. Trace:
I20260709 12:10:50.084647 22584 rpcz_store.cc:276] 0709 12:10:48.616147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.748146 (+1131999us) service_pool.cc:224] Handling call
0709 12:10:49.879955 (+131809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.084012 (+204057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.084214 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.012984 25169 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.016832 25150 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.006773 25013 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.106808 25013 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:50.107645 25175 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:10:50.109099 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:49.918751 21850 rpcz_store.cc:276] 0709 12:10:48.379930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.567615 (+1187685us) service_pool.cc:224] Handling call
0709 12:10:49.568188 (+   573us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:49.585198 (+ 17010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.585295 (+    97us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:49.618271 (+ 32976us) log.cc:844] Serialized 52 byte log entry
0709 12:10:49.879734 (+261463us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:49.916762 (+ 37028us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.917034 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.917088 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.917114 (+    26us) raft_consensus.cc:1685] finished
0709 12:10:49.917120 (+     6us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.917229 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36891,"raft.queue_time_us":726,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":27377,"spinlock_wait_cycles":27282816,"thread_start_us":204839,"threads_started":1,"wal-append.queue_time_us":195918}
I20260709 12:10:50.109797 22582 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
W20260709 12:10:50.111646 25058 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.014s
W20260709 12:10:50.111887 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.112349 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.070667 25114 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.098280 25125 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.114598 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1635) took 3410 ms. Trace:
I20260709 12:10:50.115490 25125 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:50.099571 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 220591us
I20260709 12:10:50.101800 21845 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:50.086189 25151 raft_consensus.cc:2764] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:10:50.121223 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 50840.5us
I20260709 12:10:50.102555 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:50.097158 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 691) took 1554 ms. Trace:
W20260709 12:10:50.115635 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.126660 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:50.073943 24988 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:50.114972 21996 rpcz_store.cc:276] 0709 12:10:46.703721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.210401 (+1506680us) service_pool.cc:224] Handling call
0709 12:10:48.210882 (+   481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:48.540065 (+329183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.540106 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:48.540651 (+   545us) log.cc:844] Serialized 52 byte log entry
0709 12:10:49.528737 (+988086us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:49.528841 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.528994 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.095416 (+566422us) raft_consensus.cc:1685] finished
0709 12:10:50.095435 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.114541 (+ 19106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":72118,"thread_start_us":843478,"threads_started":1,"wal-append.queue_time_us":1073827}
I20260709 12:10:50.131304 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:50.124280 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 58248.8us
I20260709 12:10:50.064240 24958 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:10:50.123980 22577 rpcz_store.cc:276] 0709 12:10:48.542748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.581679 (+ 38931us) service_pool.cc:224] Handling call
0709 12:10:50.073633 (+1491954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.136550 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 647) took 2143 ms. Trace:
I20260709 12:10:50.142858 25013 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.142859 24766 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:50.144758 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.147073 21920 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:50.106635 25169 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.106400 25089 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.153654 25089 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.154680 25110 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:50.154143 25169 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:50.142742 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:50.164891 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 48498.8us
I20260709 12:10:50.169838 22576 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:50.142266 22579 rpcz_store.cc:276] 0709 12:10:47.986366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.987489 (+  1123us) service_pool.cc:224] Handling call
0709 12:10:48.013634 (+ 26145us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:48.275465 (+261831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.275509 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:48.276291 (+   782us) log.cc:844] Serialized 52 byte log entry
0709 12:10:49.597490 (+1321199us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:49.602231 (+  4741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.612759 (+ 10528us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.118751 (+505992us) raft_consensus.cc:1685] finished
0709 12:10:50.118770 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.130027 (+ 11257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75749,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":53366,"thread_start_us":1524103,"threads_started":2,"wal-append.queue_time_us":1437617}
W20260709 12:10:50.174537 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 48032.4us
I20260709 12:10:50.166730 25133 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:10:50.178299 21926 raft_consensus.cc:2410] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:50.164116 25050 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:50.184514 25190 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:10:50.184829 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:50.185427 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:50.186393 22584 raft_consensus.cc:2410] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:50.191412 22579 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:50.192272 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.185514 22582 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:50.134367 24553 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.175879 24766 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:50.224859 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 51190.2us
I20260709 12:10:50.209770 21966 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:50.235600 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.235029 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:50.238598 22579 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
W20260709 12:10:50.240487 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 59319us
W20260709 12:10:50.244536 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.226406 24841 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:50.232335 25114 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:50.238005 25169 consensus_queue.cc:1059] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:10:50.263864 24766 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.273922 22584 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:10:50.277065 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:50.315644 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 59920us
I20260709 12:10:50.231874 24945 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:50.249851 24912 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.325268 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 686) took 1825 ms. Trace:
W20260709 12:10:50.276786 25015 consensus_meta.cc:287] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.000s
I20260709 12:10:50.262821 25161 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:50.339958 25150 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:50.344022 25162 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:50.278059 25141 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:50.345533 25141 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:50.538951 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 329266us
I20260709 12:10:50.540372 21966 leader_election.cc:400] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:50.540699 21966 leader_election.cc:403] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:10:50.577445 24822 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.082s	user 0.007s	sys 0.012s
I20260709 12:10:50.578728 24822 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:50.581174 24822 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:50.588609 24688 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.251492 24988 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.591321 24988 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.589745 24688 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.275707 24553 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:50.601109 24688 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:50.685328 25089 consensus_meta.cc:287] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.001s
I20260709 12:10:50.705416 24841 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.706084 24841 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.709270 24841 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:50.717001 21967 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:50.740120 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 508173us
I20260709 12:10:50.741472 24958 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:50.742197 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:50.756701 24958 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.757468 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:50.758466 24958 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:50.758890 24958 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.759227 24958 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:50.765974 22575 rpcz_store.cc:276] 0709 12:10:48.342970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.651105 (+1308135us) service_pool.cc:224] Handling call
0709 12:10:49.651519 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.651815 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:49.878967 (+227152us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.137091 (+258124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.137208 (+   117us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:50.167982 (+ 30774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.168065 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.168192 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3268,"prepare.queue_time_us":209836,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":6387,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":401897,"threads_started":2,"wal-append.queue_time_us":343072}
I20260709 12:10:50.777082 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:50.780889 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.780831 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.782230 24958 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.784029 21852 raft_consensus.cc:2368] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:10:50.784523 24958 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:50.793529 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.794039 21847 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:50.805028 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 88135.2us
W20260709 12:10:50.830488 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 290270us
I20260709 12:10:50.829810 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.831339 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:50.831697 21847 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:50.839223 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:50.839389 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:50.840951 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.841436 21850 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 4.
I20260709 12:10:50.842389 21848 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.805258 24866 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.844043 21844 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:10:50.845503 21847 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.804656 24912 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6.
I20260709 12:10:50.846783 25115 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.846827 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.847312 25115 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.848222 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.848738 21850 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:50.846590 24958 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.857020 25084 consensus_meta.cc:287] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.229s	user 0.005s	sys 0.011s
I20260709 12:10:50.858641 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.859160 25115 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:50.863077 21850 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:50.855959 24958 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.859153 25084 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:50.865918 25084 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:50.865939 24958 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:50.872964 21848 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:50.873288 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:50.876236 21967 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:50.877238 25084 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:50.877727 25084 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:50.878351 24815 consensus_meta.cc:287] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.798s	user 0.017s	sys 0.000s
I20260709 12:10:50.880688 24815 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:50.877245 21967 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:50.882967 24815 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:50.883838 24815 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.883942 21967 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:50.884243 24815 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:50.884761 24815 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.878666 25084 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.879874 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:50.879218 21847 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:50.896761 24822 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:50.897198 24822 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.897524 24822 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.900643 24912 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.903079 24766 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.903663 24766 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:50.904126 24766 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.907327 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:50.914664 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:50.920840 24866 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:50.914623 24766 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:50.921463 24866 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:50.922462 25047 raft_consensus.cc:3055] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.923015 25047 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:50.922533 24866 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.923843 25047 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.924007 24766 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:50.925077 25047 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.319895 25098 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:50.929318 21967 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:50.931018 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:50.931596 25084 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.932822 24766 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.933312 24766 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:50.933753 24766 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.935906 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 689) took 2459 ms. Trace:
I20260709 12:10:50.936290 22581 rpcz_store.cc:276] 0709 12:10:48.476537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.704243 (+1227706us) service_pool.cc:224] Handling call
0709 12:10:49.998623 (+294380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.999206 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.935701 (+936495us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400548b50. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:50.935843 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623361280}
W20260709 12:10:50.938212 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.938853 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.939337 21967 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:50.940155 25161 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.940534 25161 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:50.940902 25161 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.944142 24815 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.920838 24912 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.946697 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:50.946849 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 688015us
I20260709 12:10:50.948576 21966 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:50.948733 21818 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:50.949613 24912 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.950502 24912 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.951174 25072 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:50.954119 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.949903 21749 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 6, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 6 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.956575 21843 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:50.957283 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.957646 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:50.957914 21846 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:50.958395 21847 raft_consensus.cc:2410] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:10:50.959107 24822 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:50.961328 24822 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:50.963994 25013 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.964424 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2100) took 4183 ms. Trace:
I20260709 12:10:50.964483 25013 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:50.969264 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:50.970476 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:50.964905 21923 rpcz_store.cc:276] 0709 12:10:46.780710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.548208 (+767498us) service_pool.cc:224] Handling call
0709 12:10:47.576458 (+ 28250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.615871 (+ 39413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.615899 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.622290 (+  6391us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.458809 (+1836519us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:49.947175 (+488366us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b1800384760. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be49434bc 00007f3be1c9148b 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cab455 00007f3be87933c7 00007f3be4da59a7 00007f3be4db50bf
0709 12:10:49.947310 (+   135us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.250648 (+303338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.261595 (+ 10947us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.261641 (+    46us) raft_consensus.cc:1685] finished
0709 12:10:50.964163 (+702522us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.964358 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28849,"prepare.queue_time_us":306549,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":29947,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":248,"spinlock_wait_cycles":6916352,"thread_start_us":2413425,"threads_started":3,"wal-append.queue_time_us":917648,"wal-append.run_cpu_time_us":1564,"wal-append.run_wall_time_us":1001577}
I20260709 12:10:50.979316 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:50.967769 25151 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:10:50.980018 24841 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.980443 24841 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.980783 24841 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.976197 25110 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:50.982738 25110 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.983069 25110 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.946331 24815 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:50.995142 21818 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:51.000028 21996 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:51.000527 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:51.002403 25013 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:51.001788 25072 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.006108 21818 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:51.006804 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:51.008241 25047 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.013916 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:51.015391 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:51.016146 25072 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.015453 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.017519 21999 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:51.017908 25084 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.018690 25084 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:51.019135 25098 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.019227 25084 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.019682 25098 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.021540 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.021432 25161 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.023651 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.024289 21999 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:51.025131 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.027122 24766 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:51.027875 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.030040 24766 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:51.031883 25013 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.032403 25072 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.032511 25013 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:51.033025 25072 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:51.031910 22578 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:51.035306 21818 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:51.035512 25072 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:51.036728 21818 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:51.036935 25072 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.037658 24904 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.037786 25072 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:51.037971 25091 consensus_queue.cc:1175] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cffb5c192e144f7caa7b94271976ed42" responder_term: 7 status { last_received { term: 6 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:10:51.041436 21750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58736 (request call id 279) took 22687 ms (client timeout 15000 ms). Trace:
I20260709 12:10:51.044478 24688 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.045101 24688 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:51.039031 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 60119.4us
I20260709 12:10:51.046842 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:51.047264 24688 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:51.042145 21749 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 5, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 5 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:51.051141 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 52713.3us
I20260709 12:10:51.043156 25161 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:51.038895 25013 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:51.047922 22549 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:51.054111 22549 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:51.055365 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:51.057760 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:51.056798 25169 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.047537 24553 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.059955 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:51.062095 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 808456us
I20260709 12:10:51.056682 21918 raft_consensus.cc:2376] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8. Re-sending same reply.
I20260709 12:10:51.058653 25047 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:51.062573 21849 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1848) took 2681 ms (client timeout 1727 ms). Trace:
I20260709 12:10:51.063398 21749 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:10:51.065433 21926 raft_consensus.cc:2376] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6. Re-sending same reply.
I20260709 12:10:51.066715 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:51.066437 24553 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:51.044080 21750 rpcz_store.cc:269] 0709 12:10:28.354311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.354508 (+   197us) service_pool.cc:224] Handling call
0709 12:10:51.041180 (+22686672us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:40.582586 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:40.806012 (+223426us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:40.819049 (+ 13037us) write_op.cc:435] Acquired schema lock
0709 12:10:40.829849 (+ 10800us) tablet.cc:662] Decoding operations
0709 12:10:41.012080 (+182231us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:41.012183 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:41.012223 (+    40us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:10:41.013111 (+   888us) tablet.cc:701] Row locks acquired
0709 12:10:41.013162 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:10:41.013337 (+   175us) write_op.cc:270] Start()
0709 12:10:41.013471 (+   134us) write_op.cc:276] Timestamp: P: 1783599041013270 usec, L: 0
0709 12:10:41.013499 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:10:41.014249 (+   750us) log.cc:844] Serialized 3964 byte log entry
0709 12:10:41.691705 (+677456us) op_driver.cc:464] REPLICATION: finished
0709 12:10:42.223875 (+532170us) write_op.cc:301] APPLY: starting
0709 12:10:42.235568 (+ 11693us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:42.276880 (+ 41312us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:42.334868 (+ 57988us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:42.504758 (+169890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:42.505115 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:10:42.505156 (+    41us) write_op.cc:312] APPLY: finished
0709 12:10:42.505506 (+   350us) log.cc:844] Serialized 77 byte log entry
0709 12:10:42.920424 (+414918us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:42.929927 (+  9503us) write_op.cc:454] Released schema lock
0709 12:10:42.938968 (+  9041us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:42.949437 (+ 10469us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:42.949470 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46951,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":410996,"apply.run_cpu_time_us":30304,"apply.run_wall_time_us":802937,"num_ops":10,"prepare.queue_time_us":712654,"prepare.run_cpu_time_us":11491,"prepare.run_wall_time_us":641739,"raft.queue_time_us":285440,"raft.run_cpu_time_us":47795,"raft.run_wall_time_us":425258,"replication_time_us":616643,"spinlock_wait_cycles":32128,"thread_start_us":1202831,"threads_started":5,"wal-append.queue_time_us":800578,"wal-append.run_cpu_time_us":12125,"wal-append.run_wall_time_us":2313110}]]}
I20260709 12:10:51.073526 21749 catalog_manager.cc:5697] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:10:51.066134 21849 rpcz_store.cc:269] 0709 12:10:48.381122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.530219 (+149097us) service_pool.cc:224] Handling call
0709 12:10:51.062236 (+2532017us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400208d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:51.062448 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604437760}
I20260709 12:10:51.067353 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:51.077060 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:51.056886 24904 consensus_queue.cc:1059] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:10:51.077998 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:51.077869 21749 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:51.078675 21924 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:51.069125 24553 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.076197 25151 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.067991 25169 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.079586 21749 catalog_manager.cc:5697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 3, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 3 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.062654 24988 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.082036 25169 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.084198 21999 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:10:51.083225 21749 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 7, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 7 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.088126 25151 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:51.088424 25213 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:51.089193 25151 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.090029 25213 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.086247 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:51.093288 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:51.093706 25115 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:51.093102 21749 catalog_manager.cc:5697] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 6, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 6 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:51.055707 24841 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.094158 25115 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:10:51.103783 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.072589 25161 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:51.112479 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.109907 21749 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.114099 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:51.090443 25213 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:51.116542 22575 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:10:51.102242 25015 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:51.117678 21749 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 5, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:51.117878 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:51.119685 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:51.121301 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.067560 25072 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.144942 21918 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.146910 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:51.156270 24841 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:51.161438 25110 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.166900 21925 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:51.117851 25213 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.169258 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:51.140012 24766 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.180857 21924 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 4.
I20260709 12:10:51.181694 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:51.183910 21918 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:51.109441 24710 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:10:51.181712 25047 raft_consensus.cc:697] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:51.191228 21999 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:51.186650 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 76005us
I20260709 12:10:51.190791 25098 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:51.196578 24766 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:51.197624 21999 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.188098 21749 catalog_manager.cc:5697] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 8, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 8 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.180368 24866 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.200248 21923 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.203218 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:51.204540 21966 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:51.208753 25047 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.169098 25015 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:51.209760 25031 consensus_meta.cc:287] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.127s	user 0.012s	sys 0.004s
I20260709 12:10:51.212914 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.209957 24815 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:10:51.212898 21749 catalog_manager.cc:5697] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 6, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 6 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.239233 21749 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:51.219017 25098 consensus_queue.cc:1059] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:10:51.200816 24904 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.228027 25084 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.229463 21966 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:51.241348 21923 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:51.243892 21749 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 6, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 6 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:51.197633 24766 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:51.260880 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.262323 21844 raft_consensus.cc:2410] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:51.239384 25110 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:51.265326 24553 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.198438 25115 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:51.266582 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 48011.7us
I20260709 12:10:51.267321 25115 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.268519 25089 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:51.270056 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.273806 21749 catalog_manager.cc:5697] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:10:51.270752 21964 leader_election.cc:336] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.597s (SENT)
I20260709 12:10:51.257159 24904 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.277987 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.254241 25207 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.258838 25098 raft_consensus.cc:3055] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:51.282049 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 52723.4us
I20260709 12:10:51.287253 21749 catalog_manager.cc:5697] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 5, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:51.277402 21923 pending_rounds.cc:85] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 4
I20260709 12:10:51.290946 21923 pending_rounds.cc:107] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:10:51.291294 21923 raft_consensus.cc:2889] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:51.270025 24866 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.295878 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.298645 21844 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:51.299113 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.307961 21749 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 6, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 6 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:51.283062 24904 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.313722 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d50c36e857cb4e33997aee7e5dd39447 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:10:51.281059 25098 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:51.327064 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.329018 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.332060 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.329727 21749 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 6, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 6 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:51.355273 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:51.366256 22547 leader_election.cc:336] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.597s (SENT)
W20260709 12:10:51.369069 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.372977 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:51.351884 21781 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb9a0 after lost signal to thread 20708
W20260709 12:10:51.367281 21892 connection.cc:256] RPC call timeout handler was delayed by -2.7305285739998908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 12:10:51.388646 21844 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:51.405356 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:51.408092 21892 connection.cc:256] RPC call timeout handler was delayed by -2.23708467199981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 12:10:51.408730 21892 connection.cc:256] RPC call timeout handler was delayed by -2.2289846719997968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 12:10:51.409154 21892 connection.cc:256] RPC call timeout handler was delayed by -1.95252646799986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 12:10:51.409525 21892 connection.cc:256] RPC call timeout handler was delayed by -1.9012264680000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 12:10:51.409933 21892 connection.cc:256] RPC call timeout handler was delayed by -1.7978846719997819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 12:10:51.410296 21892 connection.cc:256] RPC call timeout handler was delayed by -1.7840648549999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:10:51.413288 21892 connection.cc:256] RPC call timeout handler was delayed by -1.7840648549999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:10:51.413829 21892 connection.cc:256] RPC call timeout handler was delayed by -1.782264854999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 12:10:51.414368 21892 connection.cc:256] RPC call timeout handler was delayed by -1.782264854999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 12:10:51.415154 21892 connection.cc:256] RPC call timeout handler was delayed by -1.7798846719997528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 12:10:51.415897 21892 connection.cc:256] RPC call timeout handler was delayed by -1.6796648549998281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260709 12:10:51.416376 21892 connection.cc:256] RPC call timeout handler was delayed by -1.6778648549998252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 12:10:51.416860 21892 connection.cc:256] RPC call timeout handler was delayed by -1.58966485499991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 12:10:51.417315 21892 connection.cc:256] RPC call timeout handler was delayed by -1.5376264679998712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
W20260709 12:10:51.417788 21892 connection.cc:256] RPC call timeout handler was delayed by -1.4620264679999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 12:10:51.418234 21892 connection.cc:256] RPC call timeout handler was delayed by -1.4267648549998739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 12:10:51.418715 21892 connection.cc:256] RPC call timeout handler was delayed by -1.4267648549998739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 12:10:51.424064 21892 connection.cc:256] RPC call timeout handler was delayed by -1.3898648549998143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:10:51.424999 21892 connection.cc:256] RPC call timeout handler was delayed by -1.3898648549998143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:10:51.426848 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 77040.5us
I20260709 12:10:51.391448 24822 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.423009 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.431876 21995 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:51.429900 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:51.433573 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:51.428952 21892 connection.cc:256] RPC call timeout handler was delayed by -1.3475648549999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 12:10:51.435987 21892 connection.cc:256] RPC call timeout handler was delayed by -1.3475648549999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 12:10:51.437835 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.394023 25161 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:51.441612 21844 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:10:51.440605 21995 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:51.440482 21922 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:51.439775 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1729648549999183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
W20260709 12:10:51.449815 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1729648549999183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
W20260709 12:10:51.450057 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1551264679999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25070000000000003s for a response
W20260709 12:10:51.450294 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1279648549998456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 12:10:51.430477 25110 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:51.462729 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.457296 21845 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.449150 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:51.474320 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:51.450635 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1279648549998456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 12:10:51.476368 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1099648549998165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 12:10:51.477303 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1099648549998165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 12:10:51.436548 25089 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.436491 25226 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.500828 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:51.467332 25227 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:10:51.440924 25015 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:51.503019 21922 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.452111 24688 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.502998 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:51.503382 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 82781.1us
I20260709 12:10:51.468340 25084 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:51.506699 22547 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.768s (SENT)
W20260709 12:10:51.507560 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 103183us
I20260709 12:10:51.426674 25098 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.520707 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.521162 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:51.521654 21893 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:51.523243 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.524400 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:51.532721 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.510962 25228 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.512955 24988 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:51.486327 25110 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.535195 21925 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.524327 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:51.534035 21993 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:51.547715 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.543051 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.544996 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:51.548440 21851 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:10:51.548561 21844 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:10:51.547045 21849 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:51.550290 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 43622.9us
I20260709 12:10:51.552838 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:51.508302 25089 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.555387 21845 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.504447 25226 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:51.557404 21843 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:51.567756 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:51.544371 24688 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:51.574456 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:52.140300 22584 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.140466 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:52.141296 22582 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:51.700544 25110 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:52.142359 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:52.106063 24904 consensus_meta.cc:287] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.757s	user 0.006s	sys 0.006s
I20260709 12:10:51.978597 24553 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:52.143689 25098 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.144121 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:51.665431 25115 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.480s
I20260709 12:10:51.567862 24866 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.084805 25031 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:52.147055 25031 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:51.630594 21922 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:52.147477 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:51.543118 25228 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.148617 25228 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.148303 25031 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:52.149036 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.624567 21893 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:52.149775 25031 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.732200 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.150449 25091 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.150933 25091 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:52.151369 25091 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.556412 25232 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.152894 24688 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:52.153247 25232 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:52.153717 25232 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.010447 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:52.010878 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:51.631740 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.041472 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:52.155189 22577 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:51.580911 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:52.158236 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:51.633384 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.158679 21847 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:10:51.986874 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:52.159678 25091 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:51.690240 24822 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.161233 21999 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.665859 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:52.161944 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:52.011057 25212 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.162544 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 496746us
I20260709 12:10:52.162917 25212 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.163244 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.879642 24988 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:52.164016 22576 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:52.164189 24988 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.164458 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.165244 22001 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:52.143393 24904 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.166008 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.181772 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.167490 24904 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:51.983574 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.138883 21781 debug-util.cc:398] Leaking SignalData structure 0x7b0800035c80 after lost signal to thread 21784
I20260709 12:10:52.188050 22576 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:52.189167 21781 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6080 after lost signal to thread 21876
W20260709 12:10:52.189549 21781 debug-util.cc:398] Leaking SignalData structure 0x7b08003abd20 after lost signal to thread 21877
I20260709 12:10:51.632987 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:52.139504 21964 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.725s (SENT)
I20260709 12:10:52.159006 22583 raft_consensus.cc:2368] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10.
I20260709 12:10:52.190647 21964 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:52.191603 21781 debug-util.cc:398] Leaking SignalData structure 0x7b080038c260 after lost signal to thread 21951
I20260709 12:10:52.192324 24904 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.192936 21781 debug-util.cc:398] Leaking SignalData structure 0x7b08003be500 after lost signal to thread 22025
I20260709 12:10:52.192862 24904 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:52.163280 21817 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:51.735558 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.579813 21925 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:10:52.169943 25015 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.195721 22001 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.196203 25015 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:51.709888 25221 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.404s	user 0.002s	sys 0.000s
I20260709 12:10:52.147025 24866 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:52.170629 25141 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:52.158509 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 588762us
W20260709 12:10:51.610455 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.161957 25091 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:51.659758 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:52.199563 21845 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
W20260709 12:10:51.919942 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.175148 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:52.200949 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.774820 25234 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
I20260709 12:10:52.176592 24553 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:52.177507 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:51.746959 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.185436 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.977238 25226 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:52.194350 21781 debug-util.cc:398] Leaking SignalData structure 0x7b08003320a0 after lost signal to thread 22608
I20260709 12:10:52.196586 25015 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.200688 22584 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:52.215528 22578 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:51.662220 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 118495us
I20260709 12:10:51.680543 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:52.201818 22580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.007s	sys 0.008s
I20260709 12:10:52.199707 21967 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:52.154755 22581 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:10:52.218521 22580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.007s	sys 0.008s
W20260709 12:10:52.206821 22547 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.835s (SENT) [suppressed 41 similar messages]
I20260709 12:10:52.166137 25212 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:52.207630 21997 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:52.208156 21999 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:10:52.209438 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:52.210211 21781 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1ca0 after lost signal to thread 22609
I20260709 12:10:52.209606 21893 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:52.221241 21781 debug-util.cc:398] Leaking SignalData structure 0x7b080036f240 after lost signal to thread 25079
W20260709 12:10:52.222066 21781 debug-util.cc:398] Leaking SignalData structure 0x7b080033cd80 after lost signal to thread 25173
I20260709 12:10:52.215289 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.173225 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:52.230728 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 91262.7us
W20260709 12:10:52.231456 21964 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.799s (SENT)
I20260709 12:10:51.634838 25230 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.231578 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:51.775908 25089 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:52.278693 22579 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.280252 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.232363 21996 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.232769 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:52.286293 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:52.281131 21893 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:52.290388 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 112952us
I20260709 12:10:52.291592 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:52.279106 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:52.295511 21918 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.015s	sys 0.011s
I20260709 12:10:52.219955 25015 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.296747 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.297631 21992 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:52.222205 25207 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.303475 21993 raft_consensus.cc:2410] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:10:52.296777 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.219756 24822 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.306238 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.307071 22549 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:52.220098 24866 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:52.308035 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 87535.5us
I20260709 12:10:52.283520 24710 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.284329 25226 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:52.307391 21918 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.016s	sys 0.012s
I20260709 12:10:52.326238 21997 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:52.327966 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 46931.3us
I20260709 12:10:52.328321 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:52.308305 25213 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 1.119s	user 0.007s	sys 0.006s
W20260709 12:10:52.316727 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 121287us
I20260709 12:10:52.288744 25151 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.215915 24553 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.340420 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1930) took 1026 ms. Trace:
I20260709 12:10:52.355906 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.355229 21918 rpcz_store.cc:276] 0709 12:10:51.313803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.328365 (+ 14562us) service_pool.cc:224] Handling call
0709 12:10:51.355382 (+ 27017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.368381 (+ 12999us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:51.518166 (+149785us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.747308 (+229142us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.335711 (+588403us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.335768 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:52.340069 (+  4301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.340173 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.340342 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80397,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":116,"raft.queue_time_us":23416,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":5673,"thread_start_us":898339,"threads_started":3,"wal-append.queue_time_us":688548}
I20260709 12:10:52.360021 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.360208 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:52.307775 25169 consensus_meta.cc:287] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 1.205s	user 0.014s	sys 0.000s
W20260709 12:10:52.348291 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 141484us
I20260709 12:10:52.366665 21995 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:52.326913 25110 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.373198 21893 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:52.370694 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:52.329813 24710 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:52.357767 25089 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.299024 25228 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.379861 21893 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:52.335556 25226 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:52.362964 25141 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.346395 25207 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:52.310295 25230 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:52.358430 25212 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.358273 24904 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:52.369405 25110 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:52.376961 24824 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.369429 25115 consensus_queue.cc:1059] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:10:52.382862 25226 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:52.398902 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 104546us
I20260709 12:10:52.361043 25213 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.366533 25169 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.417419 24553 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:52.419199 25115 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:52.420049 24988 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:52.391921 25212 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.393559 25242 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:52.417994 24710 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:52.388043 24688 consensus_queue.cc:1059] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:52.397053 25141 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.435025 22579 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:10:52.396521 25110 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.443780 22575 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:52.426057 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:52.424103 25242 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.461190 22581 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:52.422959 25237 log.cc:927] Time spent T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:10:52.470578 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 239178us
I20260709 12:10:52.431133 24710 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.422400 24988 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:52.475666 25239 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:10:52.469874 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:52.472427 22578 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:52.480695 22579 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.470244 22547 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.106s (SENT)
I20260709 12:10:52.456928 25249 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:10:52.432888 24688 raft_consensus.cc:3055] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:52.423794 25212 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.433193 25213 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:52.428262 25248 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:52.461714 25091 raft_consensus.cc:2764] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:10:52.482280 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.497273 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 496) took 1373 ms. Trace:
I20260709 12:10:52.433277 25141 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.481169 22547 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:52.462111 25242 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.480168 25207 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.489768 25169 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:52.489532 25230 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:52.505203 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 125402us
I20260709 12:10:52.491153 25228 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:52.494402 22579 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
W20260709 12:10:52.494637 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 130453us
W20260709 12:10:52.449380 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 142419us
I20260709 12:10:52.508152 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:52.498721 21818 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:52.462292 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 89753.6us
I20260709 12:10:52.497660 21846 rpcz_store.cc:276] 0709 12:10:51.123402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.123579 (+   177us) service_pool.cc:224] Handling call
0709 12:10:51.124001 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.141973 (+ 17972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.142020 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.171282 (+1029262us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b2c00014b88. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:10:52.171668 (+   386us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.304013 (+132345us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:52.304050 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.304221 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.493234 (+189013us) raft_consensus.cc:1685] finished
0709 12:10:52.493267 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.497205 (+  3938us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":932,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":14189,"spinlock_wait_cycles":49353984,"thread_start_us":131989,"threads_started":1,"wal-append.queue_time_us":272489}
I20260709 12:10:52.493023 24688 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:52.497121 25248 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:52.517139 21818 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:52.517987 21818 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:52.519196 21818 leader_election.cc:400] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10.
I20260709 12:10:52.519508 21818 leader_election.cc:403] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.512275 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:52.501439 25141 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.517565 21817 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:52.530830 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:52.530036 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:52.535195 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:52.537648 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:52.539355 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:52.540961 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.542121 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.543715 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.544257 21849 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.546084 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.546710 21817 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:52.547617 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.548808 22583 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:52.549611 22581 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:52.550112 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:52.554703 21845 raft_consensus.cc:2368] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7.
I20260709 12:10:52.515357 25151 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.530239 25249 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:52.570034 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 71006.2us
I20260709 12:10:52.570678 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.530300 25246 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:52.573269 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 52899.2us
W20260709 12:10:52.573127 21964 leader_election.cc:336] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.864s (SENT)
I20260709 12:10:52.501238 25232 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.550621 25228 raft_consensus.cc:2764] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:10:52.578567 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:52.578883 21964 leader_election.cc:336] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.978s (SENT)
I20260709 12:10:52.526080 24866 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:52.568152 25169 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.580273 25259 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.582549 21852 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:52.583995 25151 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.581923 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.605741 21847 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.572365 24553 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.548290 25098 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:10:52.575371 25256 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.604126 21849 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
W20260709 12:10:52.665890 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 77823.6us
I20260709 12:10:52.669337 22549 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:52.675778 21817 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:52.608433 21964 leader_election.cc:336] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.006s (SENT)
I20260709 12:10:52.679590 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:52.678365 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:52.680625 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.595703 25244 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.676349 25256 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.665663 25257 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:52.691747 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:52.673879 24904 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.669786 25228 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:52.604786 25259 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.688830 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:52.668903 25254 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.608834 25269 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.692566 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:52.685957 25253 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.695640 21852 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:52.603698 25213 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:10:52.704166 21847 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:52.591033 24688 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.673754 25169 consensus_queue.cc:1059] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:10:52.679239 25091 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.706280 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:52.709663 22575 raft_consensus.cc:2393] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:52.695761 24904 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:52.719766 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.608896 25151 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.691690 25256 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.718102 22584 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:52.722091 22578 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
W20260709 12:10:52.722847 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 128343us
I20260709 12:10:52.725414 24688 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.726980 24904 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:52.734534 21964 leader_election.cc:336] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.140s (SENT)
I20260709 12:10:52.734745 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:52.736156 25267 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.737098 25254 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.719871 25253 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:52.740758 25268 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
I20260709 12:10:52.708590 25273 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.748497 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.721046 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:52.692999 25244 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.709899 25259 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:52.752310 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.768540 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:52.768628 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 202262us
I20260709 12:10:52.781869 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.782554 21847 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:52.784981 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 225485us
I20260709 12:10:52.724232 25084 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:52.790474 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:52.792531 21922 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.789742 21818 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:52.603376 25248 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:52.795780 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 126516us
I20260709 12:10:52.704015 25257 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:52.797255 21847 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:10:52.797356 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:52.802397 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:52.750762 25253 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:52.803227 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:52.804347 21925 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.826529 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:52.841142 21924 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:52.840771 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:52.827867 25244 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:52.828190 21918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:10:52.742188 25091 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.830724 25257 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:52.831112 21848 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:52.831697 21920 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:10:52.832062 21922 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:52.832180 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:52.832684 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.835783 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:52.825479 25248 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.722945 25274 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:10:52.822944 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:52.894518 21926 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:52.842759 21918 raft_consensus.cc:606] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:52.895352 21918 raft_consensus.cc:614] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:52.823715 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.716650 25269 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:52.862447 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 278997us
I20260709 12:10:52.866526 25289 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:52.869621 25287 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:52.871234 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.904593 21844 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.871855 25293 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:52.872599 25292 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:52.873509 25280 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.874557 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:52.875780 25271 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:10:52.878470 25115 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:52.880470 25213 raft_consensus.cc:3055] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:52.884217 25141 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.888370 21848 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.933033 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:52.902818 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:52.834005 24904 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:52.908221 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:52.944499 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:52.945339 21851 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:52.945673 25279 raft_consensus.cc:3055] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.946062 25279 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:52.946457 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:52.947191 21923 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:52.947921 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:52.948490 21923 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.907738 25254 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:52.940917 25293 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:52.822870 25249 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:52.823654 25232 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:52.910786 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.913067 21893 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:52.986999 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 74009us
I20260709 12:10:52.913286 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:52.913837 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 192900us
W20260709 12:10:52.949803 25226 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 12:10:52.845050 25098 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.890735 25212 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.932051 25296 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.929950 25213 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:52.901916 21846 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:52.769518 25273 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.932914 21919 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:52.907781 25289 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:52.911389 25287 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.992412 25031 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.922256 25280 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.923661 25288 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:52.963351 21925 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
W20260709 12:10:52.908895 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 106605us
I20260709 12:10:52.955962 25253 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:52.989274 25265 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.021134 25256 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.022902 25151 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:52.999401 25249 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:52.964202 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 50166.7us
I20260709 12:10:53.024924 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:10:52.966085 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 142964us
I20260709 12:10:53.027658 21964 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:53.029036 21964 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:53.015370 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.026189 21815 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:52.984933 21844 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:52.989737 21966 leader_election.cc:400] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7.
I20260709 12:10:53.016520 25273 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:52.989735 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 79376.3us
I20260709 12:10:53.033711 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:53.036228 24988 raft_consensus.cc:2764] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:10:53.036429 24688 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:53.038146 25300 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:52.990057 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.038582 25257 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.039044 21918 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:52.994518 25277 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:52.989189 25110 consensus_meta.cc:287] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.004s
W20260709 12:10:52.989778 25015 consensus_meta.cc:287] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.663s	user 0.006s	sys 0.005s
I20260709 12:10:53.020370 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:53.018704 25280 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.009276 22575 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:53.019665 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.043782 21815 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:53.179171 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 135454us
I20260709 12:10:53.019013 25288 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.111243 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.182698 21918 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.120641 25212 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:53.117420 25141 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:53.109301 25084 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 12:10:53.128211 25285 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:10:53.076305 21923 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
W20260709 12:10:53.018345 25302 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:10:53.080816 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:53.080308 22579 raft_consensus.cc:2393] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:53.079030 25110 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.040529 24866 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:53.003978 24904 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:53.069231 25242 consensus_meta.cc:287] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.001s
I20260709 12:10:53.051757 25292 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.151103 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:53.040910 24710 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.017740 25031 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:10:53.008575 25089 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.002s
I20260709 12:10:53.030833 21919 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:53.012511 25213 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.210230 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.079348 25015 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.000660 25293 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:52.999472 25226 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.207170 25031 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.220443 25226 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:53.000070 25098 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.052536 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:53.221508 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 169053us
I20260709 12:10:53.221707 25306 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.222677 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:53.223459 25110 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:53.223613 25257 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:53.016948 25289 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:53.030648 25287 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:52.991561 25271 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:10:53.168298 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 398094us
I20260709 12:10:53.224853 25289 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:53.226003 25279 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.226951 25252 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:53.227449 25252 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.228207 22581 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEARNER]: Advancing to term 8
I20260709 12:10:53.229864 25267 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:53.178049 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 157642us
I20260709 12:10:53.230839 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:53.230968 21994 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.231938 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:53.232860 25301 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.232955 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:53.233629 21997 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:53.233435 25301 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.234954 21993 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:53.235059 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:53.184656 22578 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:53.237434 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.185808 21925 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.237699 25212 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:53.065308 25274 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 12:10:53.175405 25256 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:53.238255 25212 raft_consensus.cc:697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:10:53.190423 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 109690us
I20260709 12:10:53.232909 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:53.237241 22000 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:53.036477 25259 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.184409 25273 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.184830 25115 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:53.236373 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:53.209002 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 419315us
I20260709 12:10:53.208858 22577 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.211150 21918 raft_consensus.cc:2410] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:10:53.209522 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.211606 25089 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.214766 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.010315 25281 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.249s
I20260709 12:10:53.216514 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.223824 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.260134 21919 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.260440 21920 raft_consensus.cc:2410] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:53.224115 25257 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:53.242630 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 82884.4us
I20260709 12:10:53.268921 21964 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:53.194608 25244 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:53.270236 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:53.244390 25277 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.239500 22580 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:53.246790 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.284694 21922 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:53.247802 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:53.203859 24710 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:53.222609 25098 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:53.211930 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.287257 21926 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.192454 24866 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:53.250114 21818 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:53.248786 24553 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.253494 25273 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:53.253930 25169 consensus_queue.cc:1059] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:53.254570 25272 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:10:53.254747 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:53.255025 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:53.203576 25242 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.258476 21849 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.227449 25279 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.259670 21921 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.245048 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:53.294260 21999 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.243412 25306 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:53.290689 21992 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.286257 24710 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.267500 25296 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:53.267963 25141 consensus_queue.cc:1059] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:10:53.274442 25244 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.275686 25232 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:53.276943 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:53.277408 25015 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:53.268131 25292 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:10:53.282614 21925 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:53.321527 25098 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.339358 21964 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:53.291213 21993 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
W20260709 12:10:53.299492 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.301905 25252 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:53.301509 24866 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.302584 25212 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.303424 25259 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:53.329350 21927 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:53.330646 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 80643.2us
I20260709 12:10:53.360090 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:53.273581 22581 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:10:53.330580 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 82874.7us
I20260709 12:10:53.363036 21964 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:53.364298 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:53.333204 21922 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:53.336977 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 86912.3us
I20260709 12:10:53.255187 25240 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:53.324100 25115 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:53.362049 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 72903.3us
I20260709 12:10:53.337875 24822 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:53.367437 21918 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:10:53.338034 25286 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:53.376470 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:53.377162 21993 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.376554 21918 pending_rounds.cc:85] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 6
I20260709 12:10:53.378084 21918 pending_rounds.cc:107] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:10:53.378345 21918 raft_consensus.cc:2889] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.368219 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:53.371573 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:53.379699 22581 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:53.380337 25207 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.381695 25244 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:53.382773 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 105931us
I20260709 12:10:53.382936 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:53.383576 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:53.383600 21995 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.367337 25240 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:53.372308 24866 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.387624 25240 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.388159 25242 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:53.388880 25240 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.387568 25290 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.390738 25288 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:53.390198 21993 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.378957 21967 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:53.393198 25301 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:53.367703 25015 raft_consensus.cc:3055] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.393878 25015 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:53.394734 25286 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:53.394861 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:53.377574 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:53.396282 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:53.397933 21817 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:53.396839 21892 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:53.375473 24553 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.402390 25286 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.406342 24553 raft_consensus.cc:697] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:53.409003 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:53.414230 24553 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.409299 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:53.409508 21846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:53.414636 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:53.416455 22580 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.403466 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.412056 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:53.417779 22582 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.407795 22578 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:53.420282 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:53.420872 22575 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.421152 25091 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:53.421589 21999 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:53.423180 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.373230 25252 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.424475 22581 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:53.425613 21919 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.428752 21850 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:10:53.430971 22584 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.374323 25269 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:53.355028 25098 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.440047 25232 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:10:53.439908 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.444723 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.450141 21921 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.416712 25265 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10.
I20260709 12:10:53.394694 25015 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.443701 24988 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.451833 24988 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:53.452033 25015 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.452618 24988 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.410490 25306 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.409334 25281 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.403685 25259 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:53.411592 24688 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:53.418090 25242 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.377647 25292 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:10:53.372531 25257 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:53.438251 25298 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.439s	user 0.002s	sys 0.005s
I20260709 12:10:53.403447 25307 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:53.438350 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.482520 21924 raft_consensus.cc:2376] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7. Re-sending same reply.
I20260709 12:10:53.449463 25098 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:53.450912 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.456784 21846 raft_consensus.cc:606] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:53.486469 21846 raft_consensus.cc:614] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:53.433571 21918 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:53.433353 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:53.450995 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.487496 21921 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:53.447392 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:53.463733 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.465809 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:53.469131 21926 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:53.464893 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:53.490746 21964 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:53.483294 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 301456us
I20260709 12:10:53.471150 25259 consensus_queue.cc:1243] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:53.492955 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:53.495710 22580 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.496532 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.498761 21924 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.463099 24822 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:53.478593 25248 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:53.499554 25098 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.500030 25098 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:53.500412 25098 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.505493 25280 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.508131 25280 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:53.508598 25312 log.cc:927] Time spent T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.131s	user 0.000s	sys 0.002s
I20260709 12:10:53.477478 25278 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.515515 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.482265 25307 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:53.510596 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 131715us
I20260709 12:10:53.510308 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.537073 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.537237 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:53.487777 24988 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.539139 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.539073 21818 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:53.539956 21926 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.540522 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:53.485399 25281 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:53.541437 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.542474 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:53.544992 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.537869 25280 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.546911 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:53.482708 25031 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.514202 25287 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.578419 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:53.578812 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 88148.6us
I20260709 12:10:53.582043 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:53.572574 22580 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.573614 21926 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:53.488369 25274 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:10:53.574983 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.541021 25246 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.539705 25307 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.605502 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:53.605198 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:53.544201 25244 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:53.578285 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.583092 22001 raft_consensus.cc:2393] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:53.595971 21918 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.586028 21924 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:53.667465 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:53.667753 21921 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.610148 21926 raft_consensus.cc:1240] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:53.547446 25256 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.537660 25301 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:10:53.681833 21922 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:53.687433 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 105380us
W20260709 12:10:53.682868 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 145855us
I20260709 12:10:53.669849 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:53.574911 25296 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.691591 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.693486 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.697072 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:53.698197 21998 raft_consensus.cc:2393] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 4: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:53.671545 22547 leader_election.cc:336] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.570s (SENT)
I20260709 12:10:53.698437 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:53.609560 22582 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.592238 25269 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.700963 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.701741 21923 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.694610 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.702530 21851 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:53.694119 21924 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
W20260709 12:10:53.685321 25328 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:10:53.604676 25261 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.548415 25288 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 12:10:53.706578 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.696475 25296 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.704452 25269 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.691198 24688 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.578958 25287 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.711730 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.577030 25300 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.712921 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.721905 21926 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:53.722009 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 149218us
I20260709 12:10:53.714190 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.723312 21924 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.715358 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.598306 25098 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.540405 25278 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.692417 25091 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:53.693636 25244 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:53.718595 21918 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.608887 24710 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.705082 25273 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:53.733319 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.759029 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.761504 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.584702 24822 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.775175 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.726513 25287 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.715894 25269 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:53.787729 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 97582.7us
I20260709 12:10:53.771085 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.789428 21926 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.790251 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.791354 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.719360 25296 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.782907 21922 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
W20260709 12:10:53.784514 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.778746 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.793356 21924 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.794158 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.794247 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.794823 21924 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:53.795630 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.796059 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.796146 21922 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.797420 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.792073 21926 raft_consensus.cc:2410] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:53.800343 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.802783 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.760129 25259 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.798115 21924 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.803993 21926 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:53.806075 21995 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:53.807391 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.807798 21817 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:53.808244 21845 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.809005 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.809237 21817 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:53.809981 21926 raft_consensus.cc:2376] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9. Re-sending same reply.
I20260709 12:10:53.814932 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:53.727510 24688 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:53.759996 25300 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.771314 25281 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:54.305900 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.906970 21843 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:53.983160 22547 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.783s (SENT)
I20260709 12:10:54.078500 22577 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.310060 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:54.031632 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 499) took 1232 ms. Trace:
I20260709 12:10:54.068243 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:54.044044 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:54.311141 21993 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
W20260709 12:10:54.086544 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 277386us
I20260709 12:10:54.311528 21919 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.046749 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:54.033344 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 827) took 1350 ms. Trace:
W20260709 12:10:54.001166 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.874164 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:53.846714 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.028712 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1883) took 1343 ms. Trace:
I20260709 12:10:54.078176 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:54.341584 21849 rpcz_store.cc:276] 0709 12:10:52.685055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.685176 (+   121us) service_pool.cc:224] Handling call
0709 12:10:52.703805 (+ 18629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.293890 (+590085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.028419 (+734529us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400400954. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:54.028638 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275127552}
W20260709 12:10:54.342492 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 295815us
I20260709 12:10:54.306969 21852 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:54.032375 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2124) took 1201 ms. Trace:
I20260709 12:10:54.097848 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.344756 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:54.345479 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 362343us
I20260709 12:10:54.032616 21927 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:54.344875 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:54.036664 22583 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:53.874545 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:54.348208 21998 raft_consensus.cc:2393] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:53.923910 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.047169 21815 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:54.005190 25015 consensus_meta.cc:287] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.002s
W20260709 12:10:54.138298 25280 consensus_meta.cc:287] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
I20260709 12:10:54.043938 25269 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.933116 25213 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.177431 21846 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:54.393961 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 346847us
I20260709 12:10:54.393879 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 1949) took 1022 ms. Trace:
I20260709 12:10:54.136411 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:54.394548 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:53.818332 21922 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
W20260709 12:10:54.169745 25252 consensus_meta.cc:287] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.002s
I20260709 12:10:54.041550 22582 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:54.344637 21925 rpcz_store.cc:276] 0709 12:10:52.831291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.239145 (+407854us) service_pool.cc:224] Handling call
0709 12:10:53.239423 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.338449 (+ 99026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.032084 (+693635us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b54003e5dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:54.032315 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98760448}
I20260709 12:10:54.381528 22000 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.839970 21918 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:54.312791 21817 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:53.896406 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:54.383224 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:54.150383 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:54.005084 25335 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:54.165812 25230 raft_consensus.cc:3055] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.343935 25295 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:10:54.387050 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.108039 22549 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:54.189334 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.931061 24710 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:53.982205 25098 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:54.178948 25294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.007s	sys 0.011s
W20260709 12:10:54.169564 25240 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.780s	user 0.004s	sys 0.009s
I20260709 12:10:54.052544 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:54.096989 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:54.346732 22579 rpcz_store.cc:276] 0709 12:10:52.682851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.683163 (+   312us) service_pool.cc:224] Handling call
0709 12:10:54.033094 (+1349931us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54006491d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:54.033269 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891612928}
I20260709 12:10:54.031931 21844 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:10:54.310817 21850 rpcz_store.cc:276] 0709 12:10:52.799615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.799743 (+   128us) service_pool.cc:224] Handling call
0709 12:10:54.031441 (+1231698us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b540017f7d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:54.031566 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872995584}
I20260709 12:10:54.019821 21997 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:54.004186 25336 log.cc:927] Time spent T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:10:53.850791 25313 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:10:54.395255 21818 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:54.396023 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.863471 22001 pending_rounds.cc:85] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 3
I20260709 12:10:54.408967 25015 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.394682 21927 rpcz_store.cc:276] 0709 12:10:53.371421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.450660 (+ 79239us) service_pool.cc:224] Handling call
0709 12:10:54.393718 (+943058us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54002e7054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:54.393824 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256481664}
I20260709 12:10:54.395092 21924 raft_consensus.cc:2376] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11. Re-sending same reply.
W20260709 12:10:53.903167 25326 log.cc:927] Time spent T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:10:54.074180 25273 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.916842 25329 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 12:10:53.917164 25290 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 12:10:54.170136 25296 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:53.865914 25244 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:54.087049 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:54.175465 25277 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:53.892602 25324 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.307s	user 0.001s	sys 0.001s
I20260709 12:10:54.411248 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:53.916116 25297 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:54.074280 25258 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.412050 21852 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:54.427345 25340 consensus_queue.cc:1059] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 12:10:54.416471 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 103919us
W20260709 12:10:54.419821 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 75250.8us
I20260709 12:10:54.553746 21964 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:54.553934 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 725) took 1017 ms. Trace:
I20260709 12:10:54.554525 22584 rpcz_store.cc:276] 0709 12:10:53.536949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.537385 (+   436us) service_pool.cc:224] Handling call
0709 12:10:53.548008 (+ 10623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.573322 (+ 25314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.573364 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.610486 (+ 37122us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.819640 (+209154us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:53.819694 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.819778 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.553661 (+733883us) raft_consensus.cc:1685] finished
0709 12:10:54.553691 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.553861 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2075,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":17834,"thread_start_us":106704,"threads_started":1,"wal-append.queue_time_us":184022}
I20260709 12:10:53.843535 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:53.911209 25031 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:54.423727 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.374688 25212 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.015561 25338 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.154196 24904 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.995451 25278 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:53.931648 25251 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.548367 25277 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.426927 21846 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:53.785885 25091 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:54.426936 21847 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:54.428834 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:54.431169 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.585160 21925 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:54.429333 21845 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:54.401963 25280 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.456869 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.374728 25332 consensus_queue.cc:1059] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:10:54.459335 22001 pending_rounds.cc:107] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:53.818509 25306 consensus_queue.cc:1059] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.602s
I20260709 12:10:54.459043 21922 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:54.460224 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 65064.8us
I20260709 12:10:54.569089 25265 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.819051 25259 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:53.935108 25289 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.495s
W20260709 12:10:54.424995 25286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.004s	sys 0.023s
I20260709 12:10:54.400532 25341 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:54.153864 25287 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:54.421977 25252 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.034372 25307 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:54.480037 21998 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:54.427816 25256 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:54.417932 25230 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:54.482856 21992 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:54.483726 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1892) took 1118 ms. Trace:
W20260709 12:10:54.618957 25286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.004s	sys 0.023s
I20260709 12:10:53.863056 25246 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.484946 21993 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:54.467617 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 72908.3us
I20260709 12:10:54.487493 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2212) took 1246 ms. Trace:
I20260709 12:10:54.496677 21893 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:54.509598 22000 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:54.413359 21919 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:54.479031 25279 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.557950 21920 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:54.558099 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.557976 21918 raft_consensus.cc:2376] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8. Re-sending same reply.
I20260709 12:10:54.665916 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 456) took 1066 ms. Trace:
I20260709 12:10:54.654543 25256 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:54.560724 21923 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:54.661242 21996 rpcz_store.cc:276] 0709 12:10:53.240844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.240954 (+   110us) service_pool.cc:224] Handling call
0709 12:10:53.251245 (+ 10291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:53.258619 (+  7374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.258650 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:53.259628 (+   978us) log.cc:844] Serialized 52 byte log entry
0709 12:10:53.428335 (+168707us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:53.428378 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.428439 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.487285 (+1058846us) raft_consensus.cc:1685] finished
0709 12:10:54.487305 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.487436 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55772,"raft.queue_time_us":7230,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":9210,"thread_start_us":107557,"threads_started":1,"wal-append.queue_time_us":194389}
I20260709 12:10:54.680251 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 474) took 1074 ms. Trace:
I20260709 12:10:54.665827 21927 raft_consensus.cc:2376] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7. Re-sending same reply.
I20260709 12:10:54.680625 21923 rpcz_store.cc:276] 0709 12:10:53.605585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.809898 (+204313us) service_pool.cc:224] Handling call
0709 12:10:54.680199 (+870301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.501295 25015 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:54.660547 25246 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.695501 25246 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.644821 25341 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:54.695890 25015 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:54.616312 25265 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:54.573963 21995 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:54.698786 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.699272 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:54.699532 25265 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:54.699870 21995 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.692162 25031 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.700953 21747 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:54.691459 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:54.049823 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:54.509577 25290 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.576298 21964 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:54.703053 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:54.557752 25347 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:54.578584 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:54.580225 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 472269us
I20260709 12:10:54.699569 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 462) took 1098 ms. Trace:
I20260709 12:10:54.704999 21920 rpcz_store.cc:276] 0709 12:10:53.601054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.679259 (+1078205us) service_pool.cc:224] Handling call
0709 12:10:54.699510 (+ 20251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.479897 25295 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.705698 25287 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:54.706023 25274 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.706141 25295 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:54.597922 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.706597 25332 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.598618 22001 raft_consensus.cc:2889] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.706650 25274 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:54.598281 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.398495 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 685) took 1173 ms. Trace:
I20260709 12:10:54.708730 21925 raft_consensus.cc:2410] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:10:54.576745 25212 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.490514 25273 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:54.612016 21851 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:54.612646 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 220063us
I20260709 12:10:54.572887 24904 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:54.587265 25240 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.619297 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.551343 25258 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:54.633116 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:54.599722 25261 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.637080 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:54.596041 25338 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:54.709153 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 476) took 1103 ms. Trace:
I20260709 12:10:54.719800 25300 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:54.720048 21925 rpcz_store.cc:276] 0709 12:10:53.606223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.597995 (+991772us) service_pool.cc:224] Handling call
0709 12:10:54.709099 (+111104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.720508 21926 raft_consensus.cc:2376] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8. Re-sending same reply.
I20260709 12:10:54.721130 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.721457 21846 raft_consensus.cc:2410] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:54.721933 21925 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:54.678737 25269 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:54.722316 25261 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:54.722582 25240 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:54.708936 22583 rpcz_store.cc:276] 0709 12:10:53.225349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.227445 (+  2096us) service_pool.cc:224] Handling call
0709 12:10:54.036344 (+808899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.348150 (+311806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.398235 (+ 50085us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54006491d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:54.398406 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859537792}
I20260709 12:10:54.723034 25261 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.724720 21843 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.639906 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:54.709333 25212 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:54.644552 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:54.726830 25212 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.645767 21844 rpcz_store.cc:276] 0709 12:10:53.365347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.365451 (+   104us) service_pool.cc:224] Handling call
0709 12:10:54.031662 (+666211us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:54.440718 (+409056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.483544 (+ 42826us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b540017f7d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:54.483673 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531356928}
I20260709 12:10:54.727257 22575 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:54.457325 25294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.433s	user 0.008s	sys 0.019s
I20260709 12:10:54.648478 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:54.652683 25259 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:54.656705 24688 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:54.596393 25251 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:54.728494 25338 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:54.710465 25356 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.611858 25334 consensus_queue.cc:1059] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:10:54.659169 25296 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:54.730495 25356 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:54.659528 25091 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:54.666353 21918 rpcz_store.cc:276] 0709 12:10:53.599307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.423389 (+824082us) service_pool.cc:224] Handling call
0709 12:10:54.665858 (+242469us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:54.732420 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1331795250000596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 12:10:54.665226 25321 raft_consensus.cc:2764] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:10:54.674263 21993 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.726213 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:54.704421 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.704840 21747 catalog_manager.cc:5697] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 5, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.758455 21923 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:54.665310 25279 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.679096 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:54.681231 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 460) took 1080 ms. Trace:
I20260709 12:10:54.779549 21847 raft_consensus.cc:2368] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:54.779448 21927 rpcz_store.cc:276] 0709 12:10:53.600459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.504106 (+903647us) service_pool.cc:224] Handling call
0709 12:10:54.681154 (+177048us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:54.568056 21749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42850 (request call id 206) took 13641 ms (client timeout 15000 ms). Trace:
I20260709 12:10:54.611369 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:54.780633 21749 rpcz_store.cc:269] 0709 12:10:40.910518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.929076 (+ 18558us) service_pool.cc:224] Handling call
0709 12:10:52.412277 (+11483201us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b540041e028. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be9cc4aa1 00007f3be9ceb9b4 00007f3be87cf3dc 00007f3be8790e0b 00007f3be8790be4 00007f3beac90fa1 00007f3beac917ff 00007f3beab50a1b 00007f3beac5890e 00007f3be91192a4 00007f3be9119232
0709 12:10:54.551971 (+2139694us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:52.538894 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:52.539597 (+   703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:52.539654 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:10:52.539682 (+    28us) tablet.cc:662] Decoding operations
0709 12:10:52.541815 (+  2133us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:52.541933 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:52.541973 (+    40us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:10:52.544120 (+  2147us) tablet.cc:701] Row locks acquired
0709 12:10:52.544166 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:10:52.544400 (+   234us) write_op.cc:270] Start()
0709 12:10:52.544570 (+   170us) write_op.cc:276] Timestamp: P: 1783599052544311 usec, L: 0
0709 12:10:52.544595 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:52.545453 (+   858us) log.cc:844] Serialized 7114 byte log entry
0709 12:10:53.158742 (+613289us) op_driver.cc:464] REPLICATION: finished
0709 12:10:53.259556 (+100814us) write_op.cc:301] APPLY: starting
0709 12:10:53.286093 (+ 26537us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:53.304140 (+ 18047us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:53.304300 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:53.381995 (+ 77695us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:53.382454 (+   459us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:10:53.382512 (+    58us) write_op.cc:312] APPLY: finished
0709 12:10:53.383011 (+   499us) log.cc:844] Serialized 125 byte log entry
0709 12:10:53.383245 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:53.383408 (+   163us) write_op.cc:454] Released schema lock
0709 12:10:53.383499 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:53.383986 (+   487us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:53.384014 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":893247,"reported_tablets":33,"spinlock_wait_cycles":7419520,"child_traces":[["op",{"apply.queue_time_us":50721,"apply.run_cpu_time_us":5676,"apply.run_wall_time_us":133852,"num_ops":18,"prepare.queue_time_us":63089,"prepare.run_cpu_time_us":16956,"prepare.run_wall_time_us":45478,"raft.queue_time_us":416479,"raft.run_cpu_time_us":16827,"raft.run_wall_time_us":40553,"replication_time_us":613985,"spinlock_wait_cycles":608512,"thread_start_us":497163,"threads_started":4,"wal-append.queue_time_us":13378,"wal-append.run_cpu_time_us":18240,"wal-append.run_wall_time_us":1828973}]]}
I20260709 12:10:54.718369 25256 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:54.453577 24988 consensus_queue.cc:1059] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:10:54.794550 21747 catalog_manager.cc:5697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 4 to 6, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 6 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:54.751895 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 175685us
I20260709 12:10:54.797132 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:54.752426 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:54.799479 21998 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:54.801368 21846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:54.801971 21846 raft_consensus.cc:606] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:54.802309 21846 raft_consensus.cc:614] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:54.802845 21923 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.803409 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 440) took 1392 ms. Trace:
I20260709 12:10:54.803747 21923 rpcz_store.cc:276] 0709 12:10:53.411291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.776799 (+1365508us) service_pool.cc:224] Handling call
0709 12:10:54.802693 (+ 25894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.803199 (+   506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.803358 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.752707 21921 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:54.753665 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:54.806576 21850 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:54.807220 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:54.803124 21994 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
W20260709 12:10:54.761370 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 264773us
I20260709 12:10:54.808801 21927 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:54.809382 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1955) took 1397 ms. Trace:
W20260709 12:10:54.761754 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 100014us
I20260709 12:10:54.637117 21922 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:54.792240 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.811055 21920 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:54.793591 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:54.794457 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 452) took 1196 ms. Trace:
I20260709 12:10:54.742301 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.812237 21919 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:54.812621 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 457) took 1213 ms. Trace:
I20260709 12:10:54.758461 25307 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:54.813747 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 477) took 1102 ms. Trace:
I20260709 12:10:54.835896 21920 rpcz_store.cc:276] 0709 12:10:53.711324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.705640 (+994316us) service_pool.cc:224] Handling call
0709 12:10:54.813690 (+108050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.811491 21924 rpcz_store.cc:276] 0709 12:10:53.598237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.595533 (+997296us) service_pool.cc:224] Handling call
0709 12:10:54.794375 (+198842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.837183 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:54.809662 21927 rpcz_store.cc:276] 0709 12:10:53.412276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.780419 (+1368143us) service_pool.cc:224] Handling call
0709 12:10:54.808643 (+ 28224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.809159 (+   516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.809331 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.837611 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 458) took 1237 ms. Trace:
I20260709 12:10:54.838377 21924 rpcz_store.cc:276] 0709 12:10:53.599816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.836862 (+1237046us) service_pool.cc:224] Handling call
0709 12:10:54.837125 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.837305 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.837331 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.837370 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:54.837411 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.837462 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.837562 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.814469 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:54.786921 25279 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.833071 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:54.843225 22578 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.834828 21922 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.844211 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1961) took 1249 ms. Trace:
I20260709 12:10:54.838927 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:54.844669 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:54.839970 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1956) took 1427 ms. Trace:
I20260709 12:10:54.812927 21919 rpcz_store.cc:276] 0709 12:10:53.599545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.678489 (+1078944us) service_pool.cc:224] Handling call
0709 12:10:54.812570 (+134081us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.847263 21924 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:54.844724 21922 rpcz_store.cc:276] 0709 12:10:53.594990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.834219 (+1239229us) service_pool.cc:224] Handling call
0709 12:10:54.834592 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.843898 (+  9306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.844145 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.842707 21747 catalog_manager.cc:5697] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:10:54.845947 21923 rpcz_store.cc:276] 0709 12:10:53.412567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.804452 (+1391885us) service_pool.cc:224] Handling call
0709 12:10:54.839358 (+ 34906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.839546 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.839586 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.839638 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:54.839700 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.839770 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.839903 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.851877 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:54.856431 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 450) took 1258 ms. Trace:
I20260709 12:10:54.856809 21920 rpcz_store.cc:276] 0709 12:10:53.597689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.836573 (+1238884us) service_pool.cc:224] Handling call
0709 12:10:54.855917 (+ 19344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.856098 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.856125 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.856167 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:54.856221 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.856274 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.856374 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.860384 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1899) took 1162 ms. Trace:
I20260709 12:10:54.860909 21851 rpcz_store.cc:276] 0709 12:10:53.697662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.710069 (+ 12407us) service_pool.cc:224] Handling call
0709 12:10:53.710433 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.726532 (+1016099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.860098 (+133566us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400208354. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:54.860311 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065768832}
I20260709 12:10:54.815150 25031 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.855294 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 459) took 1247 ms. Trace:
I20260709 12:10:54.867023 21924 rpcz_store.cc:276] 0709 12:10:53.600063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.839744 (+1239681us) service_pool.cc:224] Handling call
0709 12:10:54.839987 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.847617 (+  7630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.847791 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.832414 24988 consensus_queue.cc:1243] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:10:54.864951 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.838828 25332 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.872100 21920 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:54.868227 21924 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.795150 25091 consensus_queue.cc:1059] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:10:54.865460 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.870781 21919 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:54.877929 21927 raft_consensus.cc:1813] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Handling vote request from an unknown peer 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:54.878113 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 464) took 1276 ms. Trace:
I20260709 12:10:54.878772 21927 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:54.855288 25296 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.882990 21927 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.883066 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:54.884481 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1962) took 1156 ms. Trace:
I20260709 12:10:54.884948 21924 rpcz_store.cc:276] 0709 12:10:53.720504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.867790 (+1147286us) service_pool.cc:224] Handling call
0709 12:10:54.868069 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.877007 (+  8938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.877182 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.878657 21919 rpcz_store.cc:276] 0709 12:10:53.601599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.846894 (+1245295us) service_pool.cc:224] Handling call
0709 12:10:54.867676 (+ 20782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.877882 (+ 10206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.878057 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.852628 25084 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.881600 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 470) took 1269 ms. Trace:
I20260709 12:10:54.849133 25357 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.891609 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2222) took 1029 ms. Trace:
I20260709 12:10:54.893079 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:54.896661 22578 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:54.897410 22580 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:54.895011 21920 rpcz_store.cc:276] 0709 12:10:53.603432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.857663 (+1254231us) service_pool.cc:224] Handling call
0709 12:10:54.871782 (+ 14119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.872459 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.872640 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.902244 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:54.903858 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:54.904764 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2141) took 1176 ms. Trace:
I20260709 12:10:54.905283 21927 rpcz_store.cc:276] 0709 12:10:53.728351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.882375 (+1154024us) service_pool.cc:224] Handling call
0709 12:10:54.882764 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.904447 (+ 21683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.904694 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.906899 21927 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.884210 21747 catalog_manager.cc:5697] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:10:54.874464 25115 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.916227 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.932389 21927 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:54.927999 21995 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:54.933255 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:54.895694 22001 rpcz_store.cc:276] 0709 12:10:53.862617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.862723 (+   106us) service_pool.cc:224] Handling call
0709 12:10:53.863189 (+   466us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:54.707697 (+844508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.707727 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:54.708365 (+   638us) log.cc:844] Serialized 78 byte log entry
0709 12:10:54.790069 (+ 81704us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:54.790381 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.790828 (+   447us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.791490 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.793026 (+  1536us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.891403 (+ 98377us) raft_consensus.cc:1685] finished
0709 12:10:54.891422 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.891549 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467,"prepare.queue_time_us":1257,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":16637,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":15202,"thread_start_us":81254,"threads_started":1,"wal-append.queue_time_us":81600}
W20260709 12:10:54.915408 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 121891us
I20260709 12:10:54.916329 21919 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:10:54.935146 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1963) took 1077 ms. Trace:
I20260709 12:10:54.936637 21919 rpcz_store.cc:276] 0709 12:10:53.858193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.890955 (+1032762us) service_pool.cc:224] Handling call
0709 12:10:54.916102 (+ 25147us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:54.934882 (+ 18780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.935094 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.879261 25330 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.938287 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:54.945999 21892 leader_election.cc:400] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:54.946065 25370 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.946465 21892 leader_election.cc:403] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:10:54.946934 25370 consensus_queue.cc:1059] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:54.947540 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:54.947974 25370 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.843567 24904 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:54.874250 25267 consensus_queue.cc:1059] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:10:54.871592 25280 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:10:54.875263 25031 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:54.954973 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:54.874655 25232 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.894402 25265 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:54.950315 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.917037 25259 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.918474 24688 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.916913 25293 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:54.955735 21919 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:54.948128 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2153) took 1022 ms. Trace:
I20260709 12:10:54.957268 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:54.946261 21747 catalog_manager.cc:5697] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:54.935210 24822 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.900758 25274 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:54.900565 25258 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:54.935681 25356 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:54.918987 25251 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:55.001029 21920 rpcz_store.cc:276] 0709 12:10:53.925958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.899319 (+973361us) service_pool.cc:224] Handling call
0709 12:10:54.947469 (+ 48150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.947701 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.947740 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.947810 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:54.947863 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.947933 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.948061 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.948895 25115 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:54.935221 25354 consensus_queue.cc:1059] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
W20260709 12:10:55.003881 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 107943us
I20260709 12:10:55.022032 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:55.004182 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47013.4us
I20260709 12:10:55.010181 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:55.023989 21919 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:54.998504 24904 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.982959 25273 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:55.033918 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:54.960628 25306 consensus_queue.cc:1059] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:54.909396 25296 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.001868 24988 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.040237 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:55.005272 25265 raft_consensus.cc:697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:55.040643 22578 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:55.039793 21747 catalog_manager.cc:5697] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 6, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 6 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
W20260709 12:10:55.048790 25366 log.cc:927] Time spent T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:55.020741 25115 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.061885 21892 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:55.003760 25369 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.036412 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:55.007690 25091 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.952603 25330 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.055708 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1953) took 1677 ms. Trace:
I20260709 12:10:55.090564 21918 rpcz_store.cc:276] 0709 12:10:53.378653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.735002 (+1356349us) service_pool.cc:224] Handling call
0709 12:10:54.735390 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.735593 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:54.791690 (+ 56097us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.054966 (+263276us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b18000b3d40. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be87933c7 00007f3be4da59a7 00007f3be4db50bf 00007f3be4db5038
0709 12:10:55.055185 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.055360 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.055410 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.055467 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.055535 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.055644 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35937,"prepare.queue_time_us":225738,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":18556,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":33856,"spinlock_wait_cycles":72399488,"thread_start_us":89700,"threads_started":1,"wal-append.queue_time_us":139194}
I20260709 12:10:55.055709 25257 raft_consensus.cc:3055] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.063177 25258 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:55.054577 25213 consensus_meta.cc:287] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.003s
I20260709 12:10:55.056905 25295 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:55.011850 24822 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.103041 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1952) took 1726 ms. Trace:
I20260709 12:10:55.034749 25293 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:55.064086 21747 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 7, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 7 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.085352 21920 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:55.105186 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:55.105921 21920 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:55.001569 24688 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.107650 22583 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:10:55.108165 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 204198us
I20260709 12:10:55.112670 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:55.113021 21923 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:55.113273 21918 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:55.072501 25031 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:55.047091 24988 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.122574 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2155) took 1195 ms. Trace:
I20260709 12:10:55.129977 21920 rpcz_store.cc:276] 0709 12:10:53.927118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.106677 (+1179559us) service_pool.cc:224] Handling call
0709 12:10:55.121939 (+ 15262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.122152 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.122201 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.122258 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:55.122310 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.122375 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.122518 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:55.103469 21926 rpcz_store.cc:276] 0709 12:10:53.376991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.721197 (+1344206us) service_pool.cc:224] Handling call
0709 12:10:54.721501 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.721707 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:54.722010 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.917514 (+195504us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.102707 (+185193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.102759 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:55.102814 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.102873 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.102987 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59303,"prepare.queue_time_us":169397,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":81,"raft.queue_time_us":83983,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":2478,"thread_start_us":331592,"threads_started":3,"wal-append.queue_time_us":118476}
I20260709 12:10:55.073500 25246 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.125147 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1965) took 1131 ms. Trace:
I20260709 12:10:55.126045 25286 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:55.094614 25257 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:55.127209 25377 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:55.099905 25258 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.132810 21923 rpcz_store.cc:276] 0709 12:10:53.981976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.110242 (+1128266us) service_pool.cc:224] Handling call
0709 12:10:55.112736 (+  2494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.113353 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.113534 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38400}
I20260709 12:10:55.108500 25369 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.145772 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:55.137097 21747 catalog_manager.cc:5697] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 5 to 7, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 7 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.146955 21926 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:55.138062 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:55.139235 21927 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.144315 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1966) took 1118 ms. Trace:
I20260709 12:10:55.114102 25294 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.160398 21852 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:55.128532 25320 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.160971 21918 rpcz_store.cc:276] 0709 12:10:54.025839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.113841 (+1088002us) service_pool.cc:224] Handling call
0709 12:10:55.143813 (+ 29972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.143989 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.144013 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.144055 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:55.144102 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.144157 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.144249 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:55.164055 21920 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.111317 25293 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:55.145035 25277 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.001s
W20260709 12:10:55.164399 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 102647us
I20260709 12:10:55.128463 25334 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:10:55.170914 21747 catalog_manager.cc:5697] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.176476 25257 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.146435 25258 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.076326 25230 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.179679 24822 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:55.170372 25320 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.183702 24688 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:55.184561 25296 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:55.186784 25212 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.171800 25294 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:55.192265 25358 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.482s	user 0.002s	sys 0.002s
I20260709 12:10:55.194802 25256 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.194964 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.211500 21918 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:10:55.213120 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:55.197026 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:55.204633 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:55.216063 21747 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 4, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 4 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:10:55.218511 25256 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.221091 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:55.209493 25259 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.223431 21747 catalog_manager.cc:5697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 1 to 6, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 6 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:10:55.228456 21918 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:55.135233 25265 consensus_queue.cc:237] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.229321 21747 catalog_manager.cc:5697] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.233111 25256 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:55.212548 25279 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.209794 25277 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.233336 25246 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:55.243777 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:55.404906 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:55.352715 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 126336us
I20260709 12:10:55.242391 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:55.261071 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:55.353881 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 94163.8us
I20260709 12:10:55.407375 22001 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.353299 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2143) took 1569 ms. Trace:
I20260709 12:10:55.413112 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:55.735153 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 302113us
I20260709 12:10:55.343222 21927 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:55.314839 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:55.790729 21994 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.226253 25257 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.245007 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:55.417500 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.249310 21926 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:55.225687 25098 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.242391 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:55.786486 21924 rpcz_store.cc:276] 0709 12:10:53.783905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.885864 (+1101959us) service_pool.cc:224] Handling call
0709 12:10:54.886226 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.900945 (+ 14719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.900973 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.917313 (+ 16340us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.119510 (+202197us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18001d7d60. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:10:55.222753 (+103243us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:55.223224 (+   471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.223310 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.278898 (+ 55588us) raft_consensus.cc:1685] finished
0709 12:10:55.278927 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.353191 (+ 74264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39233,"raft.queue_time_us":56061,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5721,"spinlock_wait_cycles":5704576,"thread_start_us":103047,"threads_started":1,"wal-append.queue_time_us":277650}
W20260709 12:10:55.798627 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.408177 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:55.789108 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:55.821688 21851 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
W20260709 12:10:55.828861 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 420722us
I20260709 12:10:55.829699 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:55.832957 21817 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:55.412048 25261 consensus_meta.cc:287] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.005s
W20260709 12:10:55.796051 25281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.013s
W20260709 12:10:55.752339 25387 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 12:10:55.841702 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:55.846661 21992 raft_consensus.cc:3055] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.778761 25295 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.848721 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:55.857983 21995 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.235374 25370 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:55.237798 25330 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:55.249215 25278 raft_consensus.cc:3055] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:55.237232 25212 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:55.248699 25320 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:55.243592 25341 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:55.855067 21992 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:55.834702 25256 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.827852 25338 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:10:55.891953 25279 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:55.869246 25295 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.893486 25212 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.894138 25212 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:55.894969 25295 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:55.895206 25212 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.897586 21919 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:55.902590 25256 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:55.903008 21995 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:55.904178 21817 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:55.903823 25256 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.905256 25341 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.905788 25341 raft_consensus.cc:697] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:55.853729 25280 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:55.906847 25341 consensus_queue.cc:237] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.907505 25280 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.352897 25115 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.395860 25356 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.458s
I20260709 12:10:55.911545 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:55.849238 25281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.002s	sys 0.014s
I20260709 12:10:55.834734 25355 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.431241 25273 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.423s
I20260709 12:10:55.921314 24988 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:55.344183 25213 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.510s
I20260709 12:10:55.852994 24904 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.879805 21992 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:55.925307 21992 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.910120 25280 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:55.873395 25278 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:55.854398 25261 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.924834 24904 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.966931 21999 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:55.963550 24904 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.987962 25261 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:55.990206 25115 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:55.981519 25277 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:55.972601 25278 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:55.993433 25278 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:55.961004 25258 consensus_meta.cc:287] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.000s
W20260709 12:10:56.055787 22001 consensus_meta.cc:287] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.001s
I20260709 12:10:56.056363 22001 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:10:56.064889 25261 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:56.065512 25261 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.069496 25261 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:56.079097 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 249475us
I20260709 12:10:56.079480 21994 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:56.080826 21817 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:56.087990 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.093124 25207 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:56.112679 21992 pending_rounds.cc:85] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 7
I20260709 12:10:56.113077 21992 pending_rounds.cc:107] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:10:56.113415 21992 raft_consensus.cc:2889] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:56.095577 25392 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.085111 25273 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:56.084825 25356 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:10:56.084915 25386 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:56.082182 25258 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.125768 25392 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.128870 25258 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.129236 25392 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:56.129616 25386 raft_consensus.cc:697] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:56.130652 25386 consensus_queue.cc:237] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.136361 25240 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.137557 25240 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.147019 22549 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:56.158861 25398 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:56.165927 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.126587 25273 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.170701 25261 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:56.144302 25392 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:56.179375 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1755) took 1561 ms. Trace:
I20260709 12:10:56.182941 21852 rpcz_store.cc:276] 0709 12:10:54.618173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.638548 (+ 20375us) service_pool.cc:224] Handling call
0709 12:10:56.178975 (+1540427us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540017edd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:56.179173 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992895360}
I20260709 12:10:56.142871 24904 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.186079 25261 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.186843 25392 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.195856 25269 raft_consensus.cc:3055] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:56.196276 25269 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:56.197252 25392 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.197171 25269 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.198184 25269 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.199460 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.200019 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1969) took 1339 ms. Trace:
I20260709 12:10:56.200358 21920 rpcz_store.cc:276] 0709 12:10:54.860753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.142086 (+281333us) service_pool.cc:224] Handling call
0709 12:10:55.142431 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.172859 (+ 30428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.199790 (+1026931us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b54002e7554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:56.199962 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49060096}
I20260709 12:10:56.185540 25398 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:10:56.201761 25346 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 1.518s	user 0.006s	sys 0.018s
W20260709 12:10:56.207434 21927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 2163) took 1292 ms (client timeout 1631 ms). Trace:
W20260709 12:10:56.223658 21927 rpcz_store.cc:269] 0709 12:10:54.914565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.933023 (+ 18458us) service_pool.cc:224] Handling call
0709 12:10:56.207227 (+1274204us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54003e7bd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:56.207356 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472185728}
I20260709 12:10:56.213357 25273 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.214686 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.228065 21994 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:56.215057 24904 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:56.215857 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.230398 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.218022 25261 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:56.227201 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.188941 25336 log.cc:927] Time spent T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 1.253s	user 0.005s	sys 0.007s
I20260709 12:10:56.232016 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:56.233517 21996 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.234804 25357 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.235356 25357 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.247062 25290 raft_consensus.cc:3055] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:56.247394 24710 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:56.241362 25115 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:56.248284 25213 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.248055 24710 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.248679 25213 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:56.248821 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 2159) took 1335 ms. Trace:
I20260709 12:10:56.249243 21919 rpcz_store.cc:276] 0709 12:10:54.913552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.024647 (+111095us) service_pool.cc:224] Handling call
0709 12:10:56.248638 (+1223991us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54003e71d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:10:56.248756 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915896704}
I20260709 12:10:56.249631 25213 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.253368 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.247521 25290 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:56.239542 25386 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:56.258976 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:56.241050 25293 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:56.262017 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.248631 25115 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.263101 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.263310 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.263669 21847 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:10:56.264478 25274 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:56.264248 25290 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.265003 25274 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.265342 25115 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.265424 25290 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.265435 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.262125 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.268026 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.240515 25240 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:56.250303 24710 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.270164 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.270390 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.272082 21849 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:56.244975 25267 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:56.273272 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.273896 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.275558 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.276423 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.268782 25386 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.276894 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.277946 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.275624 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.281965 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.283118 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.277096 21850 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:10:56.286093 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.287920 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.259567 25273 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.267114 25274 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.261277 25213 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:56.308249 25378 log.cc:927] Time spent T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 1.130s	user 0.003s	sys 0.007s
I20260709 12:10:56.288592 21849 raft_consensus.cc:2368] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:56.288792 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.260267 24904 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:56.291244 21996 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:56.267205 25392 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.292719 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.258688 25398 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.296029 21845 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.287561 25267 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.280377 25355 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.297295 24710 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.318089 25392 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.321161 24710 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:56.321620 25392 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.322029 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.323154 21845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:56.323666 21845 raft_consensus.cc:606] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:56.323966 21845 raft_consensus.cc:614] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:56.325012 21845 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.332316 25333 raft_consensus.cc:3055] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:56.332756 25333 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:56.332871 25267 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.333992 25355 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:56.293813 25356 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.335813 25294 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.318239 25402 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:56.336697 25402 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.337826 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 707) took 1479 ms. Trace:
I20260709 12:10:56.338208 22583 rpcz_store.cc:276] 0709 12:10:54.858110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.859564 (+  1454us) service_pool.cc:224] Handling call
0709 12:10:54.859832 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.108037 (+248205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.337588 (+1229551us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400462dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:56.337766 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569195776}
I20260709 12:10:56.338806 25402 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:56.299341 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.340296 21847 raft_consensus.cc:2368] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:56.340011 25355 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.341301 25355 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.299799 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 514) took 2368 ms. Trace:
I20260709 12:10:56.300349 25357 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.300859 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.286926 24866 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:56.318861 25273 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.310628 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.344285 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:56.306767 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.342281 21848 rpcz_store.cc:276] 0709 12:10:53.923282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.148926 (+225644us) service_pool.cc:224] Handling call
0709 12:10:54.149257 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.730249 (+580992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.730278 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.789162 (+ 58884us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b2c00014b88. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:10:54.795644 (+  6482us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.103570 (+307926us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.103608 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.290994 (+1187386us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400206554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:56.291076 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.291139 (+    63us) raft_consensus.cc:1685] finished
0709 12:10:56.291159 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.291325 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2327,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":1399531008,"thread_start_us":250801,"threads_started":1,"wal-append.queue_time_us":272540,"wal-append.run_cpu_time_us":1594,"wal-append.run_wall_time_us":1001609}
I20260709 12:10:56.349370 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:56.350709 22547 leader_election.cc:336] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.712s (SENT)
I20260709 12:10:56.389629 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:56.352066 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:56.354349 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.370663 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.388901 21847 raft_consensus.cc:606] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:56.391425 21847 raft_consensus.cc:614] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:56.392359 21845 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:56.397449 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:56.398787 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 48111.8us
I20260709 12:10:56.398937 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:10:56.399432 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.400605 22547 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:56.274544 25240 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.343565 25295 consensus_queue.cc:1059] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:10:56.411470 22547 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:56.274302 25293 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.348886 24866 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.394734 25357 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:56.322117 24710 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.407449 25301 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:56.408568 25402 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.412667 24553 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.427800 21850 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:10:56.430750 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1970) took 1569 ms. Trace:
I20260709 12:10:56.438572 21923 rpcz_store.cc:276] 0709 12:10:54.860982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.143715 (+282733us) service_pool.cc:224] Handling call
0709 12:10:55.162588 (+ 18873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.430372 (+1267784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.430403 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.430466 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:56.430510 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.430570 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.430683 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1267463,"raft.queue_time_us":1267805,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75}
I20260709 12:10:56.431516 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1954) took 3034 ms. Trace:
W20260709 12:10:56.431757 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 1.22716e+06us
I20260709 12:10:56.432210 25369 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:56.433382 24688 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.413887 25212 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.320380 24904 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:56.409893 25356 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:56.441928 21892 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:56.439956 21925 rpcz_store.cc:276] 0709 12:10:53.396350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.739694 (+1343344us) service_pool.cc:224] Handling call
0709 12:10:54.786215 (+ 46521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.786406 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:54.869556 (+ 83150us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.131751 (+262195us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.211184 (+1079433us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800309e80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae557 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:56.236426 (+ 25242us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800309e80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:10:56.307768 (+ 71342us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:56.429916 (+122148us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b1800309e80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be4d93060 00007f3be4da5716 00007f3be4db6287 00007f3be4db6208
0709 12:10:56.430055 (+   139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.430110 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:56.430161 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.430243 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.430366 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11275,"prepare.queue_time_us":67546,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":94,"raft.queue_time_us":1298303,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":5198,"spinlock_wait_cycles":80516224,"thread_start_us":294372,"threads_started":2,"wal-append.queue_time_us":307245}
I20260709 12:10:56.451031 22547 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:56.455987 21848 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:56.455632 25356 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.459410 24866 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:56.460337 25356 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.449869 24553 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.451530 24710 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.462777 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.463320 21844 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:10:56.416023 25392 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.460891 25356 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.451321 25301 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:56.474716 25407 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:10:56.475399 25405 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:56.479712 25240 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.482124 25293 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.451894 24688 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.515280 24688 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:56.487396 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.453230 25402 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:56.427430 25357 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.520207 25386 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.520907 25357 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.505035 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:10:56.506932 25392 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.522539 21847 raft_consensus.cc:606] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:56.522924 21847 raft_consensus.cc:614] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:56.523326 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:56.508495 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:56.509130 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:56.525214 21851 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.470367 24553 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.524178 25414 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:56.469658 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.531075 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:56.531162 25392 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.531757 25392 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:56.532863 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:56.532593 25392 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.533917 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:56.530627 25414 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:56.536151 25414 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.536623 25230 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.475420 24904 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:56.530594 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 61040.6us
I20260709 12:10:56.542480 22547 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:56.539701 25240 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.560384 25301 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.562590 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2166) took 1504 ms. Trace:
I20260709 12:10:56.563323 25411 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.565930 21918 rpcz_store.cc:276] 0709 12:10:55.058323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.229169 (+170846us) service_pool.cc:224] Handling call
0709 12:10:55.345997 (+116828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.431994 (+1085997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.432022 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.432529 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.503171 (+ 70642us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:56.503212 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.503277 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.562363 (+ 59086us) raft_consensus.cc:1685] finished
0709 12:10:56.562381 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.562532 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1057385,"raft.queue_time_us":1058540,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":70214,"threads_started":1,"wal-append.queue_time_us":128204}
W20260709 12:10:56.568570 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.568573 25240 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.570664 25411 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:56.571105 25273 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.571620 25411 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.566651 25252 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.583560 25252 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.573757 25273 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.600952 25240 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:56.602917 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.605844 25273 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.611279 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.612090 21992 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:10:56.613677 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:56.614902 25398 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:56.606622 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 1.4091e+06us
I20260709 12:10:56.617127 21893 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.617825 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2229) took 2060 ms. Trace:
I20260709 12:10:56.618594 25290 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.618368 21999 rpcz_store.cc:276] 0709 12:10:54.556945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.734814 (+177869us) service_pool.cc:224] Handling call
0709 12:10:54.735122 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.967567 (+1232445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.617531 (+649964us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000d2d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:56.617755 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2832314624}
I20260709 12:10:56.615370 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1960) took 3120 ms. Trace:
I20260709 12:10:56.620519 25273 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.626358 21851 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:56.616711 25369 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.615252 25398 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.615504 25277 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:56.620075 21921 rpcz_store.cc:276] 0709 12:10:53.495408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.807672 (+1312264us) service_pool.cc:224] Handling call
0709 12:10:54.808012 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.808269 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:55.120585 (+312316us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.615018 (+1494433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.615073 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:56.615132 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.615198 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.615317 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1544153,"prepare.queue_time_us":73586,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":5528,"raft.queue_time_us":1407804,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":364272,"threads_started":2,"wal-append.queue_time_us":119559,"wal-append.run_cpu_time_us":954,"wal-append.run_wall_time_us":1000975}
I20260709 12:10:56.620692 25031 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:10:56.616163 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 174314us
I20260709 12:10:56.632165 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.637099 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.633657 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:56.639704 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.640656 21919 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
W20260709 12:10:56.642385 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 99997.3us
I20260709 12:10:56.644524 21925 raft_consensus.cc:1240] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:56.646973 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:56.647922 21923 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.649132 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:56.649875 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.604359 25301 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.654631 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.654951 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:56.655745 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.656332 21918 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:56.656558 22547 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:56.650508 21927 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:56.651217 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.652379 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.637246 25412 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.653400 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:10:56.645691 25399 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.386s	user 0.002s	sys 0.002s
I20260709 12:10:56.660292 21925 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.653597 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.654343 21921 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:56.658131 22583 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:56.650995 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.663868 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.664178 21922 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:56.664616 21992 raft_consensus.cc:2393] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:56.631531 25252 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:56.639477 25398 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.637144 25290 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.665233 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:56.675025 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:56.675558 21993 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:56.665577 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.675715 22575 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:10:56.676213 21918 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:56.660101 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.667358 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:56.669859 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:56.671979 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.677287 21919 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.672127 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:56.677992 22576 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.672124 22578 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.678815 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.672211 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:56.679666 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 141428us
I20260709 12:10:56.653170 25392 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.679836 21926 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 4.
I20260709 12:10:56.654209 25273 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:56.654114 25091 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.658015 25411 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:56.645860 25277 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.700390 25411 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.700704 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.701323 22583 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:56.701565 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.701983 25277 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.702791 22578 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:56.703759 22582 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:56.706019 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.693297 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:56.706876 21996 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.707084 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.707644 25411 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.707687 22583 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:10:56.709331 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.710588 22583 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:56.711388 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.711921 22583 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:56.712724 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.713018 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:56.696389 21919 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:56.713456 21923 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:56.712764 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.709980 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.693825 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:56.714382 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.715070 21994 raft_consensus.cc:2410] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:56.697947 21925 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:56.715549 25277 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:56.643850 25031 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.722922 21920 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:56.717768 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.715583 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.719781 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:56.715049 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.724112 21967 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:56.721951 21996 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:10:56.671808 25258 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:56.666603 25232 consensus_queue.cc:1059] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:56.672544 25370 consensus_queue.cc:1059] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:10:56.658191 25357 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:10:56.725476 22583 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:56.727097 22547 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:56.726271 21967 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:56.728922 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.729308 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.660554 24866 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:10:56.676501 24688 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:10:56.672670 25412 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.722656 25290 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:56.736243 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:56.661355 25301 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.738369 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:56.745201 21920 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.729831 25257 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:56.731213 25277 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.731432 25270 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.749894 21967 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:56.762117 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.720345 25392 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:56.751645 25420 log.cc:927] Time spent T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:56.717800 25273 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:56.777676 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 64717.6us
I20260709 12:10:56.744170 25290 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:56.748313 25257 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.803031 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.803895 21923 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
W20260709 12:10:56.790727 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 61874.8us
I20260709 12:10:56.812342 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.743734 25295 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.742764 25294 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.731249 25258 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.845810 22579 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:56.782629 25232 raft_consensus.cc:3055] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:56.846203 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.759621 25270 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:56.792093 25240 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.853962 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:56.857244 21851 raft_consensus.cc:2410] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:56.854199 21849 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:56.855180 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.855400 21852 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:56.858640 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 122489us
I20260709 12:10:56.858642 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:56.788657 25373 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.791185 25213 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.795845 25301 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:56.815488 25290 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.882922 21847 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:56.885962 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:56.794482 25031 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.814785 25212 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.845145 22576 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:56.792366 25424 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.849452 25232 raft_consensus.cc:740] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:56.856704 25240 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.848011 25356 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.815028 25295 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:56.887800 21843 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.848452 25257 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.889416 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.891839 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.885932 25338 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.860146 25270 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:56.906733 25394 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.936s	user 0.003s	sys 0.002s
I20260709 12:10:56.884258 25402 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:56.907634 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:56.913793 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.923627 25369 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.915774 25258 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.917265 22578 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.918354 25031 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.890821 25259 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:56.863013 25370 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.919822 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:56.921195 21964 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:56.928761 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 170492us
I20260709 12:10:56.794376 25412 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.885716 25375 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.900252 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:56.975399 21923 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:56.947887 21848 pending_rounds.cc:85] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 4
I20260709 12:10:56.976194 21848 pending_rounds.cc:107] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:10:56.976480 21848 raft_consensus.cc:2889] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:56.941424 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:56.981033 22584 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:56.980677 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 95751.8us
I20260709 12:10:56.924412 25373 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:56.953243 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.954152 21850 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:10:56.992169 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.925074 25213 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:56.999382 25213 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.000988 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:56.964818 21847 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:57.002118 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:56.919863 25273 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.003901 24710 consensus_queue.cc:1059] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:57.004937 24710 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.005767 24710 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.006089 24710 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:57.006381 25252 raft_consensus.cc:1064] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:10:57.007023 25386 raft_consensus.cc:3055] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:57.007215 25307 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.007453 25386 raft_consensus.cc:740] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:57.008332 25386 consensus_queue.cc:260] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.975416 25259 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:56.941145 25240 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.011691 25259 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.003459 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:57.013830 25280 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.968989 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:56.970124 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.009485 25386 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.020013 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:56.955485 25295 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.951108 21925 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:56.984627 25398 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.021492 25357 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.981223 25375 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:56.970702 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.023167 21843 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:56.938534 25301 consensus_queue.cc:1059] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:10:57.024058 25375 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.987653 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:57.023891 25425 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:10:57.024809 25301 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.025172 25301 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:56.959848 25338 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.026324 25091 raft_consensus.cc:3055] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:57.026760 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:57.027387 21994 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.027729 25338 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:56.990341 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.031337 25293 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.031757 25293 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:57.032097 25293 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.032585 25290 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.033138 21851 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:10:57.035468 24710 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:57.035727 25408 log.cc:927] Time spent T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:57.026839 25091 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:56.991524 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.039736 25091 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.039927 25232 consensus_queue.cc:260] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.039753 21849 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:56.987967 21920 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
W20260709 12:10:56.997130 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 55804.4us
I20260709 12:10:56.996321 25015 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.987716 25321 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.014209 25280 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:57.015686 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.052294 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:57.053117 21993 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:10:57.054278 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:57.055228 21993 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:57.017985 25270 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.026005 25301 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.061692 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.074662 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.075469 21849 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:10:57.076453 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.021977 25357 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.022626 25398 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:56.997474 25333 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.040941 25232 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:57.094460 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:57.095407 22000 raft_consensus.cc:2410] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:57.095777 25373 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:56.966308 25369 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.099263 25290 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.100802 25301 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.992007 24553 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.104022 21992 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:10:57.104420 21992 pending_rounds.cc:85] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 8
I20260709 12:10:57.104636 24553 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:57.110131 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.957554 25294 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:10:57.114816 22581 raft_consensus.cc:2393] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:10:57.114725 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.116258 22575 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:57.059368 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.117117 21847 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:57.117731 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.074049 25280 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.118939 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:57.119709 21849 raft_consensus.cc:2410] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:57.120401 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.121322 21849 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:57.122695 21817 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:57.123080 25294 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.125233 25256 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:10:57.126780 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 91418.3us
I20260709 12:10:57.130589 25207 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:10:57.124130 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 78277us
I20260709 12:10:57.132241 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.132788 21818 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:57.060909 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.133621 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.135818 21847 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:10:57.136749 21994 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:10:57.040957 25091 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.050400 25015 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.062386 25212 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:56.949802 25414 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.064672 25273 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:57.064988 25392 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.047061 24688 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.009443 25252 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.184775 21845 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:57.082705 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:57.088359 25270 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:57.088876 25370 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.089530 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:57.176692 25307 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.060021 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.104632 21992 pending_rounds.cc:107] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:10:57.159214 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.167351 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:57.192801 21992 raft_consensus.cc:2889] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.193264 21847 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:57.168058 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:57.168438 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:57.169078 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 46454.2us
I20260709 12:10:57.171341 21818 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:57.172360 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 313804us
I20260709 12:10:57.176797 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:57.180064 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 48578.9us
I20260709 12:10:57.180739 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:57.195896 22584 raft_consensus.cc:2410] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:10:57.181620 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 260472us
I20260709 12:10:57.182566 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:57.196133 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.166702 25398 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.090119 25333 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.177567 25386 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:57.177440 25369 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:57.177687 25256 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:10:57.201663 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:57.199754 21817 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:57.213805 21818 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:57.214404 22581 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:57.196472 25307 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:57.182873 25240 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.189316 25341 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:10:57.224568 25240 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:57.219997 21892 leader_election.cc:400] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:57.221473 25356 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.222504 25307 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.225440 21892 leader_election.cc:403] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.225806 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:57.213881 24866 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.193060 25207 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:10:57.213121 25269 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:57.217216 25281 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:57.249063 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.211894 25433 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:57.250079 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 55261.1us
I20260709 12:10:57.251999 21966 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:57.252811 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:57.254913 22578 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:57.212147 25287 consensus_queue.cc:1059] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:57.195470 25370 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.259898 21892 leader_election.cc:400] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:57.259977 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:57.211087 25398 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.248579 25274 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:57.246393 24866 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.274391 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.277146 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.277488 25321 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.277818 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:57.278577 25414 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:57.278972 25115 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.219048 25251 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:10:57.250844 25369 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9.
I20260709 12:10:57.285123 22583 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:57.279347 25249 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.322702 25249 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.325352 25249 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:57.325517 25265 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.326051 25265 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:57.326447 25265 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.327924 25370 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:57.278685 25281 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:57.279556 25207 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:57.247891 24710 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.306663 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:57.340778 22584 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:10:57.258386 21966 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:57.309137 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49252.3us
W20260709 12:10:57.345305 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 87080.3us
I20260709 12:10:57.346061 21966 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.310142 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.295837 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.251461 25015 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.312744 22582 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:57.282573 25256 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.257113 25232 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.305334 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:57.259358 25240 raft_consensus.cc:3055] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:57.319344 25444 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 12:10:57.257480 25267 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.332388 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:57.317900 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:57.308853 24866 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:57.335268 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.374807 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 79048us
I20260709 12:10:57.273000 25269 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:57.336272 22576 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:57.304239 25274 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:57.344664 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:57.410159 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 67879.7us
I20260709 12:10:57.348836 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:57.387130 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 189808us
I20260709 12:10:57.354866 21966 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:57.433987 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 85255.6us
I20260709 12:10:57.434934 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:57.433352 21964 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.446903 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:57.443615 25267 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:57.432404 25274 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.449998 25269 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.335978 25207 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:10:57.364311 25249 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.380806 25369 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.350708 25357 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:57.452000 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 97226.3us
I20260709 12:10:57.385780 25256 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:57.450019 25267 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.375079 24688 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.356823 25448 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.388456 25240 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:57.464411 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:57.472128 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:57.385854 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.337620 25370 consensus_queue.cc:1059] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 12:10:57.382339 25293 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:57.477140 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.478199 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 299991us
W20260709 12:10:57.504312 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 221133us
I20260709 12:10:57.405857 25295 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.372638 25375 consensus_queue.cc:1059] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:10:57.460084 25321 raft_consensus.cc:2764] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:10:57.460227 25207 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.483680 21966 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.374272 25257 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.456916 25439 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:57.471932 25446 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:10:57.509866 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 124102us
I20260709 12:10:57.528858 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.456841 25447 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:57.535959 25447 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.475051 25267 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.475503 25256 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.520504 25448 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.542249 25448 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.542690 25448 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.546604 25293 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:57.547194 25293 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.547583 25293 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.549064 25115 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.549499 25293 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.549939 25115 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:57.534736 25357 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.550673 25240 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.551221 25279 raft_consensus.cc:3055] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:57.551666 25279 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:57.551923 25240 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.552553 25279 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.554778 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:57.555209 24710 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.554416 25279 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.473816 25369 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:57.528216 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 75429.9us
I20260709 12:10:57.538870 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:57.540228 25447 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:57.516459 25370 consensus_queue.cc:1243] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:10:57.540143 25441 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.175s	user 0.001s	sys 0.003s
I20260709 12:10:57.517858 25424 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.572674 21920 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:57.572559 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.573921 21964 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:57.550048 25293 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:57.574290 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:57.574724 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.590055 21845 raft_consensus.cc:2410] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:57.575637 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:57.590620 21922 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:10:57.576459 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:57.576653 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:57.579061 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:57.591675 21919 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:10:57.580410 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.591879 21925 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:57.580685 21921 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:57.593292 21919 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:57.600319 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:57.527989 25287 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.600149 25447 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:10:57.603158 25321 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.551931 25115 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:57.602695 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.605477 21927 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:57.559228 24688 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.612406 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:57.620961 21923 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:57.531731 25249 consensus_queue.cc:1059] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:10:57.614058 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.478940 25281 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.607452 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.641491 21848 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:57.562870 25091 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.622179 21926 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:10:57.538110 25251 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:10:57.515319 25265 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.640113 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.588804 25293 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:57.657244 21918 raft_consensus.cc:3055] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.588255 25433 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.619436 25270 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:57.526659 25451 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 12:10:57.610668 25287 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:57.613538 25373 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.656885 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.662128 25433 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:57.619292 25386 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:57.661556 25398 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.657729 21918 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:10:57.653051 25280 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.005s
I20260709 12:10:57.643101 25115 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:57.698269 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:57.679204 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.676815 21892 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:57.664249 25293 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.667694 25424 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.684402 25290 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.698186 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:57.670301 25287 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.651374 25333 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:10:57.643051 25370 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:10:57.681607 25301 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 12:10:57.684823 25256 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.691638 25295 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:57.692394 25265 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.687397 25257 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:57.654146 25091 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.708405 25433 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.696877 25369 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:57.683262 25461 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:57.712087 25267 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:57.736260 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 59508.1us
I20260709 12:10:57.733987 21918 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.795364 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.795670 21918 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.682066 25307 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.694295 25274 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.735008 25373 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:57.784906 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.718786 25280 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:57.747970 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 230723us
I20260709 12:10:57.813750 21967 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:57.820320 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:57.801333 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 337004us
I20260709 12:10:57.807278 22547 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.837092 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:10:57.838356 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.847366 21849 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:57.848490 22582 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.849730 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:57.851667 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:57.853406 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:57.854816 22578 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:57.787530 25461 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:57.857533 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:57.859566 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:57.860486 22578 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:57.860631 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.869820 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.873857 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:57.809963 25369 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:57.878327 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:57.876385 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:57.844640 25259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.009s	sys 0.003s
I20260709 12:10:57.857976 25370 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:57.871063 25425 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:57.874549 25257 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:57.871728 25373 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.812003 25398 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:10:57.871404 25414 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.895740 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:57.895995 25280 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:57.896262 25461 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.897068 25256 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:57.890575 25443 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.533s	user 0.000s	sys 0.003s
W20260709 12:10:57.897796 25456 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:10:57.873798 25424 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:57.885339 25449 log.cc:927] Time spent T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.518s	user 0.004s	sys 0.000s
W20260709 12:10:57.886547 25259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.009s	sys 0.003s
I20260709 12:10:57.845551 25448 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.898674 24688 consensus_queue.cc:1059] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:10:57.892508 25425 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:57.880468 24866 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.910667 25414 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:57.809273 25386 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:57.913954 25257 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:57.900195 25290 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.921536 25461 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.935030 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 451384us
I20260709 12:10:57.908671 25338 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:10:57.922719 25460 log.cc:927] Time spent T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:57.959774 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:57.970734 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.913141 22578 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:10:57.880028 25115 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:57.963660 21918 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:57.950037 25425 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:10:57.998584 25232 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:57.968261 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:10:57.978883 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 116671us
I20260709 12:10:57.985427 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1924) took 1008 ms. Trace:
I20260709 12:10:58.005369 21852 rpcz_store.cc:276] 0709 12:10:56.977038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.977149 (+   111us) service_pool.cc:224] Handling call
0709 12:10:56.977444 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.002590 (+ 25146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.002617 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.042820 (+ 40203us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b2c00014b88. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:10:57.043314 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.179988 (+136674us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:57.180026 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.180092 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.668158 (+488066us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:57.985160 (+317002us) raft_consensus.cc:1685] finished
0709 12:10:57.985190 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.985357 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24797,"raft.queue_time_us":27823,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":105574144,"thread_start_us":136312,"threads_started":1,"wal-append.queue_time_us":241049}
I20260709 12:10:57.963425 25213 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.956784 25414 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.955071 25370 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.964233 25290 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.008849 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:10:57.992384 21747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58722 (request call id 272) took 17464 ms (client timeout 15000 ms). Trace:
I20260709 12:10:58.021322 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:10:58.019502 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 52952.1us
I20260709 12:10:58.028038 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:10:57.980868 25338 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:58.030730 21847 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:58.032274 21852 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:58.032716 21852 pending_rounds.cc:85] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 7
I20260709 12:10:58.032977 21852 pending_rounds.cc:107] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:58.033259 21852 raft_consensus.cc:2889] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.037977 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:58.042331 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:58.046542 21847 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:58.048960 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:58.049991 21850 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:58.055730 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:58.056952 21852 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:58.059934 21852 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.061558 21847 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:58.025252 25290 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.063051 21846 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:10:58.027448 25301 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:58.068694 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:58.068645 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:58.069523 22582 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 11: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:10:57.991588 25207 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:58.075683 21992 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:58.075752 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.078691 21993 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:10:58.035746 25398 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:58.020183 25465 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:10:58.014786 25213 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.096220 21921 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:58.084133 21927 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:58.085497 21923 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.089537 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:58.089990 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:58.090184 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.092500 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:58.094698 21925 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:58.100373 21922 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:58.094884 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.104000 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.104053 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:58.104962 21919 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:10:58.063427 25307 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:58.066099 25091 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:58.124908 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.066689 25274 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:58.138935 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 532545us
I20260709 12:10:58.108620 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:58.146800 21925 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
W20260709 12:10:58.021636 21747 rpcz_store.cc:269] 0709 12:10:40.527787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.528001 (+   214us) service_pool.cc:224] Handling call
0709 12:10:57.992308 (+17464307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:55.949714 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:55.950531 (+   817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:55.950603 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:10:55.950632 (+    29us) tablet.cc:662] Decoding operations
0709 12:10:55.952273 (+  1641us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:55.952357 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:55.952402 (+    45us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:10:55.953980 (+  1578us) tablet.cc:701] Row locks acquired
0709 12:10:55.954010 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:10:55.954216 (+   206us) write_op.cc:270] Start()
0709 12:10:55.954368 (+   152us) write_op.cc:276] Timestamp: P: 1783599055954148 usec, L: 0
0709 12:10:55.954402 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:10:56.106012 (+151610us) log.cc:844] Serialized 5140 byte log entry
0709 12:10:56.597268 (+491256us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:10:57.034142 (+436874us) op_driver.cc:464] REPLICATION: finished
0709 12:10:57.215372 (+181230us) write_op.cc:301] APPLY: starting
0709 12:10:57.218974 (+  3602us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:57.247494 (+ 28520us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:57.247513 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:57.338828 (+ 91315us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:57.373889 (+ 35061us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:10:57.373961 (+    72us) write_op.cc:312] APPLY: finished
0709 12:10:57.374330 (+   369us) log.cc:844] Serialized 95 byte log entry
0709 12:10:57.374566 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:57.374702 (+   136us) write_op.cc:454] Released schema lock
0709 12:10:57.374751 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:57.386907 (+ 12156us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:57.405137 (+ 18230us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12692,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":161570,"apply.run_cpu_time_us":7886,"apply.run_wall_time_us":163746,"num_ops":13,"prepare.queue_time_us":170822,"prepare.run_cpu_time_us":17961,"prepare.run_wall_time_us":238304,"raft.queue_time_us":221748,"raft.run_cpu_time_us":14148,"raft.run_wall_time_us":222380,"replication_time_us":896055,"spinlock_wait_cycles":4030720,"thread_start_us":399376,"threads_started":4,"wal-append.queue_time_us":133975}]]}
I20260709 12:10:58.027619 25370 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.070055 25267 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:58.134491 21817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.017s	sys 0.020s
I20260709 12:10:58.135510 21992 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:58.106124 22000 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:58.122951 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:58.149986 21923 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:58.155138 24688 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:58.164199 21926 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:58.164048 24688 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.164403 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:58.151700 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:58.157094 21964 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:58.162120 21817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.017s	sys 0.020s
W20260709 12:10:58.167088 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 661860us
I20260709 12:10:58.169641 21996 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:58.170850 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.170177 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.180925 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.181073 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:58.181838 21925 raft_consensus.cc:2393] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:58.182950 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:58.183704 21925 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.191246 21999 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:58.192190 21993 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:58.203040 21993 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:58.204342 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:10:58.205683 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.205652 21995 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.212664 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:58.072791 25257 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.219102 21994 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:58.219131 21748 catalog_manager.cc:5697] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 4, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 4 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:58.215229 22000 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:58.166893 24688 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:58.222398 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.222725 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:58.223181 21999 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
I20260709 12:10:58.223229 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:58.223805 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:58.224916 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.225314 21994 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:58.225481 21996 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:58.226006 21995 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:58.226374 21995 pending_rounds.cc:85] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 7
I20260709 12:10:58.226332 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:58.226831 21995 pending_rounds.cc:107] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:58.227176 21995 raft_consensus.cc:2889] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.227165 21748 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 7, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 7 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:58.178591 25091 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.230793 24866 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:58.230674 25091 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.231482 24866 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.231953 24866 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:58.232939 25091 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:58.135403 25338 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.222486 25462 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.257540 21994 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:58.326243 21847 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:58.252799 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:58.260562 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:10:58.320858 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.284713 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 68719.3us
I20260709 12:10:58.257676 22000 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.280669 21993 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:58.235766 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:58.344753 21993 pending_rounds.cc:85] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 6
I20260709 12:10:58.343932 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:58.345809 21847 raft_consensus.cc:2393] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:10:58.248241 25373 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:58.281222 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:58.345055 22578 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:10:58.353400 21893 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:58.308998 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:58.354583 21852 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:58.345016 21993 pending_rounds.cc:107] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:58.358296 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:58.359015 21851 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.249821 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:58.359935 21921 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.234136 24866 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:58.247510 25207 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:58.339761 25274 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.235952 25270 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.374814 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:58.358520 21993 raft_consensus.cc:2889] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.264498 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:58.415124 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 150726us
I20260709 12:10:58.416108 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:58.259836 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:58.258219 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:58.417824 21998 raft_consensus.cc:2410] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 9 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:10:58.260202 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:58.264928 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:10:58.277098 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:58.376017 25439 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.386608 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.362985 25232 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:58.262871 25357 raft_consensus.cc:3055] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:58.350567 25373 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:58.234687 25448 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:58.389954 25091 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:58.250238 25451 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:58.357775 25470 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:10:58.404120 24688 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.404922 25287 consensus_meta.cc:287] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.002s
I20260709 12:10:58.408951 21921 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:10:58.419428 22576 raft_consensus.cc:2410] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:58.419528 21892 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:58.418826 21846 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.263758 21925 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:10:58.420670 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:58.418136 21851 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
W20260709 12:10:58.422274 22547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.010s	sys 0.025s
W20260709 12:10:58.567734 22547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.010s	sys 0.025s
W20260709 12:10:58.568419 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 731334us
I20260709 12:10:58.239748 25338 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.434592 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:58.470144 22577 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:58.467219 21996 raft_consensus.cc:2393] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 11: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:10:58.474424 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 131211us
W20260709 12:10:58.508064 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 102082us
W20260709 12:10:58.514835 21845 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.012s	sys 0.012s
I20260709 12:10:58.419807 25270 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:58.276080 25370 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:58.514403 21848 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.005s	sys 0.019s
W20260709 12:10:58.474313 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.528101 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 58794.6us
I20260709 12:10:58.420238 24866 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.534793 25091 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:58.453989 25369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.000s	sys 0.019s
I20260709 12:10:58.418839 25466 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 12:10:58.420038 25244 consensus_queue.cc:1059] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:10:58.402292 25290 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:58.347378 25462 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.440523 25301 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:58.473367 25232 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:58.521858 25293 consensus_meta.cc:287] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.773s	user 0.008s	sys 0.003s
I20260709 12:10:58.467393 25424 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:58.572863 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 138382us
I20260709 12:10:58.573061 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:58.572471 21846 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:10:58.601387 21817 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:58.601899 21815 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:10:58.602429 21924 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.019s	sys 0.051s
I20260709 12:10:58.423435 25249 consensus_queue.cc:1059] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:10:58.506872 25357 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:58.418818 25265 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.142s
I20260709 12:10:58.422674 25447 consensus_queue.cc:1059] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 12:10:58.424631 25465 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.136s
I20260709 12:10:58.617848 25477 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 12:10:58.527482 25451 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:58.475795 25256 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
W20260709 12:10:58.628886 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 471860us
I20260709 12:10:58.527432 25307 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:10:58.467824 25274 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.607724 25213 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:10:58.569684 22549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.004s
W20260709 12:10:58.758905 22549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.014s	sys 0.006s
I20260709 12:10:58.733739 25232 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:58.675689 21926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.011s	sys 0.010s
W20260709 12:10:58.693222 21848 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.009s	sys 0.021s
W20260709 12:10:58.762985 21926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.011s	sys 0.010s
W20260709 12:10:58.694249 21845 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.037s	sys 0.041s
I20260709 12:10:58.600875 24688 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.710386 21844 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:58.476410 25439 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:58.640257 25433 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.853s	user 0.012s	sys 0.000s
I20260709 12:10:58.778632 25433 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:58.779505 25499 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:10:58.779994 24688 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:58.780329 21922 raft_consensus.cc:2393] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:58.780519 24688 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.780681 25433 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:58.781317 25433 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.781001 24688 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.781731 25433 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:58.783017 25462 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:58.754768 25246 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:10:58.735675 25333 consensus_queue.cc:1059] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:10:58.783712 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:58.604421 25474 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:58.675235 25398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.019s	sys 0.000s
I20260709 12:10:58.633345 25481 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.788054 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:58.736200 25293 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.788867 22577 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
W20260709 12:10:58.736912 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 135084us
I20260709 12:10:58.736989 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:58.738657 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 137321us
I20260709 12:10:58.467178 25375 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
W20260709 12:10:58.710079 25369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.001s	sys 0.019s
I20260709 12:10:58.710685 25370 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.597895 25287 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:10:58.642957 25373 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:58.706725 25270 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.743247 25451 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:58.746738 25471 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:10:58.701022 25490 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:58.749264 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:58.749511 21923 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:10:58.736372 25425 consensus_meta.cc:287] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.000s
W20260709 12:10:58.759271 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 694495us
W20260709 12:10:58.457741 25281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.008s	sys 0.013s
I20260709 12:10:58.725900 25502 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:58.741462 25455 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:58.754829 25280 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:58.754593 25424 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.776432 25414 consensus_meta.cc:287] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.749s	user 0.012s	sys 0.000s
I20260709 12:10:58.778772 25213 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:58.694905 25461 consensus_meta.cc:287] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
W20260709 12:10:58.734287 21924 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.022s	sys 0.051s
W20260709 12:10:58.851979 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 115056us
W20260709 12:10:58.665606 25240 consensus_meta.cc:287] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.107s	user 0.014s	sys 0.000s
I20260709 12:10:58.800064 21815 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:58.792958 21818 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:58.788235 25398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.021s	sys 0.000s
I20260709 12:10:58.805217 25369 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:10:58.787372 25474 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.789197 25207 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:58.810456 25492 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:58.788008 24866 raft_consensus.cc:3055] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:58.828725 21817 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:10:58.842773 21843 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:58.845304 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:58.879053 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 129861us
W20260709 12:10:58.880326 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 87443.4us
W20260709 12:10:58.852021 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.882572 21999 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:58.853060 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:58.883697 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 83705.5us
I20260709 12:10:58.852346 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 496) took 1274 ms. Trace:
I20260709 12:10:58.840837 21849 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:58.788084 25301 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.939994 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 531) took 1110 ms. Trace:
I20260709 12:10:58.937951 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 537) took 1053 ms. Trace:
I20260709 12:10:58.967128 21964 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:58.967950 21999 pending_rounds.cc:85] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 7
W20260709 12:10:58.846040 25281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.009s	sys 0.013s
W20260709 12:10:58.833915 25483 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 12:10:58.971064 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 142362us
I20260709 12:10:58.997051 21999 pending_rounds.cc:107] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:58.999723 21999 raft_consensus.cc:2889] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.833496 25295 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:10:58.998374 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 256127us
I20260709 12:10:59.005966 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:58.966845 21924 rpcz_store.cc:276] 0709 12:10:57.577939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.581132 (+  3193us) service_pool.cc:224] Handling call
0709 12:10:57.581523 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.581970 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.582014 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.582602 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.054680 (+472078us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:58.851722 (+797042us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.851974 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.852069 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.852115 (+    46us) raft_consensus.cc:1685] finished
0709 12:10:58.852132 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.852281 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":299,"prepare.queue_time_us":478486,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":1667,"raft.queue_time_us":4900,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":22043,"thread_start_us":1241304,"threads_started":2,"wal-append.queue_time_us":889049}
W20260709 12:10:59.006388 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 153413us
I20260709 12:10:59.006652 21927 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:59.007789 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:59.008757 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:59.009627 21927 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:58.995945 21845 rpcz_store.cc:276] 0709 12:10:57.884094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.884242 (+   148us) service_pool.cc:224] Handling call
0709 12:10:57.884568 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.884818 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:58.775721 (+890903us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.937207 (+161486us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.937291 (+    84us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:58.937367 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.937655 (+   288us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.937859 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":499,"prepare.queue_time_us":834503,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":3074,"raft.queue_time_us":2034,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":1039306,"threads_started":2}
I20260709 12:10:58.835445 25470 raft_consensus.cc:3055] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:58.832050 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 262818us
I20260709 12:10:58.844519 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:58.838286 25504 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.849442 25373 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.850449 25280 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.011092 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:59.012550 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:59.032871 21924 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.013283 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 168034us
I20260709 12:10:59.032986 21927 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:59.013882 22576 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:59.033643 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:58.969945 24866 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:58.998029 21848 rpcz_store.cc:276] 0709 12:10:57.829652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.829831 (+   179us) service_pool.cc:224] Handling call
0709 12:10:57.876021 (+ 46190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.876241 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:58.763241 (+887000us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.884535 (+121294us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.884588 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:58.884639 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.939837 (+ 55198us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.939939 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":762057,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":366,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":51877,"thread_start_us":997348,"threads_started":2}
I20260709 12:10:58.846308 24688 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:58.943351 25503 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 12:10:59.019747 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.833895 25490 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:58.846432 25455 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:59.020139 22577 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:10:59.021365 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:10:59.017784 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 598287us
I20260709 12:10:59.052472 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:59.022985 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.052810 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:58.885421 25447 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.058153 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:58.922746 25321 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:58.886482 25475 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:10:59.018537 25303 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.024834 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:58.883670 25398 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:10:58.886619 25473 log.cc:927] Time spent T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:10:59.029381 21844 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:58.831990 25370 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:58.966581 25207 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:59.050230 25464 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.008389 21996 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
W20260709 12:10:58.942965 25498 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:10:59.020294 25471 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:59.008345 25451 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.922598 25463 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.885705 25341 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:58.995342 25474 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.886900 25486 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:58.853449 25414 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.048862 21847 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:59.018653 25251 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.006201 25295 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:58.832376 25462 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.198s
I20260709 12:10:59.055325 21893 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:10:59.150991 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 95773.8us
I20260709 12:10:59.019773 25493 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:59.018689 25491 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.942973 25287 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:58.846215 25425 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.053447 21922 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
I20260709 12:10:59.109644 25463 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.133919 25341 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.063359 21892 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:59.027271 25091 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:59.036705 25280 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.079538 21924 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:10:59.084370 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:59.034088 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:10:59.166890 21927 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.091792 25457 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:59.091696 25505 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:10:59.093641 25370 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.170842 25472 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.171197 25370 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:59.171772 25370 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.171526 25472 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.173241 25357 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.173943 25370 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.074556 25477 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.094120 25369 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.094720 25015 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.096134 25490 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:59.098879 25293 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.061024 24688 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.083606 25447 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:59.099448 25439 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.031901 25504 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.050724 25448 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:10:58.853659 25424 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:59.102082 25338 consensus_meta.cc:287] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 12:10:59.060282 25455 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.103478 21921 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:59.061128 25290 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:59.032032 25469 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:10:59.089181 25274 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:10:59.134755 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.093672 25482 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
W20260709 12:10:59.131368 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 99005.1us
I20260709 12:10:59.219031 25240 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:59.088310 25303 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:10:59.145735 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 87641.1us
W20260709 12:10:59.149201 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 124447us
I20260709 12:10:59.071049 25307 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:10:59.153731 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 497) took 1575 ms. Trace:
I20260709 12:10:59.155546 22579 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.019286 25470 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:59.287467 25303 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.299901 25470 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.142288 25251 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.167420 21924 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:59.301640 25251 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:59.171010 25509 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:59.075786 25386 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:59.302429 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:59.175698 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:59.303510 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 757) took 1486 ms. Trace:
I20260709 12:10:59.303781 22582 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:10:59.156929 25213 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.303925 22580 rpcz_store.cc:276] 0709 12:10:57.817566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.817699 (+   133us) service_pool.cc:224] Handling call
0709 12:10:57.871484 (+ 53785us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:57.879395 (+  7911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.879429 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:57.924170 (+ 44741us) log.cc:844] Serialized 546 byte log entry
0709 12:10:58.457044 (+532874us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:58.457195 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.457459 (+   264us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.303299 (+845840us) raft_consensus.cc:1685] finished
0709 12:10:59.303319 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.303453 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29957,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":16946,"thread_start_us":499017,"threads_started":1,"wal-append.queue_time_us":853612}
I20260709 12:10:59.295097 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:10:59.160832 25481 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:59.305754 25481 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.307523 25375 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:59.297744 25424 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.309937 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:59.160075 25502 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:59.311187 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:59.310820 25502 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.313418 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:59.314033 21923 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:10:59.314776 21893 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:10:59.317420 25259 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.165493 25341 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.174286 25357 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.205698 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:59.146885 25486 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.155902 25207 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.164740 25463 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.168856 25398 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:59.218056 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.352149 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:59.169163 25091 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:59.223122 21927 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:10:59.205828 25370 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.164332 25256 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:59.240839 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:59.362154 25252 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:59.105852 25464 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.255462 25504 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:10:59.256351 25515 log.cc:927] Time spent T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:10:59.257352 25513 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:10:59.232183 25475 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:59.371028 21844 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:59.252280 25495 log.cc:927] Time spent T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 12:10:59.267833 25293 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.372681 25293 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:10:59.268641 25512 log.cc:927] Time spent T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:10:59.268546 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 600) took 1011 ms. Trace:
I20260709 12:10:59.270071 25520 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:59.375113 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 748) took 1287 ms. Trace:
I20260709 12:10:59.203783 25295 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.271008 25433 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:59.276979 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:10:59.376132 25295 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.377089 21921 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.277064 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:59.378502 25439 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:59.378912 25439 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:59.378684 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:59.379806 25439 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.380944 25439 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:59.131112 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 97532.2us
I20260709 12:10:59.384060 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:59.386300 25213 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.386627 25448 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.387135 25448 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.389214 25448 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.389979 25524 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.250821 25472 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:59.233714 25232 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.390545 25524 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.392277 25232 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.392652 25524 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.324623 25240 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.392915 25505 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:59.394253 25505 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:59.394817 25240 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.395603 25505 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:59.277927 25508 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:59.198860 22576 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:59.164366 25493 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:59.298625 21920 rpcz_store.cc:276] 0709 12:10:57.578275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.606582 (+ 28307us) service_pool.cc:224] Handling call
0709 12:10:57.606954 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.618735 (+ 11781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.618764 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.624278 (+  5514us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.064747 (+440469us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:58.518865 (+454118us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.675517 (+156652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.675590 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.145950 (+470360us) raft_consensus.cc:1685] finished
0709 12:10:59.145969 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.153539 (+  7570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17136,"prepare.queue_time_us":568627,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":7538,"raft.queue_time_us":126542,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":70410,"thread_start_us":985009,"threads_started":3,"wal-append.queue_time_us":814548}
I20260709 12:10:59.298980 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:59.322291 21992 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:10:59.405850 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:10:59.407054 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:10:59.334487 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:10:59.339805 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 276548us
I20260709 12:10:59.407829 21995 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:10:59.274434 25414 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:59.342559 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:59.342819 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 137271us
I20260709 12:10:59.345316 21997 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:10:59.412380 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 113467us
I20260709 12:10:59.306263 25481 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.352705 21847 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:59.298774 25425 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:10:59.334326 25514 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:10:59.334905 25424 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.339412 25244 raft_consensus.cc:3055] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:59.366684 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2201) took 1180 ms. Trace:
I20260709 12:10:59.367830 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:59.368330 25466 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:59.266798 25447 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:59.379033 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 102039us
I20260709 12:10:59.161463 25491 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.362533 25091 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.396890 21924 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:10:59.375469 21999 rpcz_store.cc:276] 0709 12:10:58.257421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.265306 (+  7885us) service_pool.cc:224] Handling call
0709 12:10:58.265681 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.000228 (+734547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.268291 (+268063us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54003f3754. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:59.268472 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417719168}
I20260709 12:10:59.375757 22579 rpcz_store.cc:276] 0709 12:10:58.087837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.088014 (+   177us) service_pool.cc:224] Handling call
0709 12:10:58.088332 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.298849 (+1210517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.374822 (+ 75973us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400655254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:59.375039 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453769088}
I20260709 12:10:59.378252 21921 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:59.400061 21851 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.339495 25259 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.350972 25502 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.450543 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:10:59.479082 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.734752 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:10:59.664589 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.604190 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.741019 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 290611us
I20260709 12:10:59.741636 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:10:59.742571 21847 raft_consensus.cc:2410] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:59.601557 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 538) took 1689 ms. Trace:
I20260709 12:10:59.743057 21849 rpcz_store.cc:276] 0709 12:10:57.911931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.912387 (+   456us) service_pool.cc:224] Handling call
0709 12:10:57.912807 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.002318 (+1089511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.601274 (+598956us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b5400208854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:59.601481 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083643648}
I20260709 12:10:59.611380 21997 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:59.735602 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:10:59.736965 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.587968 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1949) took 1535 ms. Trace:
I20260709 12:10:59.748245 21927 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.768316 22547 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:59.751253 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:59.755309 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:59.770092 22576 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:10:59.770037 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:10:59.751744 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 343548us
I20260709 12:10:59.748768 21925 rpcz_store.cc:276] 0709 12:10:58.188367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.566907 (+378540us) service_pool.cc:224] Handling call
0709 12:10:58.567234 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.736109 (+168875us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:58.754994 (+ 18885us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.967261 (+212267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.967309 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:58.967355 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.366448 (+399093us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540013b5d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:59.366497 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.366619 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25566,"prepare.run_cpu_time_us":2041,"prepare.run_wall_time_us":34456,"raft.queue_time_us":2515,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":12015,"spinlock_wait_cycles":387850880,"thread_start_us":211898,"threads_started":1,"wal-append.queue_time_us":350972}
I20260709 12:10:59.745318 21843 rpcz_store.cc:276] 0709 12:10:58.052700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.052932 (+   232us) service_pool.cc:224] Handling call
0709 12:10:58.069562 (+ 16630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.966215 (+896653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.587624 (+621409us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54000933d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:10:59.587885 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777768832}
I20260709 12:10:59.756865 22579 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:10:59.781384 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.781826 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.375145 25293 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.779709 22580 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
W20260709 12:10:59.657603 25531 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 12:10:59.781966 21964 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:10:59.413905 25477 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:59.776470 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:10:59.488579 25270 consensus_meta.cc:287] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.651s	user 0.005s	sys 0.006s
I20260709 12:10:59.778146 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:59.775355 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:10:59.389240 25486 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:59.436000 25232 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.819016 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 419921us
I20260709 12:10:59.772641 25370 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:59.601155 25333 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.824481 22578 raft_consensus.cc:2410] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:59.748799 25424 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.826431 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:10:59.698077 25251 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.461486 25375 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.565380 25252 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.436885 25386 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.651275 25398 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:10:59.435725 25469 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:59.460829 25307 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:10:59.762019 25281 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.878777 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:59.734185 25466 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:10:59.762059 25433 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:59.747062 25464 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.436342 25240 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.391s
I20260709 12:10:59.738757 25244 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:10:59.772061 25504 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.785660 25448 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.375758 25520 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.951344 25307 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.556373 25280 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.033900 25470 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.034991 25251 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:00.035507 25280 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:59.505502 25274 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.369s
I20260709 12:10:59.817817 25530 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:00.036366 25530 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.821327 25321 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.821732 25249 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:59.877022 25513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.017s
I20260709 12:10:59.821708 25502 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.658690 25517 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.473s
I20260709 12:10:59.785360 25414 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 12:10:59.437796 25508 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.785825 25490 consensus_queue.cc:1059] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 12:10:59.914702 25425 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.295039 25240 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.201896 25466 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:00.043555 25455 consensus_meta.cc:287] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.002s
W20260709 12:11:00.278223 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.934526 25333 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.297165 25455 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:10:59.772667 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:00.300663 25333 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.301043 25455 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:00.301564 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 528831us
W20260709 12:11:00.302004 25357 consensus_meta.cc:287] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.955s	user 0.003s	sys 0.008s
I20260709 12:11:00.302986 25470 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.303333 21992 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:00.303808 25470 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:00.304431 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:10:59.933261 25474 consensus_meta.cc:287] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.781s	user 0.009s	sys 0.000s
I20260709 12:11:00.305758 25490 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:00.141458 25451 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.016s	user 0.006s	sys 0.004s
I20260709 12:10:59.951603 25469 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.306766 25474 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:10:59.919027 22000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.016s	sys 0.019s
W20260709 12:11:00.308283 22000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.017s	sys 0.019s
I20260709 12:11:00.308487 25274 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:11:00.283216 25213 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.896s	user 0.000s	sys 0.009s
I20260709 12:10:59.927721 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:10:59.917205 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:00.014901 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.284595 25091 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.111549 25244 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.137387 25259 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.885404 25270 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.033969 25307 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.333334 22582 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:00.078189 25321 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.337566 25321 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:00.189253 25341 consensus_meta.cc:287] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.843s	user 0.007s	sys 0.007s
I20260709 12:11:00.339071 25341 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.339990 25505 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.340619 25505 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:00.342374 25341 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.349946 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.287310 21919 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:59.949553 22578 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:00.356376 22578 pending_rounds.cc:85] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 7
I20260709 12:11:00.356727 22578 pending_rounds.cc:107] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:00.357026 22578 raft_consensus.cc:2889] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.950749 22579 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.919898 25370 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:11:00.361548 25370 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:59.896332 25232 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.364915 25232 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:00.140182 25373 consensus_meta.cc:287] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.091s	user 0.010s	sys 0.003s
I20260709 12:10:59.941708 25386 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.369094 25386 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:10:59.954128 25398 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.895648 25424 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.002233 25433 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.283669 25369 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:10:59.696916 25463 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.377918 25369 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.037779 25448 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.380903 25369 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:00.381675 25448 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.938944 25252 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.385272 25252 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.389714 25398 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:00.306834 25490 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.392724 25270 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:00.393473 25490 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:10:59.950539 25281 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.393949 21994 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:00.358065 25249 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:00.192605 25481 consensus_meta.cc:287] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.722s	user 0.002s	sys 0.009s
I20260709 12:10:59.895745 25486 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.326069 25470 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.406059 25486 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:10:59.714784 25493 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.113734 25502 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.138965 25508 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.145223 25491 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:00.079399 25513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.010s	sys 0.024s
I20260709 12:10:59.818028 25516 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.154s
I20260709 12:11:00.031291 25504 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.435482 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 867) took 1128 ms. Trace:
I20260709 12:11:00.435900 22580 rpcz_store.cc:276] 0709 12:10:59.307339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.322992 (+ 15653us) service_pool.cc:224] Handling call
0709 12:11:00.435124 (+1112132us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b540054a454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:00.435300 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847604992}
I20260709 12:11:00.436596 25504 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:00.134941 25521 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.109185 25519 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.033963 25520 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:00.006916 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.441417 25519 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:00.441792 22581 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:10:59.884593 25293 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:11:00.139657 25530 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:00.196332 25533 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
I20260709 12:11:00.443159 25519 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:00.209151 25534 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
W20260709 12:11:00.227730 25539 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
W20260709 12:11:00.230010 25541 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 12:11:00.037207 25542 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:11:00.454259 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 2001) took 1212 ms. Trace:
I20260709 12:11:00.197698 25546 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.454736 21924 rpcz_store.cc:276] 0709 12:10:59.242028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.302157 (+ 60129us) service_pool.cc:224] Handling call
0709 12:11:00.453738 (+1151581us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b54002e6654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:00.454018 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215311616}
I20260709 12:11:00.455906 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1995) took 1431 ms. Trace:
I20260709 12:11:00.456408 21927 rpcz_store.cc:276] 0709 12:10:59.024387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.353456 (+329069us) service_pool.cc:224] Handling call
0709 12:10:59.353759 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.748629 (+394870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.455405 (+706776us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540036f6d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:00.455670 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906810240}
I20260709 12:11:00.457305 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2191) took 2326 ms. Trace:
I20260709 12:11:00.457624 21843 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:00.457746 21919 rpcz_store.cc:276] 0709 12:10:58.130587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.130692 (+   105us) service_pool.cc:224] Handling call
0709 12:10:58.133698 (+  3006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.355767 (+2222069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.456987 (+101220us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b5400124154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:00.457222 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4951585664}
W20260709 12:11:00.201304 25532 log.cc:927] Time spent T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:11:00.458894 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2282) took 1150 ms. Trace:
I20260709 12:11:00.459540 21847 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:11:00.229960 25535 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:11:00.461129 25469 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.459362 21998 rpcz_store.cc:276] 0709 12:10:59.308375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.315780 (+  7405us) service_pool.cc:224] Handling call
0709 12:10:59.316236 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.316689 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.316727 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.317317 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.726977 (+409660us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:59.727043 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.727143 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.208403 (+481260us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:00.448753 (+240350us) raft_consensus.cc:1685] finished
0709 12:11:00.448797 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.458704 (+  9907us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":309,"raft.queue_time_us":3104,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14246,"spinlock_wait_cycles":12941696,"thread_start_us":409185,"threads_started":1,"wal-append.queue_time_us":504149}
I20260709 12:11:00.462896 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2286) took 1153 ms. Trace:
I20260709 12:11:00.142232 25545 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:00.114992 25548 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.481634 21893 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:00.481978 25548 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.482911 25546 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.213487 25549 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:00.276135 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 501241us
W20260709 12:11:00.279106 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.311625 21846 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.283619 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 1994) took 1259 ms. Trace:
W20260709 12:11:00.280762 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 505360us
W20260709 12:11:00.277694 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.487746 25548 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.310060 25213 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.490896 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.499401 25213 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:00.488950 25486 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:00.489637 25549 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.310175 25474 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:00.328881 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.307271 25465 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.492264 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1966) took 1135 ms. Trace:
W20260709 12:11:00.503057 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.502828 25465 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:00.503876 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.503136 21846 rpcz_store.cc:276] 0709 12:10:59.356759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.356890 (+   131us) service_pool.cc:224] Handling call
0709 12:10:59.357253 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.490742 (+1133489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.491907 (+  1165us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54000a8cd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:00.492181 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193645440}
I20260709 12:11:00.492453 21926 rpcz_store.cc:276] 0709 12:10:59.024120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.167015 (+142895us) service_pool.cc:224] Handling call
0709 12:10:59.167306 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.223983 (+ 56677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.224029 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.224728 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.229922 (+  5194us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:59.229977 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.230075 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.282772 (+1052697us) raft_consensus.cc:1685] finished
0709 12:11:00.282860 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.283294 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56500,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"thread_start_us":60924,"threads_started":2,"wal-append.queue_time_us":1039}
I20260709 12:11:00.394496 25281 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.079835 25477 raft_consensus.cc:697] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:11:00.349290 22001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2263) took 2164 ms (client timeout 2866 ms). Trace:
I20260709 12:11:00.378005 25433 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.395684 25481 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.380995 25463 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.421629 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.422143 22579 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:00.422253 25369 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:00.418630 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 316756us
I20260709 12:11:00.420588 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.353789 25115 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:00.519659 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:00.429926 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.437644 25521 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.437675 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.522866 25521 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.523092 22577 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:00.508055 25477 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.342061 25505 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.526475 25474 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.455817 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2289) took 1135 ms. Trace:
W20260709 12:11:00.211032 25536 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:11:00.041333 25540 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:11:00.466771 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.527346 25474 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:00.469637 21964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.034s
I20260709 12:11:00.463454 21996 rpcz_store.cc:276] 0709 12:10:59.309748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.334498 (+ 24750us) service_pool.cc:224] Handling call
0709 12:10:59.334808 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.342557 (+  7749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.342605 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.349999 (+  7394us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.798019 (+448020us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:59.798077 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.798188 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.229306 (+431118us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:00.462336 (+233030us) raft_consensus.cc:1685] finished
0709 12:11:00.462370 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.462690 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1779,"raft.queue_time_us":8011,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9685,"spinlock_wait_cycles":113922432,"thread_start_us":436853,"threads_started":1,"wal-append.queue_time_us":781388}
W20260709 12:11:00.532909 21964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.008s	sys 0.034s
I20260709 12:11:00.532702 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:00.448807 25502 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:00.534230 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 752287us
I20260709 12:11:00.475242 25520 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:00.476315 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2290) took 1155 ms. Trace:
I20260709 12:11:00.534353 25474 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.535425 25520 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.536084 25520 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:00.535459 21994 rpcz_store.cc:276] 0709 12:10:59.321235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.321372 (+   137us) service_pool.cc:224] Handling call
0709 12:10:59.321639 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.394460 (+1072821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.475927 (+ 81467us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400221d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:00.476241 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2464956288}
I20260709 12:11:00.536414 21964 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:00.474695 25257 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.538635 25257 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:00.539394 25461 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.540243 25257 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.541841 21893 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:00.483389 25546 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.501967 25530 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:00.534377 21846 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:00.542620 25546 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.505964 25549 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:00.542923 25530 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.545274 25530 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.398631 25249 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.487011 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:00.508747 22001 rpcz_store.cc:269] 0709 12:10:58.169504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.170587 (+  1083us) service_pool.cc:224] Handling call
0709 12:11:00.333809 (+2163222us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000d3c54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:00.334169 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3289671552}
I20260709 12:11:00.494724 25307 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:00.512789 25481 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.516085 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.517210 21967 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:00.549866 22581 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:00.550494 21967 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:00.550814 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2284) took 1241 ms. Trace:
I20260709 12:11:00.527478 22000 rpcz_store.cc:276] 0709 12:10:59.320886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.322914 (+  2028us) service_pool.cc:224] Handling call
0709 12:10:59.342038 (+ 19124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.343340 (+  1302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.343382 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.350673 (+  7291us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.226162 (+875489us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:00.309091 (+ 82929us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:00.309189 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.309314 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.455353 (+146039us) raft_consensus.cc:1685] finished
0709 12:11:00.455375 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.455703 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7698,"raft.queue_time_us":2256,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":4595,"spinlock_wait_cycles":120122112,"thread_start_us":905436,"threads_started":1,"wal-append.queue_time_us":660887}
I20260709 12:11:00.549036 22576 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.551339 21993 rpcz_store.cc:276] 0709 12:10:59.309058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.317917 (+  8859us) service_pool.cc:224] Handling call
0709 12:10:59.318274 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.286973 (+968699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.287060 (+    87us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.287126 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:00.287187 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.550280 (+263093us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54003f2854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:00.550336 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.550590 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225893760}
I20260709 12:11:00.552181 22576 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:00.517693 25207 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.518151 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.516139 25369 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.522073 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.531184 25505 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.477623 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2297) took 1073 ms. Trace:
I20260709 12:11:00.496690 21918 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:00.542068 25257 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:00.539849 25295 consensus_meta.cc:287] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.163s	user 0.009s	sys 0.012s
I20260709 12:11:00.554088 25466 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.526495 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.506398 25465 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.540194 25461 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:00.557081 21992 rpcz_store.cc:276] 0709 12:10:59.404050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.406849 (+  2799us) service_pool.cc:224] Handling call
0709 12:11:00.477329 (+1070480us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54000c3fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:00.477513 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059422464}
I20260709 12:11:00.553511 22576 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.574685 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:00.565641 24688 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.537756 25520 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.583868 21849 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:00.592365 25447 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.592751 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:00.593036 25447 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.593606 25447 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.593838 25454 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:00.590618 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1971) took 1108 ms. Trace:
I20260709 12:11:00.598713 21844 rpcz_store.cc:276] 0709 12:10:59.477858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.477987 (+   129us) service_pool.cc:224] Handling call
0709 12:11:00.526133 (+1048146us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:11:00.586102 (+ 59969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5738752}
I20260709 12:11:00.599174 25461 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.602774 24866 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:00.607344 25439 consensus_meta.cc:287] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.226s	user 0.020s	sys 0.002s
I20260709 12:11:00.608651 21995 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:00.586212 25481 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.613045 25481 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:00.614224 25369 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:00.593602 21925 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.620826 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.617702 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:00.622970 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50130us
I20260709 12:11:00.585202 25307 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.628863 22576 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.605270 24866 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.636132 21926 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.634598 25424 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.640411 25424 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.565176 25448 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:00.651052 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 96299.1us
I20260709 12:11:00.652243 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 603) took 1301 ms. Trace:
I20260709 12:11:00.652675 21995 rpcz_store.cc:276] 0709 12:10:59.350711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.732918 (+382207us) service_pool.cc:224] Handling call
0709 12:10:59.733274 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.609300 (+876026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.651903 (+ 42603us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54002c6354. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:00.652147 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950656384}
I20260709 12:11:00.654990 25301 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:00.656409 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.657938 25470 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:00.659835 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2298) took 1255 ms. Trace:
I20260709 12:11:00.659548 22581 raft_consensus.cc:2955] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:00.660229 21997 rpcz_store.cc:276] 0709 12:10:59.404393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.749512 (+345119us) service_pool.cc:224] Handling call
0709 12:10:59.771286 (+ 21774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.329863 (+558577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.329943 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.331640 (+  1697us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.412946 (+ 81306us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:00.573666 (+160720us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.573992 (+   326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.659270 (+ 85278us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54002364d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:00.659324 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.659383 (+    59us) raft_consensus.cc:1685] finished
0709 12:11:00.659477 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.659639 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60813,"raft.queue_time_us":2448,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":5259,"spinlock_wait_cycles":1242875136,"thread_start_us":203610,"threads_started":2,"wal-append.queue_time_us":151573}
I20260709 12:11:00.662971 25545 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 12:11:00.664172 21918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 2200) took 2478 ms (client timeout 3286 ms). Trace:
W20260709 12:11:00.664693 21918 rpcz_store.cc:269] 0709 12:10:58.186084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.420334 (+234250us) service_pool.cc:224] Handling call
0709 12:11:00.663881 (+2243547us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b5400040454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:00.664073 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4138720000}
I20260709 12:11:00.657972 21851 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:00.670460 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.670624 25307 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.671950 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.672916 25307 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.673836 21843 raft_consensus.cc:2410] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:11:00.674222 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46400.5us
I20260709 12:11:00.676848 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:00.677879 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:00.678555 21851 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:00.679042 25259 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:00.679224 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.680101 21846 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 9. Current term is 10. Ops: [6.8-9.9]
I20260709 12:11:00.679948 25259 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.680533 25265 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.681159 25265 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.681450 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:00.679162 21849 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:00.677906 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:00.694243 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.694766 21964 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:00.695820 25493 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.696280 25493 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.696676 25493 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.614173 25481 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.709637 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:00.709529 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 83589.6us
I20260709 12:11:00.714636 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.591464 24688 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.686609 25259 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:00.729485 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 71115.9us
I20260709 12:11:00.735792 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.736631 21846 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:11:00.708964 25439 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:11:00.738332 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 43684.4us
I20260709 12:11:00.740664 21964 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:00.742129 25472 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.742800 25472 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:00.743285 25472 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.687624 25424 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:00.697825 25295 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:00.759585 21920 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:00.759853 21846 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:00.760334 21846 pending_rounds.cc:85] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 8
I20260709 12:11:00.760694 21846 pending_rounds.cc:107] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:00.760937 21846 raft_consensus.cc:2889] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.760169 25265 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:00.762910 22576 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:00.705272 25546 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.782153 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:00.785498 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:00.765130 25259 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.794847 21918 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:00.794766 25259 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.788195 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:00.734443 25474 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:00.790488 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:00.797925 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47260.8us
I20260709 12:11:00.749981 25249 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.810887 21920 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:00.801978 21919 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:00.806798 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.780792 25424 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:00.812675 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 107094us
I20260709 12:11:00.826572 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.828168 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.830581 21923 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:00.798676 25439 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.833320 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:00.834125 21923 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:00.834852 25307 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:00.835283 25307 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:00.835223 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:00.836297 21923 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:00.836378 25307 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.837291 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:00.802495 25295 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.838518 25321 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:00.838742 21818 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:00.839598 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.841517 25249 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:00.843693 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.844062 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:00.844478 22579 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:00.844799 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:00.845595 21921 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.845479 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:00.846696 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.846838 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.847447 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.850203 21926 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:00.831401 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:00.846736 22580 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:00.849472 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:00.856998 25448 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:00.859515 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:00.821983 25519 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.856999 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:00.862174 25516 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:00.838027 21923 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.868937 22582 raft_consensus.cc:2410] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:00.868868 21846 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:00.867602 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 127137us
I20260709 12:11:00.874320 21844 raft_consensus.cc:2393] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:00.875890 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.872412 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:00.879302 21918 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:00.882902 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.876709 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:00.857947 25307 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:00.885092 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.863404 25519 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.863734 25369 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.893837 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.891701 22578 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.878381 25341 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:11:00.896566 25269 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:11:00.897666 25424 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:00.901196 25265 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:00.901971 25265 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.906941 25341 raft_consensus.cc:3055] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.907482 25341 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:00.908568 25341 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:00.909979 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:00.918709 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.923609 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:00.926082 22584 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:00.918077 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:00.928045 21925 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
W20260709 12:11:00.930510 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 51310.6us
I20260709 12:11:00.894923 25519 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.935421 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:00.863867 25463 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:11:00.894222 25369 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:00.878285 25281 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:00.946038 21844 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:00.946655 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:00.951009 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.949704 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:00.954588 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:00.955204 22576 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.953527 22000 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:00.944432 25341 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.937125 25424 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.947642 25369 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.967221 21997 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 4.
I20260709 12:11:00.964929 21848 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:00.961292 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:00.967661 21993 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.992798 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:00.953786 25269 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.000347 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:01.001245 22582 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.958060 25504 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.992528 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:01.003711 25461 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.007879 25504 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.008380 25461 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.008780 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:01.009457 21922 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 5.
W20260709 12:11:01.010159 25567 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:11:01.011480 22549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.647s (SENT) [suppressed 39 similar messages]
W20260709 12:11:01.012367 25561 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:11:01.012554 24688 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:01.014328 25516 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:01.014739 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.014869 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.015168 25516 consensus_queue.cc:1243] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:01.015540 22000 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:01.015115 25521 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.015928 25516 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.016024 25548 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.016377 25516 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:01.001372 25522 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.017004 25522 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.016714 25548 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.017613 25521 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.017418 25516 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.018843 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.020120 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.021289 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.022444 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.022917 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.023056 21852 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:11:01.023998 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.024981 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.025630 21852 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:01.027694 25520 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.033892 25244 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.034989 25502 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:01.035604 25547 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.035697 25502 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.036306 25547 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.038899 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.039741 21850 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:01.040391 21925 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:01.043805 22576 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:01.008143 25552 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:01.049257 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.046142 25547 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.057070 25424 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.059516 25424 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:01.065433 25207 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
I20260709 12:11:01.065653 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1970) took 1588 ms. Trace:
I20260709 12:11:01.066138 25558 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.066056 21848 rpcz_store.cc:276] 0709 12:10:59.477407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.477540 (+   133us) service_pool.cc:224] Handling call
0709 12:11:00.437276 (+959736us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:11:01.065429 (+628153us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400215f54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:01.065590 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013785216}
I20260709 12:11:01.066737 25558 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:01.068710 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.069367 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.069697 25552 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:01.069808 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:01.070185 25552 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:01.070604 25333 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.071023 25333 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:01.071538 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:01.072317 22001 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:01.072177 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.071977 25333 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.072887 21994 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:01.073350 25333 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.073896 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:01.074326 25558 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:01.071295 25552 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.075827 25552 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:01.017381 25522 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.078977 22000 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:01.081118 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:01.081758 21815 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:01.082759 25256 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:01.082921 21925 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:01.026298 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.081068 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:01.084493 22576 raft_consensus.cc:2410] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:11:00.996217 25474 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.091382 21893 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:01.001899 25546 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.101861 21844 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 5: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:01.038226 25502 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.105312 21918 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:01.107436 21995 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:11:01.108356 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.083328 25256 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:01.040403 25265 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:01.010286 25504 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.111533 21852 raft_consensus.cc:2410] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:01.114950 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.115130 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:01.118423 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.046773 25530 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.068730 25259 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:01.119843 21923 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:01.123951 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:01.124401 22578 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:11:01.120771 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:01.135444 21920 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.096370 24688 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:01.135066 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 43744.8us
I20260709 12:11:01.104662 25461 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:01.157697 21993 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:11:01.163498 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.164340 25256 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.164748 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:01.167757 21893 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:01.108839 25269 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.174552 21998 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:01.175913 25269 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.177572 24688 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.183842 25493 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.184427 25548 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:01.186112 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.187209 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.188514 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.189656 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.190472 21925 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:01.190919 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.190315 21999 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:01.194494 21999 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:01.195866 21999 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:01.155633 25502 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.202400 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.207250 25281 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.207376 21749 catalog_manager.cc:5697] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:01.209424 24866 consensus_meta.cc:287] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.560s	user 0.005s	sys 0.005s
I20260709 12:11:01.152995 25530 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.212839 25530 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.212952 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.213613 21999 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:01.214520 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.215152 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:01.127000 25472 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.216325 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:01.229121 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 61437.7us
I20260709 12:11:01.229727 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.109453 25474 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:01.236050 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 224583us
I20260709 12:11:01.234745 21921 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:01.243278 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:01.245009 21967 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:01.245337 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:01.158921 25516 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.252482 21923 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.148249 25259 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:11:01.252710 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:01.260404 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.209986 21749 catalog_manager.cc:5697] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 7, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 7 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:01.257682 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.262064 22582 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:11:01.180538 24688 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:01.216425 25207 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.260459 22583 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:01.285004 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:01.243265 25546 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:01.287825 21918 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:01.285364 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:01.250144 25448 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.289211 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:01.292696 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:01.235921 25502 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:01.254655 24866 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.297930 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:01.289737 21817 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:01.301371 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:01.260279 25461 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.307775 22577 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
W20260709 12:11:01.308967 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.265990 25504 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.310895 21893 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:01.276346 25493 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.315953 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:01.287176 25207 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.308214 22577 pending_rounds.cc:85] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 8
I20260709 12:11:01.323591 22577 pending_rounds.cc:107] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:11:01.323979 22577 raft_consensus.cc:2889] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:01.317337 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:01.324715 21998 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.314602 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:01.333313 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:01.294334 25448 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.338904 21966 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:01.343086 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:01.334154 21749 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 8, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 8 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:01.345969 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:01.355676 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 44874.3us
W20260709 12:11:01.358721 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.312628 25546 raft_consensus.cc:697] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:01.363034 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 73396.1us
I20260709 12:11:01.317005 25424 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.333782 25207 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.320647 25477 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:01.404117 25477 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.405061 22584 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:01.371381 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:01.406759 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:01.407209 21920 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.407644 22583 raft_consensus.cc:2393] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 5: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:01.406790 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:01.409026 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 92125.1us
I20260709 12:11:01.409854 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:01.375563 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.411022 25546 consensus_queue.cc:237] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.411567 25548 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.412114 25548 raft_consensus.cc:697] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:01.412361 21992 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:01.413142 25548 consensus_queue.cc:237] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.413594 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:01.376601 25472 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:01.377408 25502 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:01.378741 21748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58738 (request call id 282) took 30602 ms (client timeout 15000 ms). Trace:
I20260709 12:11:01.372416 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:01.379307 21749 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 6, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 6 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:01.380592 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.380826 25451 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.381124 25244 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.381742 25249 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.384605 25474 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.390542 25424 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.378302 21923 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:01.394601 25295 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.396783 25571 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
I20260709 12:11:01.402740 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:01.361829 25504 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.382059 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:01.398134 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:01.410995 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.390574 21921 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:01.416375 21844 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.352084 25448 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.428321 21893 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:01.430303 21927 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:01.430934 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:01.432781 25307 consensus_meta.cc:287] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.000s
I20260709 12:11:01.390305 25369 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.434718 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:01.481281 21925 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:01.434911 25455 consensus_queue.cc:1059] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:01.359616 24688 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:01.427758 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:01.342803 25505 consensus_queue.cc:1059] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:11:01.442483 25249 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.445992 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:01.490306 21923 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:01.406749 25477 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:01.447083 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:01.483793 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 111504us
I20260709 12:11:01.429409 25244 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:01.484756 21846 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:01.485463 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:01.435704 25481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.009s	sys 0.040s
I20260709 12:11:01.506080 21921 raft_consensus.cc:2410] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:01.495288 21850 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.480654 21749 catalog_manager.cc:5697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 6 to 9, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 9 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:01.483454 25321 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.534741 21920 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
W20260709 12:11:01.508227 25481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.009s	sys 0.041s
W20260709 12:11:01.506019 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 422699us
I20260709 12:11:01.430313 25493 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 12:11:01.547860 25447 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.953s	user 0.015s	sys 0.000s
I20260709 12:11:01.547683 21850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "372e433359ec4224868a6883dfc642e3"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:01.594312 21850 raft_consensus.cc:606] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:01.594872 21850 raft_consensus.cc:614] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:01.478554 25295 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.488979 25547 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 12:11:01.523612 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 76623.9us
I20260709 12:11:01.506680 25244 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.482378 25474 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.598357 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 60316.5us
I20260709 12:11:01.437312 25451 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.599390 21815 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:01.599993 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.440452 25522 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.526922 25341 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.627048 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:01.613111 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 231147us
W20260709 12:11:01.626164 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.640998 21992 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:01.645382 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:01.581511 25461 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:01.531286 24688 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.627683 21749 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 6 to 7, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 7 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:01.670171 21847 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:01.669766 22000 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:01.675550 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:01.676386 22581 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:01.604360 25469 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:11:01.692698 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:01.701452 22583 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:01.421473 21748 rpcz_store.cc:269] 0709 12:10:30.756537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.758092 (+  1555us) service_pool.cc:224] Handling call
0709 12:11:01.351472 (+30593380us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:58.938682 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:58.939270 (+   588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:58.939313 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:10:58.939337 (+    24us) tablet.cc:662] Decoding operations
0709 12:10:58.939786 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:58.939849 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:58.939881 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:58.940237 (+   356us) tablet.cc:701] Row locks acquired
0709 12:10:58.940254 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:58.940463 (+   209us) write_op.cc:270] Start()
0709 12:10:58.940598 (+   135us) write_op.cc:276] Timestamp: P: 1783599058940390 usec, L: 0
0709 12:10:58.940623 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:58.941352 (+   729us) log.cc:844] Serialized 923 byte log entry
0709 12:11:00.108748 (+1167396us) op_driver.cc:464] REPLICATION: finished
0709 12:11:00.218700 (+109952us) write_op.cc:301] APPLY: starting
0709 12:11:00.218787 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:00.218904 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:00.219007 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:00.219360 (+   353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:00.219575 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:11:00.219634 (+    59us) write_op.cc:312] APPLY: finished
0709 12:11:00.219837 (+   203us) log.cc:844] Serialized 29 byte log entry
0709 12:11:00.219986 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.220075 (+    89us) write_op.cc:454] Released schema lock
0709 12:11:00.220112 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:00.220510 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.220550 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":328481,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":28721,"apply.run_cpu_time_us":1770,"apply.run_wall_time_us":1774,"num_ops":2,"prepare.queue_time_us":702359,"prepare.run_cpu_time_us":24732,"prepare.run_wall_time_us":124262,"raft.queue_time_us":577002,"raft.run_cpu_time_us":6419,"raft.run_wall_time_us":191653,"replication_time_us":1135498,"thread_start_us":1559526,"threads_started":4,"wal-append.queue_time_us":193639,"wal-append.run_cpu_time_us":48420,"wal-append.run_wall_time_us":2285671}]]}
I20260709 12:11:01.698856 21818 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:01.707402 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 108130us
I20260709 12:11:01.708338 21815 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:01.661542 25481 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:01.706966 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44493.1us
I20260709 12:11:01.633543 25474 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:01.683135 21749 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:01.747824 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:01.671193 25463 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.686868 25486 raft_consensus.cc:2764] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:01.640793 25577 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 12:11:01.608477 25447 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:01.757903 25249 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:01.760298 24688 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:01.735708 25461 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.738472 25481 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.698134 25472 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:11:01.703498 25505 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.224s
I20260709 12:11:02.202939 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:01.797199 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 368972us
I20260709 12:11:01.858173 21848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:02.181411 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:02.212532 21848 raft_consensus.cc:606] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
W20260709 12:11:01.922921 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.996588 21918 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: [4.6-7.7]
I20260709 12:11:01.822882 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:01.967285 22583 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:02.215518 21920 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:02.085891 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 438601us
W20260709 12:11:01.888921 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 107553us
I20260709 12:11:01.706941 25540 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.216861 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:01.898379 21998 consensus_meta.cc:287] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.000s
W20260709 12:11:01.772114 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 145332us
I20260709 12:11:02.224543 21998 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:01.712007 25580 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:02.001391 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:01.976884 21749 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.014509 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:01.873595 25552 consensus_meta.cc:287] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.000s
W20260709 12:11:01.766093 25519 consensus_meta.cc:287] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.813s	user 0.008s	sys 0.005s
W20260709 12:11:01.754896 25333 consensus_meta.cc:287] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.008s
I20260709 12:11:01.878965 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:02.072147 21844 consensus_meta.cc:287] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 12:11:02.283152 21844 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:02.227021 24866 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:02.289093 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.003407 25582 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.399s	user 0.000s	sys 0.000s
I20260709 12:11:02.236459 21919 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:11:02.236718 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.237560 22578 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:02.207684 25600 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:02.300144 25600 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:02.241888 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:02.258373 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 510574us
I20260709 12:11:02.020323 25504 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:01.935012 25522 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:01.784212 25424 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:01.987151 25474 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:02.217039 25481 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.018596 25369 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:02.277014 21921 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:02.277352 21994 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:02.217334 25461 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:01.824165 25115 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.826720 25455 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.330087 25455 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.330617 25455 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.330713 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2223) took 1454 ms. Trace:
I20260709 12:11:02.331174 21922 rpcz_store.cc:276] 0709 12:11:00.876560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.081825 (+205265us) service_pool.cc:224] Handling call
0709 12:11:01.082169 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.120552 (+ 38383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.120600 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.144162 (+ 23562us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.762915 (+618753us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:01.762955 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.763028 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.330496 (+567468us) raft_consensus.cc:1685] finished
0709 12:11:02.330521 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.330656 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41344,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":14521,"thread_start_us":469339,"threads_started":1,"wal-append.queue_time_us":958382}
I20260709 12:11:02.333786 25447 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:02.334668 21919 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:11:02.334161 21996 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:02.278920 21749 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:01.928586 25463 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.337396 25463 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.337805 25463 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.338707 21749 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 6, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 6 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.340344 21749 catalog_manager.cc:5697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:02.341089 25207 consensus_meta.cc:287] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.937s	user 0.008s	sys 0.004s
I20260709 12:11:02.322698 25504 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:11:02.018957 25577 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.343451 25577 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:02.343847 25577 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.344344 21848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
W20260709 12:11:02.344671 25516 consensus_meta.cc:287] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 1.084s	user 0.004s	sys 0.006s
I20260709 12:11:02.344949 21848 raft_consensus.cc:606] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:02.345748 22577 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:02.346091 22577 pending_rounds.cc:85] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 8
W20260709 12:11:02.121225 25256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.009s
W20260709 12:11:02.346638 25256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.000s	sys 0.009s
I20260709 12:11:02.341470 25207 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.286500 21998 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:11:02.347628 21998 pending_rounds.cc:85] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 3
I20260709 12:11:02.347985 21998 pending_rounds.cc:107] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:02.348265 21998 raft_consensus.cc:2889] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:02.348694 25207 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:02.349036 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2320) took 1053 ms. Trace:
I20260709 12:11:02.349520 21998 rpcz_store.cc:276] 0709 12:11:01.295905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.276895 (+980990us) service_pool.cc:224] Handling call
0709 12:11:02.277299 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.348790 (+ 71491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.348986 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:02.293094 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 76310.5us
W20260709 12:11:02.324108 25598 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:11:02.351336 21964 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:02.351701 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2307) took 1199 ms. Trace:
W20260709 12:11:02.290324 22582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.010s
W20260709 12:11:02.353013 22582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.009s	sys 0.011s
I20260709 12:11:02.352102 21997 rpcz_store.cc:276] 0709 12:11:01.152734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.152896 (+   162us) service_pool.cc:224] Handling call
0709 12:11:01.231428 (+ 78532us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:01.264406 (+ 32978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.264440 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:01.265171 (+   731us) log.cc:844] Serialized 52 byte log entry
0709 12:11:01.575653 (+310482us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:01.575880 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.575959 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.351486 (+775527us) raft_consensus.cc:1685] finished
0709 12:11:02.351505 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.351649 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5401,"raft.queue_time_us":12796,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12710,"thread_start_us":252506,"threads_started":1,"wal-append.queue_time_us":599946}
I20260709 12:11:02.353788 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 777) took 1082 ms. Trace:
I20260709 12:11:02.354111 22582 rpcz_store.cc:276] 0709 12:11:01.271236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.271438 (+   202us) service_pool.cc:224] Handling call
0709 12:11:01.271744 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.354898 (+ 83154us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:01.705249 (+350351us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.353445 (+648196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.353496 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:02.353543 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.353615 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.353711 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":617394,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":926684,"threads_started":2}
W20260709 12:11:02.355212 25595 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.376s	user 0.004s	sys 0.004s
W20260709 12:11:02.351758 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.356284 25549 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:02.268810 25519 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.356932 25549 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.358556 25505 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:02.358681 25519 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:02.359093 25505 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:02.300590 25574 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 1.106s	user 0.002s	sys 0.017s
W20260709 12:11:02.301318 25604 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:11:02.301441 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1802) took 1290 ms. Trace:
I20260709 12:11:02.360872 21847 rpcz_store.cc:276] 0709 12:11:01.011150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.014611 (+  3461us) service_pool.cc:224] Handling call
0709 12:11:02.301245 (+1286634us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400206f54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:02.301384 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414062336}
I20260709 12:11:02.361303 25505 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:02.302104 25614 raft_consensus.cc:993] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:11:02.361697 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2204) took 1882 ms. Trace:
I20260709 12:11:02.362152 25614 raft_consensus.cc:1081] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:11:02.302613 21850 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:02.362073 21924 rpcz_store.cc:276] 0709 12:11:00.479782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.480093 (+   311us) service_pool.cc:224] Handling call
0709 12:11:00.480491 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.481068 (+   577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.481120 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.717172 (+236052us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b2c00000e98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:11:00.751913 (+ 34741us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.997622 (+245709us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:00.997702 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.000891 (+  3189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.282474 (+1281583us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:02.361496 (+ 79022us) raft_consensus.cc:1685] finished
0709 12:11:02.361521 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.361637 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":271,"spinlock_wait_cycles":99851008,"thread_start_us":197592,"threads_started":1,"wal-append.queue_time_us":327536}
I20260709 12:11:01.931268 25213 raft_consensus.cc:3055] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:02.364120 25213 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:02.364179 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2311) took 1152 ms. Trace:
I20260709 12:11:02.275404 25249 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.364648 21999 rpcz_store.cc:276] 0709 12:11:01.211782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.295364 (+ 83582us) service_pool.cc:224] Handling call
0709 12:11:01.312325 (+ 16961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.366738 (+ 54413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.366775 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.379092 (+ 12317us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.620399 (+241307us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.620439 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.620507 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.363962 (+743455us) raft_consensus.cc:1685] finished
0709 12:11:02.363982 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.364123 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9789,"raft.queue_time_us":9964,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":33690,"thread_start_us":240849,"threads_started":1,"wal-append.queue_time_us":549757}
I20260709 12:11:02.366235 25249 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.366659 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:02.352504 21964 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:02.307518 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:02.368253 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 60817.3us
I20260709 12:11:02.364789 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:02.368510 21964 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:02.369017 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:02.369829 25614 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.308231 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:02.370193 25614 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:02.309108 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.307965 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:02.316188 25520 consensus_meta.cc:287] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.288s	user 0.014s	sys 0.000s
W20260709 12:11:02.314927 25470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.023s	sys 0.049s
I20260709 12:11:02.328483 21995 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.328572 25461 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.346292 22577 pending_rounds.cc:107] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:02.374282 21995 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:02.370389 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:02.359695 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 786) took 1207 ms. Trace:
I20260709 12:11:02.382298 22577 raft_consensus.cc:2889] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:02.384596 21818 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:02.370257 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:02.356942 21846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1809) took 1343 ms (client timeout 1645 ms). Trace:
I20260709 12:11:02.369020 22578 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:02.370965 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 62800.6us
W20260709 12:11:02.385896 21846 rpcz_store.cc:269] 0709 12:11:01.013472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.021036 (+  7564us) service_pool.cc:224] Handling call
0709 12:11:02.356778 (+1335742us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54001bc6d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:02.356882 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064490880}
I20260709 12:11:01.858394 25414 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.584s
I20260709 12:11:02.383152 22576 rpcz_store.cc:276] 0709 12:11:01.152001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.152151 (+   150us) service_pool.cc:224] Handling call
0709 12:11:01.165441 (+ 13290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.196912 (+ 31471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.196959 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.197524 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.536886 (+339362us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.536931 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.537002 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.354630 (+817628us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:02.359380 (+  4750us) raft_consensus.cc:1685] finished
0709 12:11:02.359405 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.359633 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6544,"raft.queue_time_us":31155,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":55409408,"thread_start_us":338866,"threads_started":1,"wal-append.queue_time_us":517734}
I20260709 12:11:02.352451 25516 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.391822 21845 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:02.392055 25516 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.387784 25469 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.395920 25469 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:02.370673 25614 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.365064 25213 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.370594 25558 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.371469 25249 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:02.373564 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:02.375461 25593 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 12:11:02.405609 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:02.395144 25295 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:02.341925 21749 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 6, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 6 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:02.418262 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.375268 25607 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:11:02.424396 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:02.398062 25469 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:02.401511 25587 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.708s	user 0.009s	sys 0.000s
W20260709 12:11:02.376762 25470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.023s	sys 0.050s
I20260709 12:11:02.467511 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:02.468024 25600 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:02.468218 22576 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.470563 25461 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.472422 25481 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.312829 25580 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:02.474305 25472 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:02.475087 25481 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:02.475878 25414 raft_consensus.cc:2764] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:02.476269 25580 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:02.371800 25321 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.476810 25249 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:11:02.477399 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 107101us
I20260709 12:11:02.477133 25321 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.477850 25249 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.478679 21993 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:02.479074 25547 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.476269 22576 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:02.478555 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:02.398138 25451 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:02.432179 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 58669us
W20260709 12:11:02.399776 25599 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.421s	user 0.001s	sys 0.001s
I20260709 12:11:02.436635 21845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:02.388003 25265 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:02.493173 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:02.431974 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.484030 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:02.486362 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:02.326212 25115 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:02.370821 25447 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:02.402936 25578 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:11:02.404454 25540 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.491272 21749 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 7 to 10, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 10 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.495568 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:02.501811 21918 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:02.496297 21920 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:02.494998 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.489895 21845 raft_consensus.cc:606] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:02.500133 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:02.502190 21923 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:02.481356 25295 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.506865 21919 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:02.486908 25213 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.509334 21749 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 6 to 9, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 9 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.510646 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:02.517701 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 147504us
I20260709 12:11:02.511478 21964 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:02.485090 25269 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:02.521688 21964 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:02.523201 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.420192 25615 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:02.514324 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:02.488698 25474 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.520506 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:02.523975 22584 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:11:02.500106 25115 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:02.513114 25502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.000s	sys 0.028s
I20260709 12:11:02.531294 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:02.515906 25295 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.515367 25451 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.538312 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:02.538913 21997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:11:02.551657 21997 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:02.552187 21997 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:02.548429 25605 log.cc:927] Time spent T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:11:02.522796 25547 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:02.534396 25502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.000s	sys 0.028s
I20260709 12:11:02.529085 25520 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:02.533752 25244 consensus_meta.cc:287] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.905s	user 0.005s	sys 0.005s
I20260709 12:11:02.498895 25558 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:11:02.559455 21749 catalog_manager.cc:5697] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 4 to 5, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 5 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:02.594610 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56407.4us
W20260709 12:11:02.606978 25613 log.cc:927] Time spent T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:11:02.607260 25601 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:02.607883 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.608560 21923 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:02.608671 21892 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:02.609539 25600 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.609663 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.611632 25592 consensus_queue.cc:1059] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 12:11:02.522692 25477 consensus_queue.cc:1059] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:11:02.536617 25470 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:02.615161 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:02.610065 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:02.616458 21923 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:02.521221 25447 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:02.548489 25610 log.cc:927] Time spent T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 12:11:02.550055 25615 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:02.539274 25333 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:02.599532 25616 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:02.529686 25516 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:02.518783 25341 consensus_queue.cc:1059] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:11:02.619127 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.550200 25295 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.589082 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.601410 25520 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:02.667271 21926 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:02.649272 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 130887us
I20260709 12:11:02.654122 21918 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
W20260709 12:11:02.653553 25448 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.142s	user 0.008s	sys 0.004s
I20260709 12:11:02.655789 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:02.693552 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.656106 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.592269 25547 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.515793 25540 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:02.618489 25593 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:02.536424 25505 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:11:02.663264 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.663277 21921 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:02.600593 25474 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:02.668635 25341 raft_consensus.cc:3055] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.668792 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:02.597088 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1983) took 1754 ms. Trace:
I20260709 12:11:02.559094 25577 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:02.599884 25451 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.732317 21998 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.619406 25244 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.691608 25520 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.698822 25448 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.750396 25463 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.673520 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2024) took 1283 ms. Trace:
I20260709 12:11:02.674430 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2319) took 1382 ms. Trace:
I20260709 12:11:02.676539 25549 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:02.677825 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2318) took 1386 ms. Trace:
I20260709 12:11:02.677654 25295 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:02.684238 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:02.685413 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 779) took 1290 ms. Trace:
W20260709 12:11:02.778493 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 86824.5us
I20260709 12:11:02.689746 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:02.779346 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:02.780526 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:02.781581 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.782207 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 172228us
I20260709 12:11:02.694303 21923 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:02.660773 25470 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:02.669330 25472 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.793977 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.704377 21922 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:02.708088 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 607) took 1520 ms. Trace:
I20260709 12:11:02.708122 25474 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:02.708395 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
W20260709 12:11:02.708909 25621 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:11:02.662966 25502 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.705452 25341 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:02.712831 25636 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:02.706085 21843 rpcz_store.cc:276] 0709 12:11:00.842943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.854386 (+ 11443us) service_pool.cc:224] Handling call
0709 12:11:00.870898 (+ 16512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.930841 (+ 59943us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:00.930888 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.957000 (+ 26112us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.343758 (+386758us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.343802 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.343863 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.400721 (+1056858us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:02.558945 (+158224us) raft_consensus.cc:1685] finished
0709 12:11:02.558967 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.597024 (+ 38057us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19926,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":9870,"spinlock_wait_cycles":386903424,"thread_start_us":340204,"threads_started":1,"wal-append.queue_time_us":613841}
I20260709 12:11:02.714746 25615 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.699609 25547 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:02.705955 25603 log.cc:927] Time spent T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 12:11:02.721982 25455 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:02.669559 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:02.737480 21749 catalog_manager.cc:5697] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 2 to 5, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 5 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:02.758654 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 248924us
I20260709 12:11:02.730075 21997 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:02.769052 22000 rpcz_store.cc:276] 0709 12:11:01.291684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.358899 (+ 67215us) service_pool.cc:224] Handling call
0709 12:11:02.677643 (+1318744us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54001f04d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:02.677762 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497564416}
I20260709 12:11:02.768023 21992 rpcz_store.cc:276] 0709 12:11:01.292066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.414068 (+122002us) service_pool.cc:224] Handling call
0709 12:11:01.414352 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.641674 (+227322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.674182 (+1032508us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54003f4654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:02.674355 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504834432}
I20260709 12:11:02.690636 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:02.778851 22577 rpcz_store.cc:276] 0709 12:11:01.395405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.395549 (+   144us) service_pool.cc:224] Handling call
0709 12:11:01.395902 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.383986 (+988084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.685154 (+301168us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b5400486054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:02.685352 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183620992}
I20260709 12:11:02.787150 21998 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:02.766274 21927 rpcz_store.cc:276] 0709 12:11:01.390185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.485190 (+ 95005us) service_pool.cc:224] Handling call
0709 12:11:01.506730 (+ 21540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.707357 (+200627us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:01.753102 (+ 45745us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.353597 (+600495us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b180047adc0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b23a 00007f3be4da5a2a
0709 12:11:02.504137 (+150540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.504207 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:02.504272 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.673298 (+169026us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54001707d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:02.673343 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.673463 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17478,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":77,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":6803,"spinlock_wait_cycles":452558464,"thread_start_us":150312,"threads_started":1,"wal-append.queue_time_us":900895}
I20260709 12:11:02.789986 25265 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:02.828210 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:03.156998 21999 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:02.783092 25259 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.932965 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 96213.1us
I20260709 12:11:02.798497 22001 rpcz_store.cc:276] 0709 12:11:01.187396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.188247 (+   851us) service_pool.cc:224] Handling call
0709 12:11:01.188587 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:01.189055 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.189086 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:01.189740 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 12:11:01.526768 (+337028us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.602839 (+ 76071us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.623457 (+ 20618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.623564 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.374772 (+751208us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:02.603465 (+228693us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b1800496540. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae522 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:11:02.707864 (+104399us) raft_consensus.cc:1685] finished
0709 12:11:02.707886 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.708020 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":75872,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":4260,"raft.queue_time_us":24716,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":12335,"spinlock_wait_cycles":129600512,"thread_start_us":328313,"threads_started":1,"wal-append.queue_time_us":738421}
I20260709 12:11:02.762948 25244 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:03.159576 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 490079us
W20260709 12:11:03.149227 25634 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:11:03.069347 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.156141 21847 raft_consensus.cc:606] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
W20260709 12:11:03.060061 21924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.002s	sys 0.010s
W20260709 12:11:03.044836 21996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2303) took 1973 ms (client timeout 2236 ms). Trace:
I20260709 12:11:03.045841 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1706) took 1860 ms. Trace:
W20260709 12:11:03.159021 25589 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.009s	sys 0.001s
I20260709 12:11:02.826491 25451 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:03.184265 21997 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:03.183154 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:03.201325 21923 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.978636 25293 raft_consensus.cc:3055] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:02.797063 25617 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:03.150382 25307 raft_consensus.cc:3055] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.186074 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:03.195951 21846 raft_consensus.cc:2393] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:02.976552 25448 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:02.974844 25631 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.199920 25207 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:03.211369 25631 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.211633 25207 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.193506 25626 consensus_queue.cc:1059] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 12:11:03.199733 25589 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.009s	sys 0.002s
I20260709 12:11:03.213593 25207 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:03.203346 25249 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.215457 25637 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:03.216073 25637 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.218592 25249 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.208472 25617 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:03.221503 25617 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.221613 25249 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:03.197999 21924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.002s	sys 0.013s
I20260709 12:11:03.197503 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:03.198035 21996 rpcz_store.cc:269] 0709 12:11:01.071900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.073577 (+  1677us) service_pool.cc:224] Handling call
0709 12:11:03.044651 (+1971074us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002d14d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:03.044772 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2747553536}
I20260709 12:11:03.198292 21993 rpcz_store.cc:276] 0709 12:11:01.185741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.185860 (+   119us) service_pool.cc:224] Handling call
0709 12:11:03.045608 (+1859748us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002b75d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:03.045779 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2970489088}
I20260709 12:11:03.169112 25493 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:03.201489 21925 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:02.967068 25269 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:03.001605 25463 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:02.978621 25633 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.825958 25577 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:02.825945 25281 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.373s
I20260709 12:11:03.199426 25341 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:03.199733 25461 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:11:03.231769 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 53051.9us
I20260709 12:11:03.229374 21749 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 7 to 10, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 10 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:03.218953 25295 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:03.231218 25493 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.180748 25592 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:11:03.233269 21923 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:03.237982 25633 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.815362 25472 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:03.226661 25614 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.002s
I20260709 12:11:03.204057 25293 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:03.181293 25259 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:03.168241 25636 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:03.290043 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 92613.5us
I20260709 12:11:03.306036 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:03.208030 25307 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:03.018545 25470 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.291675 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1985) took 1930 ms. Trace:
W20260709 12:11:03.312886 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 484760us
I20260709 12:11:03.236781 25628 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:03.236898 25369 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.299186 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:03.293128 25249 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.826501 25474 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.298887 25493 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.316756 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:03.319265 21923 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.311687 21852 rpcz_store.cc:276] 0709 12:11:01.361288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.361648 (+   360us) service_pool.cc:224] Handling call
0709 12:11:01.375339 (+ 13691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.375780 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.375832 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.376399 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.935121 (+558722us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:01.935185 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.935293 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.291373 (+1356080us) raft_consensus.cc:1685] finished
0709 12:11:03.291393 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.291554 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32307,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"thread_start_us":394109,"threads_started":1,"wal-append.queue_time_us":905147}
I20260709 12:11:03.321714 21749 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 1 to 4, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 4 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.303001 25341 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.324010 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:03.366668 21925 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:03.370613 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56805.6us
I20260709 12:11:03.371366 21815 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:03.373066 21815 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:03.325448 21892 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:03.330469 21923 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
W20260709 12:11:03.332702 25213 consensus_meta.cc:287] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.816s	user 0.008s	sys 0.000s
I20260709 12:11:03.334498 25502 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:03.335635 25641 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:11:03.336526 25581 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.346s	user 0.004s	sys 0.000s
I20260709 12:11:03.302188 25633 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.338958 25307 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:03.308686 25265 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:11:03.383014 25589 raft_consensus.cc:993] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
W20260709 12:11:03.363951 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.396759 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.389098 25577 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.399255 25472 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:03.399616 25115 consensus_meta.cc:287] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.859s	user 0.006s	sys 0.003s
I20260709 12:11:03.400066 25115 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.403541 25577 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:03.404486 25577 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.403563 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:03.406476 21923 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:03.316357 25269 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.321434 25295 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:03.383864 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 189798us
W20260709 12:11:03.350261 25520 consensus_meta.cc:287] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.001s
I20260709 12:11:03.384805 21749 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 9, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 9 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.414145 21749 catalog_manager.cc:5697] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 6, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 6 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:03.303742 25461 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.306851 25614 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.386696 25502 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:03.378996 21925 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:03.384127 25293 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:03.469560 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1984) took 2619 ms. Trace:
I20260709 12:11:03.502645 21749 catalog_manager.cc:5697] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 3 to 6, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 6 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:03.770151 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.891527 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:03.891376 21749 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:03.458684 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 133351us
I20260709 12:11:03.895138 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:03.587605 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.625816 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:03.897729 21923 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:03.827384 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 1999) took 1401 ms. Trace:
W20260709 12:11:03.799468 22547 leader_election.cc:336] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.582s (SENT)
W20260709 12:11:03.901535 21815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.046s	sys 0.029s
W20260709 12:11:03.903537 21815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.046s	sys 0.030s
W20260709 12:11:03.903939 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 529581us
I20260709 12:11:03.392871 25369 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.901966 22547 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:03.901288 21850 rpcz_store.cc:276] 0709 12:11:02.425902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.426087 (+   185us) service_pool.cc:224] Handling call
0709 12:11:02.426455 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.476534 (+ 50079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.476569 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.476614 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:02.476645 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.827024 (+1350379us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b5400216454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:03.827103 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.827298 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114645248}
I20260709 12:11:03.393316 25626 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:03.841923 25617 consensus_meta.cc:287] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.000s
W20260709 12:11:03.774024 25645 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.470s	user 0.001s	sys 0.000s
W20260709 12:11:03.880618 25646 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:11:03.920567 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:03.932323 21918 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:03.888895 21851 rpcz_store.cc:276] 0709 12:11:00.843384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.845463 (+  2079us) service_pool.cc:224] Handling call
0709 12:11:00.845872 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.870045 (+ 24173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.870078 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.892299 (+ 22221us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.246684 (+354385us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.246752 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.246863 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.308848 (+2061985us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:03.462822 (+153974us) raft_consensus.cc:1685] finished
0709 12:11:03.462850 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.463122 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26898,"raft.queue_time_us":19671,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":12900,"spinlock_wait_cycles":82235136,"thread_start_us":276425,"threads_started":1,"wal-append.queue_time_us":1003073}
W20260709 12:11:03.898663 25474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.007s	sys 0.020s
I20260709 12:11:03.421470 25592 raft_consensus.cc:1081] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
W20260709 12:11:03.930809 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.939558 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.462298 25115 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:03.623859 25461 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:03.566002 25259 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:03.940053 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.915845 25486 raft_consensus.cc:3055] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.640506 25295 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.888096 25455 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:03.904584 25502 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.919468 25469 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.941043 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:03.927388 25293 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:03.941663 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46639.5us
I20260709 12:11:03.942044 21922 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:03.563181 25636 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:03.950389 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:03.434527 25520 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:03.565603 25493 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:03.941332 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:03.942734 25474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.020s
I20260709 12:11:03.945061 21921 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 12:11:03.945813 21926 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:11:03.946236 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 54800.7us
W20260709 12:11:03.961127 25341 consensus_meta.cc:287] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
I20260709 12:11:03.965633 25637 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:03.948971 25486 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:03.946762 25643 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:03.968665 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:03.968741 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:03.969481 21924 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:03.969632 21922 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:03.971340 21964 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:03.972626 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2032) took 1366 ms. Trace:
I20260709 12:11:03.973026 21920 rpcz_store.cc:276] 0709 12:11:02.606700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.606833 (+   133us) service_pool.cc:224] Handling call
0709 12:11:02.607163 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.607548 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.607588 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.828885 (+221297us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b2c00000e98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:11:02.829297 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.167391 (+338094us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:03.167446 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.167535 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.972314 (+804779us) raft_consensus.cc:1685] finished
0709 12:11:03.972335 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.972562 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":418,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":18744704,"thread_start_us":337676,"threads_started":1,"wal-append.queue_time_us":380877}
I20260709 12:11:03.976424 25614 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:03.943593 25617 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.980414 25617 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:03.950906 25461 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.983559 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 784) took 1624 ms. Trace:
I20260709 12:11:03.966200 25637 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.984057 22580 rpcz_store.cc:276] 0709 12:11:02.358786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.359981 (+  1195us) service_pool.cc:224] Handling call
0709 12:11:02.360333 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:02.360739 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:02.361042 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.489145 (+128103us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:02.549270 (+ 60125us) log.cc:844] Serialized 52 byte log entry
0709 12:11:02.549445 (+   175us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:02.549485 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.549553 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.671786 (+122233us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b4800061458. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be9cc4aa1 00007f3be9cbbb37 00007f3be9cbb9ca 00007f3be9db326f 00007f3be9db2f37 00007f3be9dc755c 00007f3be9dc7508 00007f3be9dc7488 00007f3be9dc7443 00007f3be9dc66ec 00007f3be8cf0a96
0709 12:11:03.981211 (+1309425us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b24002f1158. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1b349c4 00007f3be1b32acb 00007f3be1ceddc9 00007f3be1ceda55 00007f3be1cecfb0 00007f3be4963488 00007f3be4963be8 00007f3be493b398 00007f3be493676a 00007f3be4935bb6
0709 12:11:03.983283 (+  2072us) raft_consensus.cc:1685] finished
0709 12:11:03.983312 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.983484 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32557,"prepare.queue_time_us":650,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":8144,"raft.run_cpu_time_us":2592,"raft.run_wall_time_us":178404,"spinlock_wait_cycles":136425600,"thread_start_us":125247,"threads_started":1,"wal-append.queue_time_us":163394}
I20260709 12:11:03.953367 25530 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.990713 25655 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:03.956667 25636 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:03.967239 25486 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:03.953051 25295 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:04.009701 21920 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:03.956120 25469 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:04.026921 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:04.027376 25469 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:04.027627 21926 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
W20260709 12:11:04.028419 25633 consensus_meta.cc:287] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.003s
I20260709 12:11:04.028890 25633 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:04.031935 25547 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.000s
I20260709 12:11:04.032418 25547 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:04.035852 25295 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:04.037415 25493 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:04.016430 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:04.017769 25606 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 1.723s	user 0.004s	sys 0.008s
I20260709 12:11:04.022161 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:04.022890 25486 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.024194 25520 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:03.994043 25637 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:04.003232 25636 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:04.039610 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.039865 21924 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:04.040515 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.056140 21924 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
W20260709 12:11:04.058293 21994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1704) took 2918 ms (client timeout 2999 ms). Trace:
W20260709 12:11:04.058871 21994 rpcz_store.cc:269] 0709 12:11:01.139698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.139841 (+   143us) service_pool.cc:224] Handling call
0709 12:11:04.058103 (+2918262us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002dfad4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:04.058234 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2474660608}
I20260709 12:11:04.060168 25659 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.057674 25547 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:04.077809 25637 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:04.086678 25636 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:04.078498 25637 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:04.082623 25633 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:04.090829 25552 raft_consensus.cc:3055] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:04.127626 25502 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:04.131495 25661 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:04.132285 25661 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:04.133874 25502 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:04.134773 25502 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.135102 25661 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:04.135394 25502 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:04.172154 25502 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:04.172542 25661 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:04.172950 25502 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.173216 25661 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:04.151274 22549 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.647s (SENT)
I20260709 12:11:04.173537 25502 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:04.174962 25655 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:04.175493 25661 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:04.185428 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2329) took 1675 ms. Trace:
I20260709 12:11:04.185909 21998 rpcz_store.cc:276] 0709 12:11:02.510235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.510368 (+   133us) service_pool.cc:224] Handling call
0709 12:11:04.185235 (+1674867us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54000c3fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:04.185360 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493581184}
I20260709 12:11:04.194322 25321 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:04.130529 25552 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:04.203789 25631 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:04.215600 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 783) took 1857 ms. Trace:
W20260709 12:11:04.216601 21846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 1998) took 1792 ms (client timeout 2212 ms). Trace:
W20260709 12:11:04.232156 21846 rpcz_store.cc:269] 0709 12:11:02.423890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.424084 (+   194us) service_pool.cc:224] Handling call
0709 12:11:04.216409 (+1792325us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b540017f2d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:04.216535 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668406144}
I20260709 12:11:04.229451 25540 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:04.230963 22581 rpcz_store.cc:276] 0709 12:11:02.357755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.357971 (+   216us) service_pool.cc:224] Handling call
0709 12:11:02.358357 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.483991 (+125634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.484020 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.484473 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.760179 (+275706us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:02.760223 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.215139 (+1454916us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400548dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:04.215199 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.215251 (+    52us) raft_consensus.cc:1685] finished
0709 12:11:04.215267 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.215518 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11993,"raft.queue_time_us":5065,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":8915,"spinlock_wait_cycles":288177408,"thread_start_us":275283,"threads_started":1,"wal-append.queue_time_us":495318}
I20260709 12:11:04.241008 21925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:11:04.241911 21925 raft_consensus.cc:606] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:04.242354 21925 raft_consensus.cc:614] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:04.229871 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 430436us
W20260709 12:11:04.248278 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.074594 25659 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:04.261210 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 347689us
W20260709 12:11:04.266628 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.267362 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.176741 25502 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:04.291898 21817 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:04.341385 22549 leader_election.cc:336] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.549s (SENT)
I20260709 12:11:04.315459 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:04.345206 21967 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:04.345232 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:04.347092 21998 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
W20260709 12:11:04.347335 22547 leader_election.cc:336] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.625s (SENT)
I20260709 12:11:04.347759 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:04.265347 25540 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.404142 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:04.403487 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:04.408149 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:04.586935 21846 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.403337 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:04.591123 22001 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:04.405737 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:04.403774 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:04.348626 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:04.594743 21999 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:04.288311 25259 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.290230 25662 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:04.525141 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.595770 25259 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:04.552229 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 205812us
I20260709 12:11:04.596336 25662 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:04.598215 25259 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:04.600657 25662 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:04.601536 25662 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.602891 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:04.603351 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:04.604722 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:04.604929 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:04.558318 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:04.564960 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:04.527244 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:04.608019 22000 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.609721 22000 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:04.610564 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:04.606282 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:04.614946 21846 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:04.407462 21992 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:04.617640 21992 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:04.618889 21992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35508
I20260709 12:11:04.619796 21992 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:11:04.566877 21923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.016s	sys 0.024s
I20260709 12:11:04.570829 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:04.405090 25547 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.577703 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:04.582386 21847 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:04.582278 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 290436us
I20260709 12:11:04.583052 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:04.427211 21995 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:11:04.620694 21918 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.022s	sys 0.059s
I20260709 12:11:04.621071 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:04.628918 25546 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:04.406456 25632 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.626374 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.627017 21749 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.005s	sys 0.007s
I20260709 12:11:04.389617 21850 raft_consensus.cc:1240] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.429816 25244 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:04.583009 21892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.014s	sys 0.049s
W20260709 12:11:04.628877 21964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.043s	sys 0.117s
I20260709 12:11:04.630097 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:04.430166 25519 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.288540 25472 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.311371 25661 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:04.633450 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:04.634709 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:04.348290 25447 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:04.348318 25655 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:04.635227 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 287894us
W20260709 12:11:04.931396 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 614326us
I20260709 12:11:04.566614 25461 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.528530 25256 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:04.531625 25633 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:04.641099 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:04.288877 25637 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.642990 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:04.576864 25626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.012s	sys 0.030s
W20260709 12:11:05.116405 25667 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 12:11:04.749975 21992 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.754240 25321 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:05.161002 25461 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.204849 25321 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.205555 25461 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.205922 22584 raft_consensus.cc:2410] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:05.181926 25632 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:04.684316 25521 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.564s
I20260709 12:11:05.208505 25632 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:05.115547 25520 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:05.209257 25520 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:05.204012 25626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.251s	user 0.012s	sys 0.031s
I20260709 12:11:05.210795 25626 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:05.212005 25307 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.211944 25626 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:04.620751 25463 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.214569 25256 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.214810 25463 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.216732 25463 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:04.584342 25502 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.217442 25502 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.218468 21992 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.219633 25502 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:04.346567 25369 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:04.341961 25295 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:05.220584 21992 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:05.220827 25295 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:04.341297 25636 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:05.156385 21923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.028s	sys 0.040s
W20260709 12:11:04.801326 22549 leader_election.cc:336] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 2.040s (SENT)
I20260709 12:11:05.234372 22549 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:05.008683 22581 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.009s	sys 0.018s
I20260709 12:11:04.561257 25493 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.157693 21846 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:05.157601 22547 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.647s (SENT)
I20260709 12:11:05.158372 21845 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:05.158646 21964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.044s	sys 0.131s
W20260709 12:11:05.158895 21892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.019s	sys 0.058s
I20260709 12:11:04.763793 21849 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.160327 21848 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:04.814177 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:05.166219 21843 raft_consensus.cc:3055] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:05.168190 21852 raft_consensus.cc:2368] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
W20260709 12:11:05.156816 21918 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.028s	sys 0.072s
W20260709 12:11:05.177431 21749 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.006s	sys 0.011s
W20260709 12:11:05.178786 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.936334 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:05.130481 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.924817 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.111974 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:04.884472 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:05.182188 22583 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.640293 25614 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:04.691910 25628 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.297s	user 0.094s	sys 0.149s
I20260709 12:11:05.193938 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:05.280557 25628 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.888s	user 0.127s	sys 0.183s
I20260709 12:11:05.222986 21996 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:11:05.281011 25628 raft_consensus.cc:697] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:04.529812 25552 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.281378 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:05.282060 25552 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:05.117430 25293 consensus_meta.cc:287] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.165s	user 0.004s	sys 0.007s
I20260709 12:11:05.281956 25628 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.282949 25670 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.283679 25295 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:05.283433 25670 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.286484 25636 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.236826 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:05.258023 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 1.27393e+06us
I20260709 12:11:05.259797 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:05.234792 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:05.256759 21843 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:05.260635 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:05.289078 21846 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:05.260842 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:05.289536 21992 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
W20260709 12:11:05.263062 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.261791 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:05.216745 25256 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:05.266101 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:05.289167 21844 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.259069 22547 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:05.260479 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:05.262233 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 1.31019e+06us
W20260709 12:11:05.272135 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.267396 25664 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.280432 25614 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.286969 21850 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.288864 21843 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.331601 21843 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.291519 22584 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:05.267194 25493 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.290431 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:05.290398 21846 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:05.279695 25520 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:05.265559 25321 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:05.309298 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:05.267308 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 466010us
W20260709 12:11:05.223270 25642 log.cc:927] Time spent T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 1.859s	user 0.001s	sys 0.002s
I20260709 12:11:04.981734 24866 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:05.334496 22577 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.009s	sys 0.017s
I20260709 12:11:05.339121 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 619) took 1024 ms. Trace:
I20260709 12:11:05.344502 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:04.638265 25540 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:05.348100 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 190515us
W20260709 12:11:05.359803 22577 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.010s	sys 0.017s
I20260709 12:11:05.360172 21996 rpcz_store.cc:276] 0709 12:11:04.314984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.315122 (+   138us) service_pool.cc:224] Handling call
0709 12:11:05.338963 (+1023841us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54002350d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:05.339063 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019113728}
I20260709 12:11:05.360714 22583 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
W20260709 12:11:05.349009 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 56007.7us
W20260709 12:11:05.387729 22547 leader_election.cc:336] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.549s (SENT)
I20260709 12:11:05.183367 25547 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.389024 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:05.390005 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:05.384941 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 96938us
I20260709 12:11:05.184923 25655 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.203485 25447 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.334522 25614 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.410194 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:05.387508 22001 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:05.406739 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:05.202446 25472 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.441370 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:05.441738 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 52087.4us
I20260709 12:11:05.237850 25637 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.388281 25677 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:05.443444 21994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.036s	sys 0.062s
W20260709 12:11:05.443830 21994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.036s	sys 0.062s
I20260709 12:11:05.216826 25633 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:05.183187 25546 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.418815 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:05.192613 25519 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.451133 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:05.193465 25115 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.169s
I20260709 12:11:05.364008 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:05.348158 25615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.122s	user 0.007s	sys 0.023s
I20260709 12:11:05.202924 25661 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.192480 25244 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:05.234050 25638 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.139s
I20260709 12:11:05.442291 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:05.454272 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:05.446157 21817 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:05.453630 25670 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:05.419369 25686 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.445562 25690 raft_consensus.cc:2764] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:05.471956 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:05.471568 25664 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.474282 21852 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:05.384546 24866 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:06.214577 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:06.216347 21846 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:06.216648 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 770557us
I20260709 12:11:05.743556 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2339) took 1144 ms. Trace:
I20260709 12:11:06.217329 21993 rpcz_store.cc:276] 0709 12:11:04.598647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.608017 (+  9370us) service_pool.cc:224] Handling call
0709 12:11:04.608304 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.452500 (+844196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.452543 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.452598 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:05.452644 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.743247 (+290603us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54003f2854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:05.743313 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.743480 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1940977536}
I20260709 12:11:06.144899 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:06.219226 21922 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:06.177426 22579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.007s	sys 0.003s
I20260709 12:11:05.590857 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:06.177752 21997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.246s	user 0.003s	sys 0.008s
I20260709 12:11:05.621234 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 797) took 1327 ms. Trace:
I20260709 12:11:06.221510 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.169277 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:05.471557 25663 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.751s
W20260709 12:11:06.188719 25321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.005s	sys 0.005s
I20260709 12:11:05.454324 25677 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:06.221877 25615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.996s	user 0.011s	sys 0.053s
I20260709 12:11:05.637961 21843 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
W20260709 12:11:06.220434 22579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.007s	sys 0.003s
W20260709 12:11:05.779016 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.475037 25493 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:05.863963 21918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.000s	sys 0.021s
I20260709 12:11:05.693579 25521 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:05.471712 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:05.938201 25691 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:11:06.097193 21923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.022s	sys 0.027s
I20260709 12:11:05.655977 25676 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.462759 21847 raft_consensus.cc:2368] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
W20260709 12:11:05.916420 25626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.008s	sys 0.032s
W20260709 12:11:05.503310 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 331910us
W20260709 12:11:06.187822 25520 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.005s	sys 0.013s
I20260709 12:11:05.987109 25600 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.164887 25295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.008s	sys 0.015s
I20260709 12:11:05.997223 25547 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:05.679759 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.621168 22584 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:06.189127 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:05.823544 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2345) took 1222 ms. Trace:
I20260709 12:11:05.766042 25369 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.170080 21919 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:05.739162 25474 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:11:06.249706 21967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.005s	sys 0.007s
I20260709 12:11:05.835654 25540 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:06.222636 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.223266 21926 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
W20260709 12:11:06.221071 21997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.289s	user 0.004s	sys 0.008s
W20260709 12:11:06.225010 21843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 2004) took 1695 ms (client timeout 1519 ms). Trace:
I20260709 12:11:06.225169 21996 raft_consensus.cc:2376] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10. Re-sending same reply.
W20260709 12:11:06.227006 21918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.008s	sys 0.023s
I20260709 12:11:06.227807 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.229023 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.230248 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:06.221071 21845 raft_consensus.cc:2368] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
W20260709 12:11:06.231362 21923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.023s	sys 0.028s
I20260709 12:11:06.233619 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:06.237638 21924 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.237671 22001 rpcz_store.cc:276] 0709 12:11:04.600694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.605957 (+  5263us) service_pool.cc:224] Handling call
0709 12:11:05.768589 (+1162632us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400221d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:05.823451 (+ 54862us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783777024}
I20260709 12:11:06.222811 21920 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:06.229624 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:06.229681 22580 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:11:06.229900 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2334) took 1632 ms. Trace:
W20260709 12:11:06.236173 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 793896us
I20260709 12:11:06.221582 22581 rpcz_store.cc:276] 0709 12:11:04.293523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.293655 (+   132us) service_pool.cc:224] Handling call
0709 12:11:04.349064 (+ 55409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.349314 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:05.235403 (+886089us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.620808 (+385405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.620859 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:05.620909 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.621036 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.621178 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":872020,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":36241,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":1191734,"threads_started":2}
I20260709 12:11:05.473563 25519 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:06.249792 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.997578 25689 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.072638 22000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.001s	sys 0.008s
W20260709 12:11:06.263659 21817 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.089s (SENT) [suppressed 15 similar messages]
I20260709 12:11:06.384719 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:06.356961 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:06.233496 25520 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.006s	sys 0.013s
I20260709 12:11:06.405777 22579 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
W20260709 12:11:06.232821 25626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.009s	sys 0.044s
I20260709 12:11:06.406392 22583 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:06.249030 25664 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.407346 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.407666 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.407987 22579 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:06.409058 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.409607 25664 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:06.409893 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:06.410336 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.187769 25546 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:05.478385 25659 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:05.472154 25680 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 12:11:06.411273 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2236) took 2481 ms. Trace:
I20260709 12:11:06.225711 25677 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.358809 25548 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:06.412628 25548 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.355439 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:06.223698 25321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.005s	sys 0.006s
I20260709 12:11:06.258287 25493 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:06.248771 25686 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:06.229511 25244 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.415375 25493 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:06.416172 22549 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.004s	sys 0.032s
I20260709 12:11:06.415715 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:06.416764 22547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.006s	sys 0.022s
I20260709 12:11:06.417047 21920 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:06.223541 25690 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.362710 25447 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:06.383322 22550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.000s	sys 0.028s
I20260709 12:11:06.395313 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2348) took 1792 ms. Trace:
W20260709 12:11:06.384989 22577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.011s	sys 0.018s
I20260709 12:11:05.864486 25636 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:06.411747 21918 rpcz_store.cc:276] 0709 12:11:03.929530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.948094 (+ 18564us) service_pool.cc:224] Handling call
0709 12:11:03.948394 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.948613 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:05.265036 (+1316423us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.410840 (+1145804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.410909 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:06.410979 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.411064 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.411206 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126543,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":1897,"raft.queue_time_us":238,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":2453206,"threads_started":2}
I20260709 12:11:06.071838 25472 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:05.938978 25672 log.cc:927] Time spent T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 12:11:06.438997 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:06.439788 22579 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.212546 25633 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:06.416388 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 182852us
W20260709 12:11:06.416482 22549 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.004s	sys 0.032s
W20260709 12:11:06.445513 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 1.09063e+06us
W20260709 12:11:06.446776 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.447100 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.449466 22549 connection.cc:256] RPC call timeout handler was delayed by -1.0005664029999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 12:11:06.449849 22549 connection.cc:256] RPC call timeout handler was delayed by -1.0005664029999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 12:11:06.420923 22000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.445s	user 0.008s	sys 0.014s
W20260709 12:11:06.417061 22547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.006s	sys 0.022s
W20260709 12:11:06.451244 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 1.06348e+06us
I20260709 12:11:06.451983 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.452195 25548 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.452673 21847 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:06.411765 22581 raft_consensus.cc:2393] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:06.453649 22547 connection.cc:256] RPC call timeout handler was delayed by -2.009518387000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 12:11:06.423553 22578 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.226401 25552 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:06.454097 22547 connection.cc:256] RPC call timeout handler was delayed by -1.9253719060000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:11:06.425321 22550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.000s	sys 0.030s
I20260709 12:11:06.456157 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:06.456688 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.456861 21844 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:06.457118 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.457441 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.457638 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:06.425926 22577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.011s	sys 0.018s
I20260709 12:11:06.424402 21921 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:06.421211 21999 rpcz_store.cc:276] 0709 12:11:04.597281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.598985 (+  1704us) service_pool.cc:224] Handling call
0709 12:11:04.599404 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.447006 (+847602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.447036 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.447079 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:05.447111 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.229696 (+782585us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b5400222254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:06.229743 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.229850 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948854144}
I20260709 12:11:06.405493 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2358) took 1059 ms. Trace:
I20260709 12:11:06.425904 21993 rpcz_store.cc:276] 0709 12:11:04.601624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.389810 (+1788186us) service_pool.cc:224] Handling call
0709 12:11:06.393524 (+  3714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.393750 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.393788 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.393845 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:06.393897 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.393966 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.394093 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:06.418802 21843 rpcz_store.cc:269] 0709 12:11:04.529253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.529526 (+   273us) service_pool.cc:224] Handling call
0709 12:11:06.224939 (+1695413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.419517 22575 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:06.416548 25663 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:06.363220 21892 connection.cc:256] RPC call timeout handler was delayed by -3.5891491070001393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 12:11:06.427172 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.356889 25474 raft_consensus.cc:697] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:11:06.434702 21995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.006s	sys 0.023s
W20260709 12:11:06.470960 21995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.006s	sys 0.023s
I20260709 12:11:06.471167 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.237174 25655 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.435705 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:06.234858 25295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.008s	sys 0.015s
I20260709 12:11:06.248231 25115 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:06.374069 25461 consensus_meta.cc:287] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.168s	user 0.010s	sys 0.002s
I20260709 12:11:06.441121 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.483264 22576 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:06.488543 25474 consensus_queue.cc:237] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:06.320344 25369 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.491600 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.494738 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.495699 21844 raft_consensus.cc:2393] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:06.227859 25521 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:06.417193 25686 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:06.453758 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:06.524446 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2351) took 1339 ms. Trace:
I20260709 12:11:06.524757 21847 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:06.417135 21967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.012s	sys 0.016s
I20260709 12:11:06.455724 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2342) took 1856 ms. Trace:
I20260709 12:11:06.418853 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:06.461333 22001 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 11. Ops: []
I20260709 12:11:06.417294 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 617) took 2102 ms. Trace:
I20260709 12:11:06.526844 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2349) took 1924 ms. Trace:
I20260709 12:11:06.527334 22001 rpcz_store.cc:276] 0709 12:11:04.601939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.421090 (+1819151us) service_pool.cc:224] Handling call
0709 12:11:06.440304 (+ 19214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.526597 (+ 86293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.526793 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.526616 21997 rpcz_store.cc:276] 0709 12:11:04.314367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.314563 (+   196us) service_pool.cc:224] Handling call
0709 12:11:04.427620 (+113057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.427829 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:04.931840 (+504011us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.416923 (+1485083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.416980 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:06.417027 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.417090 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.417209 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":794310,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":550,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":1836772,"threads_started":2}
I20260709 12:11:06.462538 21996 rpcz_store.cc:276] 0709 12:11:05.346241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.454029 (+107788us) service_pool.cc:224] Handling call
0709 12:11:06.405412 (+951383us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:06.463755 21892 connection.cc:256] RPC call timeout handler was delayed by -3.5009491069999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:11:06.528450 21892 connection.cc:256] RPC call timeout handler was delayed by -3.3407491069999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 12:11:06.528649 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:06.529006 21892 connection.cc:256] RPC call timeout handler was delayed by -3.3173491070001546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 12:11:06.529620 21892 connection.cc:256] RPC call timeout handler was delayed by -3.248949107000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 12:11:06.530010 21892 connection.cc:256] RPC call timeout handler was delayed by -3.2381491070000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 12:11:06.530439 21892 connection.cc:256] RPC call timeout handler was delayed by -3.167049107000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 12:11:06.513460 25664 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.530875 21892 connection.cc:256] RPC call timeout handler was delayed by -2.9879491070000768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 12:11:06.525978 22000 rpcz_store.cc:276] 0709 12:11:04.599685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.611576 (+ 11891us) service_pool.cc:224] Handling call
0709 12:11:04.611920 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.612192 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:04.975887 (+363695us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.455049 (+1479162us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.455393 (+   344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.455438 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:06.455493 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.455554 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.455670 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":627740,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":3830,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":170,"thread_start_us":1837651,"threads_started":2}
W20260709 12:11:06.435029 25486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.003s	sys 0.036s
I20260709 12:11:06.464356 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.464465 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:06.432780 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:06.466593 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:06.466863 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.362807 25637 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:06.535943 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 69423.1us
I20260709 12:11:06.469588 21924 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:06.479606 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:06.499112 22547 connection.cc:256] RPC call timeout handler was delayed by -1.5131922499999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24270000000000003s for a response
I20260709 12:11:06.507521 22583 raft_consensus.cc:2410] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:06.536052 22578 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:11:06.531315 21892 connection.cc:256] RPC call timeout handler was delayed by -2.4668491070001437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2756s for a response
I20260709 12:11:06.416338 25493 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.234210 25600 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.524854 21993 rpcz_store.cc:276] 0709 12:11:05.184962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.472458 (+1287496us) service_pool.cc:224] Handling call
0709 12:11:06.523985 (+ 51527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.524146 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.524167 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.524212 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:06.524240 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.524288 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.524393 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.525139 21847 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:06.534021 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:06.535553 21918 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:06.523458 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 889) took 2151 ms. Trace:
I20260709 12:11:06.536069 21845 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
W20260709 12:11:06.537797 21892 connection.cc:256] RPC call timeout handler was delayed by -2.4407491070001015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2785s for a response
W20260709 12:11:06.551093 21892 connection.cc:256] RPC call timeout handler was delayed by -2.3525491069999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2883s for a response
W20260709 12:11:06.551558 21892 connection.cc:256] RPC call timeout handler was delayed by -2.2481491070000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2999s for a response
W20260709 12:11:06.552089 21892 connection.cc:256] RPC call timeout handler was delayed by -2.2481491070000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2999s for a response
W20260709 12:11:06.552413 21892 connection.cc:256] RPC call timeout handler was delayed by -2.2211491069999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3029s for a response
W20260709 12:11:06.552731 21892 connection.cc:256] RPC call timeout handler was delayed by -1.98084910700004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3296s for a response
I20260709 12:11:06.506623 25115 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.429472 25689 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:06.554143 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.594810 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.595034 22583 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:06.566174 22579 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:06.596627 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.550499 21847 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:06.597878 25701 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:06.598565 21847 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.598676 25701 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.599093 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.600267 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:06.538702 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.538975 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.601127 25701 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.602056 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.603336 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:06.603567 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 190567us
I20260709 12:11:06.603873 21848 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:06.604662 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.605010 25689 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:06.605593 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.540017 21925 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:11:06.608153 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.609578 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:06.541052 21999 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:06.610504 25115 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.610946 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2350) took 2008 ms. Trace:
I20260709 12:11:06.611110 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.611447 21999 rpcz_store.cc:276] 0709 12:11:04.602294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.472349 (+1870055us) service_pool.cc:224] Handling call
0709 12:11:06.523619 (+ 51270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.610600 (+ 86981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.610855 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.612015 21848 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:06.612710 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:06.542945 22549 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:06.549057 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.615743 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.616494 21851 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:11:06.617642 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.535239 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.518043 25461 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.618500 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.618577 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.538403 21992 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:06.619153 22579 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:11:06.619656 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2353) took 1433 ms. Trace:
I20260709 12:11:06.619786 22578 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:06.619290 25521 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.620018 21992 rpcz_store.cc:276] 0709 12:11:05.186470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.482049 (+1295579us) service_pool.cc:224] Handling call
0709 12:11:06.538098 (+ 56049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.619416 (+ 81318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.619611 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.620445 21893 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:06.621165 25548 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:06.589388 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 47837.7us
I20260709 12:11:06.436466 25690 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.621583 25548 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.622005 25548 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.615768 25369 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:06.593672 25614 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.150s	user 0.012s	sys 0.000s
I20260709 12:11:06.623308 25690 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.538564 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.623530 25614 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:06.624066 24866 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:06.624806 21846 raft_consensus.cc:2393] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:06.618708 21844 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:11:06.625772 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:06.625859 25614 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:06.516930 25676 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.597932 21843 raft_consensus.cc:2410] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:06.626731 25676 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.628738 21843 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:06.629024 25676 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:06.629380 21922 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:06.629591 25548 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.621084 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:06.630699 25661 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:06.631227 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:06.631486 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.631878 21992 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:11:06.632109 22576 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:06.491135 25663 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:06.633920 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:06.633734 25663 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:06.634629 21993 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:06.634750 25548 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.635362 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:06.614159 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:06.636278 21993 raft_consensus.cc:2410] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:06.632946 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:06.637280 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:06.637964 21992 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:06.638684 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:06.640547 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 97675.6us
I20260709 12:11:06.642025 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:06.640610 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:06.639061 22583 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:06.514164 25472 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.541690 25486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.003s	sys 0.036s
W20260709 12:11:06.671701 25502 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.031s	sys 0.018s
I20260709 12:11:06.659137 25709 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.632951 25600 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.653329 25659 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:06.676795 25472 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:06.745491 25461 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.676806 25676 consensus_queue.cc:1059] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:11:06.661629 25637 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
W20260709 12:11:06.723217 25502 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.031s	sys 0.018s
I20260709 12:11:06.534577 25664 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.739773 25709 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:06.751394 25659 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:11:06.753197 25617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.008s	sys 0.057s
I20260709 12:11:06.750316 25115 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:06.756624 25675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.013s	sys 0.031s
I20260709 12:11:06.772742 25659 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:06.789356 25617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.057s
I20260709 12:11:06.767169 25709 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:06.792225 25675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.013s	sys 0.031s
I20260709 12:11:06.818775 25472 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:06.819613 25664 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:06.821146 25115 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:06.839484 25659 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.842242 25659 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:06.841943 25493 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.844460 25493 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:06.845711 25709 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:06.848337 25709 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:06.885185 25670 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.885742 25670 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:06.886626 25670 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:06.887735 25670 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:06.981582 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 336681us
I20260709 12:11:06.997459 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:06.590261 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:07.000051 22001 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:07.000777 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:07.001264 22001 raft_consensus.cc:2368] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11.
I20260709 12:11:07.002131 22001 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:07.002642 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2354) took 1815 ms. Trace:
I20260709 12:11:07.002955 22001 rpcz_store.cc:276] 0709 12:11:05.187074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.001688 (+1814614us) service_pool.cc:224] Handling call
0709 12:11:07.001955 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.002487 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.002607 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.004208 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2355) took 1767 ms. Trace:
I20260709 12:11:07.004530 22001 rpcz_store.cc:276] 0709 12:11:05.237186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.003521 (+1766335us) service_pool.cc:224] Handling call
0709 12:11:07.003763 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.003913 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.003940 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.003981 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:07.004017 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.004066 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.004161 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.006389 25673 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:07.006584 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 453361us
I20260709 12:11:07.007896 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.008141 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2360) took 1616 ms. Trace:
I20260709 12:11:07.008575 22001 rpcz_store.cc:276] 0709 12:11:05.391590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.005406 (+1613816us) service_pool.cc:224] Handling call
0709 12:11:07.007054 (+  1648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.007523 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.007558 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.007809 (+   251us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:07.007857 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.007938 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.008064 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.009104 25673 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.011371 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.012300 25673 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.012687 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.013506 25548 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.013775 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.014669 25548 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:07.015158 25548 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:07.016106 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.016008 25548 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.017215 25502 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.017637 25502 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:07.018304 25502 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.019865 25673 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.022250 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.023144 25502 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:07.024487 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:07.025375 25502 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.025763 21999 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:07.026732 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.027603 25502 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.028877 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.029877 25502 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:07.031275 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.032307 25502 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.034017 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:07.034806 25502 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.036787 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.037205 21997 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:07.037569 21926 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:07.039295 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.041184 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.041894 21926 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:07.043511 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.044126 21926 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:07.045338 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.046657 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.048607 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:07.050858 25502 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:07.051460 25502 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.053668 25502 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.054773 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:07.056250 25502 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.056661 25502 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:07.057107 25502 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.057737 21998 raft_consensus.cc:2393] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:07.059505 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.060527 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:07.061344 21849 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:07.062382 21849 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.074470 25502 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.076795 25502 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:07.078755 21815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.002s	sys 0.007s
W20260709 12:11:07.079090 21815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.002s	sys 0.007s
I20260709 12:11:07.079624 25522 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.079738 25670 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.080113 25522 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.080293 25670 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.082086 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.082365 25670 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.082918 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 576) took 1182 ms. Trace:
I20260709 12:11:07.083159 21850 rpcz_store.cc:276] 0709 12:11:05.900705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.900967 (+   262us) service_pool.cc:224] Handling call
0709 12:11:07.081938 (+1180971us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:11:07.082863 (+   925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76408576}
W20260709 12:11:07.077409 22584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.006s	sys 0.003s
W20260709 12:11:07.084131 22584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.006s	sys 0.003s
I20260709 12:11:07.079918 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:07.082187 25522 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.086172 25670 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.086762 25670 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:07.086823 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:07.087260 25670 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.092077 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:07.092926 25265 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.093412 25721 consensus_queue.cc:1059] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:07.094384 25265 raft_consensus.cc:3055] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:07.094854 25265 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.094954 25721 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:07.096221 25617 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:07.095934 25265 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.096706 25617 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.097219 25265 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.097537 25617 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.099896 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:07.100682 21992 raft_consensus.cc:2393] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:07.100893 25670 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.103042 25670 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.103464 22000 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5.
I20260709 12:11:07.104884 21999 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:07.104234 25617 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.118952 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.119802 25265 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.120694 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.120895 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:07.121467 21993 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:06.550904 22577 rpcz_store.cc:276] 0709 12:11:04.347270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.347422 (+   152us) service_pool.cc:224] Handling call
0709 12:11:04.526425 (+179003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.526711 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:05.388055 (+861344us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.498534 (+1110479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.498604 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:06.498765 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.498852 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.498993 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40208,"prepare.queue_time_us":694823,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":59153,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5494,"thread_start_us":1872330,"threads_started":2}
I20260709 12:11:07.123191 25115 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:07.124629 25115 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.124987 25115 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.125385 25115 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.129546 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:07.120225 25265 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:07.134322 25670 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.132776 25265 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:07.135087 21994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.255s	user 0.005s	sys 0.044s
W20260709 12:11:07.137045 21994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.005s	sys 0.044s
I20260709 12:11:07.137813 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 616) took 2823 ms. Trace:
I20260709 12:11:07.138294 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2347) took 2537 ms. Trace:
I20260709 12:11:07.138604 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.139771 21995 rpcz_store.cc:276] 0709 12:11:04.601313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.223528 (+622215us) service_pool.cc:224] Handling call
0709 12:11:05.329800 (+106272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.330031 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.330055 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.330560 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:11:06.471421 (+1140861us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:06.471475 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.471564 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.138067 (+666503us) raft_consensus.cc:1685] finished
0709 12:11:07.138099 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.138225 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1052266,"threads_started":1,"wal-append.queue_time_us":1257840}
I20260709 12:11:07.138121 21994 rpcz_store.cc:276] 0709 12:11:04.314061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.317239 (+  3178us) service_pool.cc:224] Handling call
0709 12:11:04.404608 (+ 87369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.444152 (+1039544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.444187 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.540642 (+ 96455us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.137457 (+1596815us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:07.137509 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.137582 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.137624 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:07.137635 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.137758 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147678,"raft.queue_time_us":401695,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":52214,"thread_start_us":2148172,"threads_started":2,"wal-append.queue_time_us":988623}
I20260709 12:11:07.142539 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.152261 21893 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.153146 25502 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.153621 25502 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.153976 25502 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.157531 25265 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:07.160071 21919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.007s	sys 0.012s
I20260709 12:11:07.159922 25115 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:07.160485 21919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.008s	sys 0.012s
I20260709 12:11:07.161187 25502 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.166030 25502 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:07.170585 25115 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.173403 25265 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.175608 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.153254 21893 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.177697 25115 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:07.178617 22582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.010s	sys 0.005s
W20260709 12:11:07.178978 22582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.010s	sys 0.005s
I20260709 12:11:07.180907 25502 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.181469 25502 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:07.181949 25502 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.178941 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.185284 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.185866 25617 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:07.187825 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 544284us
I20260709 12:11:07.178818 25115 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.188410 25115 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.189323 22547 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:07.190668 25700 consensus_queue.cc:1059] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:07.191135 25502 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.196401 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.198221 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:07.202387 22575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.003s	sys 0.003s
W20260709 12:11:07.203707 22575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.004s	sys 0.003s
W20260709 12:11:07.204823 21923 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.007s	sys 0.000s
W20260709 12:11:07.205175 21923 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.007s	sys 0.000s
I20260709 12:11:07.206193 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2234) took 3277 ms. Trace:
I20260709 12:11:07.206593 21923 rpcz_store.cc:276] 0709 12:11:03.928837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.929728 (+   891us) service_pool.cc:224] Handling call
0709 12:11:03.951892 (+ 22164us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:05.233636 (+1281744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.233740 (+   104us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:05.266405 (+ 32665us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.421622 (+1155217us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:07.205645 (+784023us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.205863 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.205937 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.205987 (+    50us) raft_consensus.cc:1685] finished
0709 12:11:07.206003 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.206138 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":395726,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":50196,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7168,"spinlock_wait_cycles":22272,"thread_start_us":3155619,"threads_started":3,"wal-append.queue_time_us":1287098}
I20260709 12:11:07.210474 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2036) took 4029 ms. Trace:
I20260709 12:11:07.210907 21927 rpcz_store.cc:276] 0709 12:11:03.181577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.360898 (+179321us) service_pool.cc:224] Handling call
0709 12:11:03.388069 (+ 27171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.912585 (+524516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.912618 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.919650 (+  7032us) log.cc:844] Serialized 26 byte log entry
0709 12:11:04.260467 (+340817us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:04.260526 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.260617 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.210215 (+2949598us) raft_consensus.cc:1685] finished
0709 12:11:07.210238 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.210393 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17678,"raft.queue_time_us":536381,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":4575,"thread_start_us":310164,"threads_started":1,"wal-append.queue_time_us":1502763}
W20260709 12:11:07.213562 21817 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.006s	sys 0.001s
W20260709 12:11:07.213917 21817 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.006s	sys 0.001s
W20260709 12:11:07.214156 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 950482us
I20260709 12:11:07.227329 22577 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.230052 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:07.231009 22580 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:07.232410 22584 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:07.232817 22584 pending_rounds.cc:85] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 7
I20260709 12:11:07.233162 22584 pending_rounds.cc:107] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:07.233399 22584 raft_consensus.cc:2889] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.232697 25721 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:07.238442 22577 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:07.239109 22577 pending_rounds.cc:85] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 7
I20260709 12:11:07.239451 22577 pending_rounds.cc:107] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.8
I20260709 12:11:07.239832 22577 raft_consensus.cc:2917] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Aborting config change with OpId 8.8: Aborted: Op aborted by new leader
W20260709 12:11:07.251981 21848 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.001s	sys 0.009s
I20260709 12:11:07.240325 22577 raft_consensus.cc:2889] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:07.254693 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56559.6us
I20260709 12:11:07.251690 25721 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.262941 25721 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.276410 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:07.285928 21852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 566) took 2430 ms (client timeout 2135 ms). Trace:
W20260709 12:11:07.292132 21852 rpcz_store.cc:269] 0709 12:11:04.855814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.261560 (+405746us) service_pool.cc:224] Handling call
0709 12:11:07.285606 (+2024046us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400292054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:07.285815 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421790080}
W20260709 12:11:07.305361 22581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.001s	sys 0.005s
W20260709 12:11:07.305773 22581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.002s	sys 0.006s
W20260709 12:11:07.332252 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 45806.8us
I20260709 12:11:07.316322 25721 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.448431 21923 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:07.448796 25749 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:07.449154 25745 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.450277 25749 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.450727 21923 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:07.450845 25749 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.450685 25748 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:07.452275 25748 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.452620 25748 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:07.453733 25749 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.459810 25617 raft_consensus.cc:697] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.460155 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.460747 25617 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.461328 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.462486 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.460788 21924 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:07.464001 21923 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:07.466332 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.467128 21923 raft_consensus.cc:2393] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 11: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:07.468912 21817 leader_election.cc:336] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.502s (SENT)
I20260709 12:11:07.470813 25486 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.460743 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.471454 25486 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:07.471643 21927 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:07.471928 25486 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.461055 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.472775 21920 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:11:07.475174 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 492668us
I20260709 12:11:07.475803 25659 consensus_queue.cc:1059] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:07.470878 25732 raft_consensus.cc:3055] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:07.476821 25659 consensus_queue.cc:1059] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:07.477088 25732 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:07.477648 25659 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:07.478040 25732 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.479468 25732 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.480046 25659 raft_consensus.cc:3055] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:07.480430 25659 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:07.481182 25659 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.483523 25659 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.461107 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.486354 21918 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.487807 25748 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.491467 22549 leader_election.cc:400] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:11:07.491945 22549 leader_election.cc:403] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:07.494184 21920 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
W20260709 12:11:07.495478 21847 consensus_meta.cc:287] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.896s	user 0.008s	sys 0.004s
I20260709 12:11:07.496078 21847 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
W20260709 12:11:07.496438 25698 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.806s	user 0.002s	sys 0.002s
W20260709 12:11:07.500643 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.500634 21918 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:07.501665 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 2016) took 1050 ms. Trace:
I20260709 12:11:07.504825 21847 rpcz_store.cc:276] 0709 12:11:06.451567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.453500 (+  1933us) service_pool.cc:224] Handling call
0709 12:11:07.501598 (+1048098us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:07.505975 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.507294 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.509181 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.511745 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.513622 21848 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:07.497267 25745 raft_consensus.cc:697] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.513562 25721 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:07.515062 25745 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:07.515549 21998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2341) took 2916 ms (client timeout 2089 ms). Trace:
W20260709 12:11:07.515956 21998 rpcz_store.cc:269] 0709 12:11:04.599299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.606166 (+  6867us) service_pool.cc:224] Handling call
0709 12:11:07.515355 (+2909189us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54001f04d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:07.515482 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5625754880}
I20260709 12:11:07.517910 25486 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.519398 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.512511 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.520464 25548 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.520771 21818 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:07.521214 25486 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.521674 25617 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:07.521932 21818 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:07.522432 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.523021 21920 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
W20260709 12:11:07.523146 21844 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.006s	sys 0.003s
W20260709 12:11:07.523681 21844 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.006s	sys 0.003s
I20260709 12:11:07.526566 21918 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:11:07.527693 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 923402us
I20260709 12:11:07.543294 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.545068 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.545629 21927 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.530027 25751 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.531040 21818 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:07.532173 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1720) took 1013 ms. Trace:
I20260709 12:11:07.548770 22001 rpcz_store.cc:276] 0709 12:11:06.518900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.010243 (+491343us) service_pool.cc:224] Handling call
0709 12:11:07.010552 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.531705 (+521153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.531745 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.531801 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:07.531851 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.531931 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.532075 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":520688}
I20260709 12:11:07.549429 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.535076 25748 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:07.535243 25461 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.538574 21967 connection.cc:256] RPC call timeout handler was delayed by -1.9678032659999189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:11:07.558132 21967 connection.cc:256] RPC call timeout handler was delayed by -1.8841032659997836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 12:11:07.558694 21967 connection.cc:256] RPC call timeout handler was delayed by -1.7869032659998538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 12:11:07.559079 21967 connection.cc:256] RPC call timeout handler was delayed by -1.7158032659999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 12:11:07.559429 21967 connection.cc:256] RPC call timeout handler was delayed by -1.6411032659998455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 12:11:07.559789 21967 connection.cc:256] RPC call timeout handler was delayed by -1.558303265999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 12:11:07.560269 21967 connection.cc:256] RPC call timeout handler was delayed by -1.5430032659999142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 12:11:07.539214 25749 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:07.539386 25670 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:07.536092 21966 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:07.546502 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.561548 21923 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.549969 21919 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.551842 21918 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:07.555841 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.562250 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.562950 21924 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:07.567128 21920 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:11:07.569375 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.570003 21924 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:07.573210 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.574282 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.574942 21922 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:11:07.578401 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2015) took 1127 ms. Trace:
I20260709 12:11:07.580312 21844 rpcz_store.cc:276] 0709 12:11:06.450933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.634823 (+183890us) service_pool.cc:224] Handling call
0709 12:11:06.635076 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.635264 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:07.524068 (+888804us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.578041 (+ 53973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.578093 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:07.578145 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.578216 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.578341 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181568,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"thread_start_us":942144,"threads_started":2}
I20260709 12:11:07.565657 25745 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:07.583107 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.583321 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.583797 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.584517 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.586517 21926 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:11:07.587508 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.588120 21921 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
W20260709 12:11:07.591883 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.578801 25522 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.586099 21925 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 6: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:07.597043 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 55440.2us
I20260709 12:11:07.597901 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.565116 25461 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.600375 25461 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:07.601424 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.602244 21921 raft_consensus.cc:2410] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:07.603452 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.603333 25757 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:11:07.604163 21920 raft_consensus.cc:2393] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:07.606745 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.607304 21925 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.598474 21927 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:07.614197 21925 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:07.621083 21923 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:07.622480 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.623314 21921 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
W20260709 12:11:07.634029 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 103044us
I20260709 12:11:07.635332 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.611261 25670 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.614286 25474 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.642706 25670 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.642756 25474 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.643988 25670 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.645687 25474 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:07.622462 25617 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.646338 25617 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.646698 25617 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.640851 25757 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:07.640280 25115 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.657619 25115 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.663281 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.667488 21919 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:07.670711 25757 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.671231 25757 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.672963 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.672444 21818 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:07.675751 25628 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.676208 25628 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.676541 25628 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.676574 25759 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.677273 25759 raft_consensus.cc:697] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.678159 25759 consensus_queue.cc:237] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.679085 25709 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:07.679505 25709 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:07.679984 25661 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.680368 25661 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:07.680262 25709 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.681541 25709 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.675521 25758 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:07.681277 25661 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.683816 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.671612 25757 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.690774 21927 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:07.686705 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:07.693444 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:07.694451 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.695380 21920 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.698940 21924 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.699460 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.700176 21921 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.700887 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.683748 25745 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.701445 21923 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:07.702303 25758 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.693974 25463 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:07.704978 25463 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.705329 25463 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:07.704629 25758 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.716060 21920 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:07.719062 21921 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:07.728341 21923 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:07.734745 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:07.687054 25751 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:07.740744 21892 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.711373 25745 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.743170 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.745097 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.735656 25661 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.741485 25115 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.745846 25548 raft_consensus.cc:2764] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:07.742246 25673 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.744454 25721 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:11:07.749960 25115 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:07.781816 25748 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:07.782286 25748 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.783919 25748 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.794836 25548 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:07.795487 25548 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.798101 25745 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.778594 25115 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:07.815924 25663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.008s	sys 0.004s
W20260709 12:11:07.816358 25663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.008s	sys 0.005s
I20260709 12:11:07.832489 25115 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.836956 25115 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:07.841076 25463 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.843235 25463 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.844722 25617 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:07.847138 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.834750 25548 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.850697 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.852952 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:07.866001 21846 raft_consensus.cc:2393] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:07.850625 21847 pending_rounds.cc:85] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 3
I20260709 12:11:07.866925 21847 pending_rounds.cc:107] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:07.861318 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.861332 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.862314 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.862618 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.868109 21926 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:07.868453 21852 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:07.863226 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:07.868858 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1723) took 1349 ms. Trace:
I20260709 12:11:07.864068 21849 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:07.869230 21996 rpcz_store.cc:276] 0709 12:11:06.519693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.558226 (+ 38533us) service_pool.cc:224] Handling call
0709 12:11:07.868693 (+1310467us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002c6854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:07.868807 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2794015488}
I20260709 12:11:07.853569 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:07.870507 21850 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 6: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:07.853217 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.875325 21847 raft_consensus.cc:2889] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.860193 25712 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.876622 21847 pending_rounds.cc:107] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:07.879456 25552 raft_consensus.cc:3055] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.879884 25552 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:07.880741 25552 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.882087 25552 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.883616 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:07.883908 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:07.884534 22577 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.884760 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:07.884925 22584 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:07.885324 22580 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.886626 25502 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:07.887019 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 682182us
I20260709 12:11:07.887310 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 893) took 1421 ms. Trace:
I20260709 12:11:07.888226 25740 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.887646 22575 rpcz_store.cc:276] 0709 12:11:06.465960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.466750 (+   790us) service_pool.cc:224] Handling call
0709 12:11:06.467005 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.467198 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:06.525126 (+ 57928us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.886968 (+1361842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.887022 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:07.887073 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.887145 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.887256 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":682826,"prepare.queue_time_us":50011,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":5400,"thread_start_us":678614,"threads_started":1,"wal-append.queue_time_us":290250,"wal-append.run_cpu_time_us":1084,"wal-append.run_wall_time_us":1002312}
I20260709 12:11:07.888769 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:07.889927 22547 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:07.890807 21847 raft_consensus.cc:2889] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.891964 22577 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
W20260709 12:11:07.893038 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 414755us
I20260709 12:11:07.896353 21926 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
W20260709 12:11:07.899288 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.891438 25540 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.899575 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.899852 25659 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:11:07.900532 25676 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:07.900821 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:07.901665 25753 raft_consensus.cc:3055] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.901922 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.902719 21852 raft_consensus.cc:2368] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:07.903378 25763 consensus_queue.cc:1059] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:07.905073 25763 raft_consensus.cc:3055] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.905422 25763 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.897599 21850 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.896409 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.907508 25617 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.907663 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.908094 25617 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.908476 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.909951 25670 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:07.910118 25628 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.910969 25759 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:07.911413 25759 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.912355 25628 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:07.912213 25759 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.898739 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:07.914966 21843 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:07.908546 25617 raft_consensus.cc:697] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:07.915321 25757 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:07.916213 25617 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.917454 25757 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.918701 21851 raft_consensus.cc:2368] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
I20260709 12:11:07.888691 25740 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.919973 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 819) took 1689 ms. Trace:
I20260709 12:11:07.898672 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:07.921526 22577 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.902036 25753 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:07.920358 22582 rpcz_store.cc:276] 0709 12:11:06.230555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.230674 (+   119us) service_pool.cc:224] Handling call
0709 12:11:06.230928 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.179357 (+948429us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:07.197076 (+ 17719us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.892390 (+695314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.892437 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:07.892489 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.919773 (+ 27284us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540057c6d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:07.919817 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.919920 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":671953,"prepare.queue_time_us":17897,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":675925,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"spinlock_wait_cycles":407025408,"thread_start_us":811292,"threads_started":3,"wal-append.queue_time_us":7660}
I20260709 12:11:07.923291 21893 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.906226 25763 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.931316 22547 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.934445 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.941020 21924 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:07.942700 25713 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:07.943252 25713 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:07.943455 25753 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.944097 25713 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:07.921424 25463 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:07.934656 25548 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:07.956225 22577 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:07.957579 21893 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.921224 25740 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:07.962738 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:07.965200 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.966308 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:07.967276 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.969944 21925 raft_consensus.cc:1240] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 12:11:07.962749 25548 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:07.970834 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.976593 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.980298 22580 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
W20260709 12:11:07.981045 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 87331.3us
I20260709 12:11:07.981832 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:07.981091 21892 leader_election.cc:400] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:07.982475 21892 leader_election.cc:403] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:07.983170 21893 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:07.939445 25664 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.972368 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:07.991851 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:07.993188 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.994081 21923 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:07.995195 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.996148 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:07.996869 21924 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:07.962327 25732 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:08.020357 25732 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.020669 25745 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:08.022652 25732 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:07.975915 25548 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:07.991083 25740 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:08.038375 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:08.109007 22578 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.040859 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:08.035861 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 54065.2us
I20260709 12:11:08.109091 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:08.109854 22577 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:07.989864 25763 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.984272 25720 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:08.046921 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 58108.7us
I20260709 12:11:08.120230 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:07.975818 25712 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 12:11:07.990981 25770 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:08.015784 25463 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:07.989363 25502 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:07.998775 25636 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:08.103581 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:08.128867 22576 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.109912 25740 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.039098 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:08.110023 22549 leader_election.cc:400] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:11:08.133308 22549 leader_election.cc:403] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:08.133823 22581 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:08.110255 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:08.117138 22578 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:08.134903 22579 raft_consensus.cc:2393] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:08.111212 22583 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:08.055289 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 145746us
I20260709 12:11:08.135183 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:08.123962 25463 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:08.122509 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 139432us
I20260709 12:11:08.138270 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:08.138985 21923 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.103119 25742 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.139631 25742 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.140897 25748 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:08.141923 25742 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:08.047071 25617 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:11:08.142807 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:08.095783 25670 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:08.143365 21922 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.144032 25670 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.145730 25768 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:08.146111 25768 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:08.129048 25780 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.047170 25772 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.103119 25732 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:08.147708 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:08.148310 22578 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.149151 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:08.149765 22583 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
W20260709 12:11:08.104146 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 59156.9us
I20260709 12:11:08.149525 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:07.990126 25664 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:08.156935 22576 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:08.159513 22575 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:11:08.164152 22578 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:08.165131 25636 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:08.167479 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47339.2us
I20260709 12:11:08.167630 21924 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:08.167786 21923 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:08.134188 25740 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.170893 21922 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:08.172760 21892 leader_election.cc:400] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
I20260709 12:11:08.175093 21892 leader_election.cc:403] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:08.137706 25463 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.178371 22577 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:08.137285 25700 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:11:08.160172 25742 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:08.183715 21818 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:08.157665 25502 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.160529 25664 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.188560 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:08.146874 25780 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:08.192085 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:08.210662 21925 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:11:08.194785 22605 debug-util.cc:398] Leaking SignalData structure 0x7b0800296580 after lost signal to thread 20708
W20260709 12:11:08.216576 22605 debug-util.cc:398] Leaking SignalData structure 0x7b0800054880 after lost signal to thread 21784
I20260709 12:11:08.166635 25732 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:08.221474 22605 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8fc0 after lost signal to thread 21876
I20260709 12:11:08.147228 25770 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:11:08.227597 22605 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc7c0 after lost signal to thread 21951
W20260709 12:11:08.228579 22605 debug-util.cc:398] Leaking SignalData structure 0x7b0800370920 after lost signal to thread 21952
W20260709 12:11:08.230341 22605 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5680 after lost signal to thread 22025
W20260709 12:11:08.232188 22605 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3a80 after lost signal to thread 22026
W20260709 12:11:08.237119 22605 debug-util.cc:398] Leaking SignalData structure 0x7b0800295dc0 after lost signal to thread 22608
W20260709 12:11:08.238358 22605 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb380 after lost signal to thread 22609
W20260709 12:11:08.239878 22605 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce140 after lost signal to thread 25520
I20260709 12:11:08.212824 25779 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
I20260709 12:11:08.219656 25636 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.168669 25548 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:08.253619 25777 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:11:08.254323 25732 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:08.254595 25540 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:08.255111 25540 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.256675 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:08.257450 21919 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:08.146884 25768 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.258846 22547 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:08.270746 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 83543.8us
I20260709 12:11:08.271697 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:08.282058 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 98466us
I20260709 12:11:08.259306 25636 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:08.289907 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:08.268796 25732 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.273023 25745 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.295516 22583 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:08.303249 22576 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:08.282382 25757 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:08.289670 25636 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:08.308183 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.313980 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.295838 25732 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:08.285010 25751 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:11:08.316843 25776 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.150s	user 0.001s	sys 0.001s
I20260709 12:11:08.315933 25757 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:08.317819 25732 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:08.330843 25781 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:11:08.334050 25676 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:08.335695 25676 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.325053 25721 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.337550 25721 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:08.338665 25721 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.342983 25757 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:08.325762 25778 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 12:11:08.378424 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 102997us
W20260709 12:11:08.329658 25782 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 12:11:08.381503 25785 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:08.381912 25676 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:08.327636 25745 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:08.387802 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:08.388782 21918 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:08.321604 25758 consensus_queue.cc:1059] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 12:11:08.395067 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.304692 25780 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:08.402431 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.403263 21924 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:08.427107 25502 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:08.404170 25783 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:08.407994 25773 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:08.410570 25758 raft_consensus.cc:3055] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:08.427513 25502 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:08.436138 25783 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:08.417495 25636 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.419423 22547 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:08.445430 25676 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.446915 22581 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:08.446656 25502 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.447944 25502 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.448115 25783 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.449505 25783 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.426806 25732 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:08.450675 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.450732 25636 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:08.446909 25664 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.453651 22584 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:11:08.454329 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.455217 21848 raft_consensus.cc:2410] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:11:08.419543 25540 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.423249 25463 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.425673 25796 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.434608 21893 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:08.413482 25791 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:08.437609 25758 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:08.452075 25732 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:08.484069 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:08.484865 21926 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.486024 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:08.486742 21924 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.489670 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:08.498219 22583 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:08.472431 25712 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.503829 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:08.504606 21848 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:08.505156 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:08.506904 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:08.507705 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:08.518863 21926 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:08.520151 22547 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:08.521270 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:08.521718 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:08.521275 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:08.523686 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:08.471385 25740 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.524969 21845 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
W20260709 12:11:08.528267 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.487123 25265 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:08.503961 25712 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.514557 25748 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.473395 25796 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.497792 25786 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:08.536243 22580 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:08.526155 25732 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.551451 25732 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:08.554348 25732 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.561342 21924 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:08.563071 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:08.566051 25789 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:11:08.566151 22605 debug-util.cc:398] Leaking SignalData structure 0x7b0800351c60 after lost signal to thread 25682
I20260709 12:11:08.536366 25712 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.570744 22575 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:11:08.573262 21964 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:08.574539 21967 connection.cc:256] RPC call timeout handler was delayed by -1.3882032659998913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 12:11:08.547264 25664 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:08.508013 25745 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.569967 25636 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.550071 25774 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:08.551124 25748 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.577873 25447 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.607427 25447 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.606485 25493 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.609330 25520 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:08.609910 25447 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:08.531864 25758 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.610755 25463 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:08.578053 25686 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:08.611490 25686 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.613466 25686 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:08.582496 25474 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:08.614159 25474 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.616315 25474 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:08.602362 25295 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.580369 25792 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:08.609901 25520 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.620710 25520 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:08.634910 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:08.635557 22581 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.617885 25295 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:08.636869 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 59290.9us
I20260709 12:11:08.634852 25636 raft_consensus.cc:697] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:11:08.638918 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 63803.6us
I20260709 12:11:08.663847 25796 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:08.640872 25689 consensus_queue.cc:1059] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:11:08.672910 25753 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.673599 25636 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:08.678561 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 1.14246e+06us
I20260709 12:11:08.680202 25740 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:08.691310 25673 consensus_queue.cc:1059] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:08.692287 25673 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:08.692611 25673 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:08.693504 25673 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.697288 25742 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:08.697814 25742 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.115541 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:08.700425 22549 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:08.702224 25295 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:08.703037 25661 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:08.705408 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 54277us
I20260709 12:11:08.666043 25748 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:08.706421 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 66279.3us
I20260709 12:11:08.712179 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:08.716810 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.724082 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:08.744336 21967 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:08.724721 21923 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:08.744585 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:08.724781 21918 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:08.706069 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:08.746620 21922 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:08.746656 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:08.748193 21921 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:08.749467 22581 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:08.750778 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:08.753048 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:08.753885 25748 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:08.754685 25748 raft_consensus.cc:697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:08.756996 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:08.757826 21919 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:08.763828 25115 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:08.766155 21924 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:11:08.769706 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56769.5us
W20260709 12:11:08.770057 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 90503.7us
I20260709 12:11:08.742754 25673 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.770788 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:08.759654 25784 log.cc:927] Time spent T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.444s	user 0.005s	sys 0.002s
W20260709 12:11:08.759476 25809 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.088s	user 0.000s	sys 0.002s
W20260709 12:11:08.756021 25804 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.249s	user 0.000s	sys 0.003s
W20260709 12:11:08.773078 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.759795 25785 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
W20260709 12:11:08.763677 25808 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.067s	user 0.000s	sys 0.004s
I20260709 12:11:08.768317 25712 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:08.801076 21966 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:08.777287 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 53282.1us
I20260709 12:11:08.804077 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:08.763326 25522 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:08.783913 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 77922.8us
I20260709 12:11:08.808780 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:08.756167 25775 log.cc:927] Time spent T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.549s	user 0.004s	sys 0.005s
I20260709 12:11:08.783646 21967 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:08.790701 25115 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:08.763218 25265 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.802286 21815 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:08.755766 25748 consensus_queue.cc:237] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.827701 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:08.828426 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:08.829157 25115 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:08.829551 25115 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.829877 25115 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:08.833225 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.800307 25682 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.809073 25686 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.856668 21966 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:08.805936 25663 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:08.859539 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 76025.6us
I20260709 12:11:08.811234 25732 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.771669 25811 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:11:08.857064 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:08.832360 25689 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.784098 25520 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:11:08.823431 25742 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:08.874775 25798 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.875349 25798 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.877653 25798 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:08.878657 25812 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.879241 25812 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:08.880086 25812 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:08.864213 25732 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:08.881548 25732 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.806284 25721 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:11:08.809480 25461 consensus_queue.cc:1059] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:11:08.823917 25522 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:08.834087 25670 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.899235 25115 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:08.919693 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.830837 25692 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:08.923507 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.924893 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.859756 25686 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.867511 25521 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.861601 25295 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:08.862185 25265 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:08.863209 25663 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:08.951431 25115 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:08.949546 25447 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.926381 25670 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.861953 25787 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
W20260709 12:11:08.999676 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 142692us
W20260709 12:11:08.999960 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 139796us
I20260709 12:11:09.000470 21964 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:09.001742 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:08.950349 25686 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:09.005685 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 216256us
I20260709 12:11:08.979594 25664 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:09.011756 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:09.014396 21921 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:09.014492 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:08.979051 25663 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.999207 25670 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.017038 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:09.020993 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 160704us
I20260709 12:11:09.022001 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.012291 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.015105 21918 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.031740 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.032430 21998 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:11:09.033656 21967 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.010805 25472 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.036448 22584 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:09.035574 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:09.047223 21967 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.048004 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.048667 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.049569 21999 raft_consensus.cc:2410] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:09.048715 22001 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:11:09.015908 25520 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.055404 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.064560 22582 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:09.065507 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.066191 21998 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:09.034749 25461 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.036192 25721 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.047684 25472 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.073469 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.074218 22001 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:09.074087 25825 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:09.074477 25472 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:09.075412 25821 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:09.075208 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:09.103636 21998 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.107826 21845 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:09.101298 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:09.108832 21848 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.071939 25721 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:09.075829 25800 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.568s	user 0.004s	sys 0.000s
W20260709 12:11:09.096262 25814 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:11:09.135329 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:09.135983 22001 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.136711 21921 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:09.034178 25522 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.091554 25768 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.126670 21918 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:09.079653 25692 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.089891 25661 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.088593 25712 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:09.111364 25682 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.143149 25843 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:09.079487 25827 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.098971 25732 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.096068 25825 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:09.147524 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:09.095078 25826 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.181672 21926 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:09.053855 25265 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.156414 21918 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:09.124284 25721 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.168421 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:09.158797 25692 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.173369 21815 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:09.178282 21998 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
W20260709 12:11:09.169026 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 121880us
I20260709 12:11:09.189795 21967 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:09.192412 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.195400 21967 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.171676 25751 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:09.199762 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:09.201666 22578 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:09.200706 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 165194us
I20260709 12:11:09.205878 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.207713 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.175945 25676 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:11:09.197263 25798 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:09.195266 25783 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:09.215924 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.193796 25692 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.172581 25661 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.208328 21999 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:09.208568 25751 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.207301 25812 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.202584 25826 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:09.205641 25636 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:11:09.224860 25783 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.179459 25843 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.200153 25682 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:11:09.264597 21892 leader_election.cc:336] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.669s (SENT)
I20260709 12:11:09.267208 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.242875 21967 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.225939 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:09.241155 22578 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:09.273336 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:09.275707 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.276381 21999 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:09.276495 21926 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:09.246915 22001 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:09.258715 21848 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:09.263427 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.279476 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.282173 22000 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
W20260709 12:11:09.283771 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 57912us
I20260709 12:11:09.228655 25836 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.233299 25770 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:09.226226 25742 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.272315 25827 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:09.225375 25798 raft_consensus.cc:697] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:09.289968 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.292999 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.295290 21993 raft_consensus.cc:2410] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:11:09.292412 21892 leader_election.cc:336] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.755s (SENT)
I20260709 12:11:09.297196 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.298563 25832 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.300881 21892 leader_election.cc:336] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.857s (SENT)
I20260709 12:11:09.286672 25520 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.290769 25835 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:09.288357 25617 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.310824 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:09.313063 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.289353 25812 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.289826 25841 raft_consensus.cc:2764] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:09.289178 25770 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:09.320003 22000 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:09.321341 25812 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.322038 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:09.322216 25686 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:09.304832 25842 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:11:09.300571 25461 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.333765 25770 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.299260 25757 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:09.338255 22578 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:09.308220 25783 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:09.311772 25521 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:09.346922 25844 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:11:09.305819 25732 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:09.348722 21994 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.358232 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:09.305819 25661 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:09.316817 25520 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:09.295955 25742 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.303433 25837 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.332713 25812 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.372488 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.299142 25832 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.368052 25770 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.386197 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:09.391358 25849 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:11:09.231333 25825 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.369217 25520 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.400251 22000 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.435626 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.309880 25798 consensus_queue.cc:237] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.331118 25617 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.445065 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.445611 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:09.446971 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.306834 25826 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.462977 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.460610 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.471511 21850 raft_consensus.cc:1813] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Handling vote request from an unknown peer 73070a828b23480e9c3588e376bce2ab
W20260709 12:11:09.472047 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.460588 22577 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:09.460819 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:09.475971 22578 raft_consensus.cc:1813] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Handling vote request from an unknown peer 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:09.476722 22578 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:09.461701 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.478397 21850 raft_consensus.cc:2410] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:09.462044 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.462199 22000 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:09.478922 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.480105 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.482513 22549 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:09.482622 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.484020 21844 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:09.488718 22578 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.482372 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.490864 25661 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.491321 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.492226 25692 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.493422 22001 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:09.499743 21844 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.501250 25732 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.501674 25732 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:09.501827 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:09.502077 25732 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.502992 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.503772 25676 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.504055 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:09.505000 25636 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.505663 25636 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.505987 25636 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:09.506342 25636 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.510798 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.510960 25661 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.511492 25661 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:09.512197 21847 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:09.512310 25661 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.480747 21992 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:09.513114 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:09.514765 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.516332 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.518215 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.518904 22576 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.518958 25636 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.522969 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.324023 25835 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.426841 25836 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:09.529338 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:09.475642 25502 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:09.535825 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 250508us
I20260709 12:11:09.534755 22578 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:09.537580 22582 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:09.542791 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.443398 25670 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.529470 25751 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:09.563426 21849 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:09.575956 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.575109 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 273476us
W20260709 12:11:09.577248 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 73258.1us
I20260709 12:11:09.579365 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.587154 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:09.589851 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.590570 21892 leader_election.cc:336] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.936s (SENT)
W20260709 12:11:09.582520 25848 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:11:09.591123 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.591300 21849 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:11:09.593497 21849 pending_rounds.cc:85] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 5
I20260709 12:11:09.593748 21849 pending_rounds.cc:107] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:11:09.593976 21849 raft_consensus.cc:2889] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:09.594059 21892 leader_election.cc:336] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.957s (SENT)
I20260709 12:11:09.576450 25676 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:09.594568 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:09.591879 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:09.601703 25835 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:09.602660 25742 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:09.603027 25663 consensus_meta.cc:287] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 12:11:09.599238 25686 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:09.603662 25663 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.604796 21996 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:09.605321 25447 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.624s	user 0.005s	sys 0.005s
I20260709 12:11:09.605768 25447 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.607291 25636 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:09.608035 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.609182 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.609867 21996 raft_consensus.cc:2393] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:09.599859 25837 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:09.615767 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.616804 21892 leader_election.cc:400] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11.
I20260709 12:11:09.617293 21892 leader_election.cc:403] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:09.620005 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:09.620639 22576 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:09.561103 25854 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:11:09.573558 25675 consensus_queue.cc:1059] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 12:11:09.620649 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 824) took 1584 ms (client timeout 1918 ms). Trace:
W20260709 12:11:09.627737 22580 rpcz_store.cc:269] 0709 12:11:08.035867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.038773 (+  2906us) service_pool.cc:224] Handling call
0709 12:11:09.620443 (+1581670us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b5400704254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:09.620589 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926599040}
I20260709 12:11:09.629467 22579 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:09.596881 25786 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.584213 25521 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:09.584354 25682 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:09.597064 25661 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:09.641363 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 61016.1us
I20260709 12:11:09.602933 25832 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:09.636922 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.638324 22581 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:09.634716 25837 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:11:09.643811 25712 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:11:09.644481 25839 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:11:09.649852 25852 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:11:09.640714 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:09.650956 21924 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:09.646188 22575 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:11:09.652189 22575 pending_rounds.cc:85] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 6
I20260709 12:11:09.652628 22575 pending_rounds.cc:107] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:11:09.647735 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:09.652915 22575 raft_consensus.cc:2889] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:09.653946 21844 raft_consensus.cc:2393] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:09.584064 25855 consensus_queue.cc:1059] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:11:09.642966 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:09.638098 25675 consensus_queue.cc:1243] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:09.646432 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.653136 21926 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:11:09.661610 21995 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:09.629750 25692 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:09.634178 25835 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11.
I20260709 12:11:09.674144 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:09.648025 25858 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:09.706509 22547 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:09.691517 21966 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35508 dropped due to backpressure: service queue is full with 50 items
I20260709 12:11:09.692456 25676 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:09.671380 25768 consensus_meta.cc:287] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 12:11:09.644132 25836 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.703209 25493 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.644354 25661 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:09.687817 25721 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.712567 25860 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:09.642059 25520 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.703946 25732 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.714282 25661 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.717916 25520 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:09.742200 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.715201 25860 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.719275 25540 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:09.745462 25860 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.713325 25493 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:09.771384 25721 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:09.776041 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 118027us
I20260709 12:11:09.778103 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:09.778725 22576 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.778816 25732 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:09.774596 25670 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:09.786067 25447 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:09.786540 25447 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:11:09.787186 25472 consensus_meta.cc:287] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.001s
I20260709 12:11:09.707213 21966 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35508 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1739)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1735)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1741)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1733)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1734)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 644)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1744)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1755)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1732)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1736)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2381)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2382)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2383)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2385)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2387)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2388)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2394)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2398)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2399)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1730)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1742)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1743)
I20260709 12:11:09.790442 25812 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.794909 21997 raft_consensus.cc:2393] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:09.791450 25472 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.796132 21992 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:09.791220 25461 raft_consensus.cc:3055] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:09.797492 25461 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:09.797581 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.798800 22576 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:09.798298 25461 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.793169 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:09.794822 25521 raft_consensus.cc:3055] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.805227 25521 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:09.809212 25493 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.810519 25493 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.806069 25521 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.812448 25295 raft_consensus.cc:3055] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.812845 25295 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:09.813618 25295 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.798835 25447 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.814723 25661 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.815331 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2305) took 1111 ms. Trace:
I20260709 12:11:09.816039 22577 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.816923 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.815958 21925 rpcz_store.cc:276] 0709 12:11:08.703870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.704297 (+   427us) service_pool.cc:224] Handling call
0709 12:11:08.704620 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:08.704981 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.705014 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:08.752551 (+ 47537us) log.cc:844] Serialized 52 byte log entry
0709 12:11:08.826516 (+ 73965us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:08.874585 (+ 48069us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.889766 (+ 15181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.889864 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.806982 (+917118us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b180021eaa0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c7c2a6 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1
0709 12:11:09.808575 (+  1593us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b180021eaa0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:11:09.815117 (+  6542us) raft_consensus.cc:1685] finished
0709 12:11:09.815137 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.815276 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29845,"prepare.queue_time_us":53360,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":35,"raft.queue_time_us":71473,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":32752,"spinlock_wait_cycles":58150400,"thread_start_us":38143,"threads_started":1,"wal-append.queue_time_us":126973}
I20260709 12:11:09.817606 21849 raft_consensus.cc:2368] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:11:09.818259 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:09.818476 25768 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.818992 25768 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:09.821362 25768 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:09.822855 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:09.839617 21844 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
W20260709 12:11:09.851521 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.793093 25860 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:09.854540 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.854624 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:09.929318 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:09.964860 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:09.855592 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:09.978404 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.933557 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:09.951354 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.914870 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.856920 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:09.858312 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 839) took 1500 ms. Trace:
I20260709 12:11:09.999620 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:10.028831 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.043664 22549 leader_election.cc:400] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:11:10.044055 22549 leader_election.cc:403] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:10.044981 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:10.046052 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:10.046653 21850 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:09.998312 22579 rpcz_store.cc:276] 0709 12:11:08.357640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.357758 (+   118us) service_pool.cc:224] Handling call
0709 12:11:09.621715 (+1263957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.629829 (+  8114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.858113 (+228284us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400704250. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:09.858255 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2906146688}
I20260709 12:11:10.047763 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:10.048426 21845 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:11:10.051040 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:10.051191 22549 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:09.857074 25663 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:10.047394 25828 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.959102 25521 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.052685 25828 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:10.052963 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:10.053369 25812 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:10.053704 22000 raft_consensus.cc:2393] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:10.054531 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:10.054764 25828 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:10.055498 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:10.056607 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:10.057332 22000 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:10.052119 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:10.047930 25295 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.058647 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:10.058779 21850 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.059185 21995 raft_consensus.cc:2376] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 5. Re-sending same reply.
I20260709 12:11:10.060009 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:10.060482 21995 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.062691 25661 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:09.928617 25472 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:09.914592 25783 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.064033 25783 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:09.928931 25461 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.863524 25860 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:10.048336 25540 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.068450 25540 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:10.058262 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:10.069818 25447 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.914880 25548 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:10.074890 25548 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:10.075980 25540 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:10.069857 22000 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:10.076905 25548 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:10.076982 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:10.077180 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:10.045922 25811 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:10.083814 25811 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:10.085836 25811 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:10.089975 21996 raft_consensus.cc:2410] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:10.091040 21850 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:11:10.091650 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:10.094599 25864 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:10.095240 25864 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:10.096150 25864 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:10.098714 25861 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.099686 25745 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.100204 25745 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:10.078227 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:10.109442 21992 raft_consensus.cc:2393] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:10.066223 25783 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:10.049018 25768 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.048099 25720 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:11:10.108191 25732 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.129267 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:10.162879 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:10.159610 21999 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:10.124163 25861 consensus_queue.cc:1059] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:11:10.189908 21993 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:10.428433 21995 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:10.977919 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2391) took 1633 ms. Trace:
I20260709 12:11:10.978444 21995 rpcz_store.cc:276] 0709 12:11:09.344187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.059789 (+715602us) service_pool.cc:224] Handling call
0709 12:11:10.977864 (+918075us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:10.440976 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.385547 25720 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.981855 25720 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:10.984375 25720 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:10.400178 25779 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.163609 21992 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
W20260709 12:11:11.155369 21992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1733) took 1646 ms (client timeout 2107 ms). Trace:
W20260709 12:11:11.155897 21992 rpcz_store.cc:269] 0709 12:11:09.508810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.162556 (+653746us) service_pool.cc:224] Handling call
0709 12:11:11.155289 (+992733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.168654 25768 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:10.570935 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.212440 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 102528us
W20260709 12:11:11.160203 21817 connection.cc:256] RPC call timeout handler was delayed by -1.3035853130002124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 12:11:11.161187 21817 connection.cc:256] RPC call timeout handler was delayed by -1.2688385810001819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 12:11:11.169325 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:10.336095 25869 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:11:10.160246 25832 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.175071 25832 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:11.177662 25832 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:11.179927 25877 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.180596 25877 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.182627 25793 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.183301 25793 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.152689 25636 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:11.185423 25636 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.189893 25636 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:11.245545 25768 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:11.194811 25779 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:11.249060 25779 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:11.275835 25877 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:11.274063 25793 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:11.281447 25461 consensus_meta.cc:287] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.215s	user 0.008s	sys 0.000s
I20260709 12:11:11.430433 25461 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:10.975654 21996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2392) took 1631 ms (client timeout 2119 ms). Trace:
W20260709 12:11:11.431248 21996 rpcz_store.cc:269] 0709 12:11:09.344457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.052742 (+708285us) service_pool.cc:224] Handling call
0709 12:11:10.975370 (+922628us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b540018f1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:10.975566 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82657536}
I20260709 12:11:11.432638 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.433570 21996 raft_consensus.cc:2368] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
W20260709 12:11:11.434051 21996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1734) took 1925 ms (client timeout 2139 ms). Trace:
W20260709 12:11:11.434595 21996 rpcz_store.cc:269] 0709 12:11:09.509027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.432305 (+1923278us) service_pool.cc:224] Handling call
0709 12:11:11.433983 (+  1678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.435704 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:11.436609 21996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 644) took 2000 ms (client timeout 2240 ms). Trace:
W20260709 12:11:11.437028 21996 rpcz_store.cc:269] 0709 12:11:09.436535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.435413 (+1998878us) service_pool.cc:224] Handling call
0709 12:11:11.436544 (+  1131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.395186 25783 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:11.038352 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:11.439347 21995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2402) took 1983 ms (client timeout 2180 ms). Trace:
W20260709 12:11:11.439834 21995 rpcz_store.cc:269] 0709 12:11:09.455845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.037963 (+1582118us) service_pool.cc:224] Handling call
0709 12:11:11.439278 (+401315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.440920 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:11.441762 21995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1748) took 1799 ms (client timeout 2058 ms). Trace:
I20260709 12:11:11.442775 25783 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:11:11.192574 25493 consensus_meta.cc:287] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.382s	user 0.011s	sys 0.000s
I20260709 12:11:11.445492 22000 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:11.446201 25493 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.446906 25493 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.449487 25493 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:11.193622 25872 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.507s	user 0.000s	sys 0.001s
W20260709 12:11:11.022465 21892 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.149s (SENT)
I20260709 12:11:11.451431 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:11.178308 25832 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:11.452886 25832 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.455591 25832 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:11.456290 25832 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.456897 25832 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:11.462921 25832 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:10.348543 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.442159 21995 rpcz_store.cc:269] 0709 12:11:09.642761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.440583 (+1797822us) service_pool.cc:224] Handling call
0709 12:11:11.441702 (+  1119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.470532 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:11.471568 21995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1756) took 1804 ms (client timeout 2038 ms). Trace:
W20260709 12:11:11.471989 21995 rpcz_store.cc:269] 0709 12:11:09.666898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.470076 (+1803178us) service_pool.cc:224] Handling call
0709 12:11:11.471501 (+  1425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.473083 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:11.473951 21995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2390) took 2130 ms (client timeout 2366 ms). Trace:
I20260709 12:11:10.642248 25552 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.474905 25552 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:11.475757 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.477592 25552 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:11.478363 25552 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:11.479746 25552 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:11.474327 21995 rpcz_store.cc:269] 0709 12:11:09.343910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.472753 (+2128843us) service_pool.cc:224] Handling call
0709 12:11:11.473888 (+  1135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.483597 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.484702 21995 raft_consensus.cc:2410] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:11:11.486020 21995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1744) took 1922 ms (client timeout 2149 ms). Trace:
W20260709 12:11:11.487915 21995 rpcz_store.cc:269] 0709 12:11:09.563425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.483289 (+1919864us) service_pool.cc:224] Handling call
0709 12:11:11.485953 (+  2664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.364030 25779 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:11.686460 25779 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.689961 25779 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:11.170290 21992 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
W20260709 12:11:11.690805 21992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1758) took 1647 ms (client timeout 1596 ms). Trace:
W20260709 12:11:11.691239 21992 rpcz_store.cc:269] 0709 12:11:10.043459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.168957 (+1125498us) service_pool.cc:224] Handling call
0709 12:11:11.690709 (+521752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.692440 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.506438 25889 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:11.697089 21992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1745) took 2113 ms (client timeout 2173 ms). Trace:
I20260709 12:11:11.696990 25889 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:11.697659 21992 rpcz_store.cc:269] 0709 12:11:09.583568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.692008 (+2108440us) service_pool.cc:224] Handling call
0709 12:11:11.697011 (+  5003us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.698891 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.699620 21992 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:11:11.699833 25889 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:11.507597 25881 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.534200 25888 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:11.545285 25461 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:11.701208 25888 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.703100 25461 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:11.123971 25880 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:11.703883 25888 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:11.703955 25880 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:11.704998 25881 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.132153 25882 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:11.706820 25882 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:11.708422 25881 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:11.709748 25882 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:11.576107 21966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.009s	sys 0.001s
W20260709 12:11:11.710692 21966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.009s	sys 0.001s
W20260709 12:11:11.712705 21992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1746) took 2116 ms (client timeout 2214 ms). Trace:
W20260709 12:11:11.713073 21992 rpcz_store.cc:269] 0709 12:11:09.596250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.698565 (+2102315us) service_pool.cc:224] Handling call
0709 12:11:11.712644 (+ 14079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.713917 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.714356 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:11.715299 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:11.715989 21995 raft_consensus.cc:2368] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
W20260709 12:11:11.629992 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 607558us
W20260709 12:11:11.716480 21995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1749) took 2061 ms (client timeout 2383 ms). Trace:
W20260709 12:11:11.716794 21892 leader_election.cc:336] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 2.173s (SENT)
W20260709 12:11:11.717993 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.718801 25779 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.719414 25779 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.721909 25779 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:11.722566 25779 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.644573 25893 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.647378 21967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.004s	sys 0.000s
W20260709 12:11:11.723726 21967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.004s	sys 0.000s
I20260709 12:11:11.723726 25893 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.729138 25893 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:11.657117 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 133404us
I20260709 12:11:11.625976 25886 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.740693 25886 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:11.658517 21964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.684s (SENT) [suppressed 37 similar messages]
I20260709 12:11:11.479100 25720 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.749547 25720 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.752313 25720 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:11.438061 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:11.753533 21996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2377) took 2418 ms (client timeout 2353 ms). Trace:
W20260709 12:11:11.754015 21996 rpcz_store.cc:269] 0709 12:11:09.335017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.437760 (+2102743us) service_pool.cc:224] Handling call
0709 12:11:11.753437 (+315677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.755347 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.756505 21996 raft_consensus.cc:2410] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:11:11.757071 21996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1750) took 2101 ms (client timeout 2394 ms). Trace:
W20260709 12:11:11.757488 21996 rpcz_store.cc:269] 0709 12:11:09.655282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.754996 (+2099714us) service_pool.cc:224] Handling call
0709 12:11:11.757005 (+  2009us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.458947 25783 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:11.758816 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.759481 21996 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
W20260709 12:11:11.760010 21996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1751) took 2104 ms (client timeout 2459 ms). Trace:
W20260709 12:11:11.760425 21996 rpcz_store.cc:269] 0709 12:11:09.655531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.758206 (+2102675us) service_pool.cc:224] Handling call
0709 12:11:11.759955 (+  1749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.761391 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:11.761952 21996 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.715852 25891 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.630898 25864 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:11.909507 25864 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:11.912408 25864 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:11.668931 25552 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:11.624652 25887 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:11.772711 25880 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:11.714517 21992 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
W20260709 12:11:11.915006 21992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1747) took 2289 ms (client timeout 2257 ms). Trace:
W20260709 12:11:11.915530 21992 rpcz_store.cc:269] 0709 12:11:09.625776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.713688 (+2087912us) service_pool.cc:224] Handling call
0709 12:11:11.914919 (+201231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.916766 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.917697 21992 raft_consensus.cc:2368] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
W20260709 12:11:11.716813 21995 rpcz_store.cc:269] 0709 12:11:09.654983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.715042 (+2060059us) service_pool.cc:224] Handling call
0709 12:11:11.716428 (+  1386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.919189 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.920153 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1732) took 2411 ms. Trace:
I20260709 12:11:11.920596 21995 rpcz_store.cc:276] 0709 12:11:09.508571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.918892 (+2410321us) service_pool.cc:224] Handling call
0709 12:11:11.920088 (+  1196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.921722 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:11.922402 21995 raft_consensus.cc:2376] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8. Re-sending same reply.
I20260709 12:11:12.272773 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.167810 21844 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
W20260709 12:11:11.723053 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.171262 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.171497 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:11.883443 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 224949us
W20260709 12:11:11.901598 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 186063us
I20260709 12:11:12.176918 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 637) took 2989 ms. Trace:
I20260709 12:11:12.286638 21994 rpcz_store.cc:276] 0709 12:11:09.187665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.188749 (+  1084us) service_pool.cc:224] Handling call
0709 12:11:09.201188 (+ 12439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.357497 (+156309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.175810 (+2818313us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54003f3754. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:12.176490 (+   680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311974144}
I20260709 12:11:12.289001 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:11.918223 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1753) took 2262 ms. Trace:
I20260709 12:11:12.290792 21992 rpcz_store.cc:276] 0709 12:11:09.655944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.916426 (+2260482us) service_pool.cc:224] Handling call
0709 12:11:11.918156 (+  1730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.292711 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.180774 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2369) took 2876 ms. Trace:
I20260709 12:11:12.294580 21993 rpcz_store.cc:276] 0709 12:11:09.303912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.304076 (+   164us) service_pool.cc:224] Handling call
0709 12:11:09.323441 (+ 19365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.986819 (+1663378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.180035 (+1193216us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54002369d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:12.180545 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991787392}
W20260709 12:11:11.928568 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.934211 25895 log.cc:927] Time spent T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.162s	user 0.007s	sys 0.015s
I20260709 12:11:11.846592 25886 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.303553 22580 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.304026 22579 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.885390 25779 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.307142 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:12.307878 25779 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:12.004096 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 115345us
I20260709 12:11:12.198450 25890 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.310508 25890 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.311118 22576 raft_consensus.cc:1217] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Deduplicated request from leader. Original: 4.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 12:11:12.302202 25886 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.311868 22576 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:12.312160 25886 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.313431 25891 consensus_queue.cc:1059] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:12.203048 25474 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.302186 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.212460 25745 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:12.240466 25522 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.254290 25502 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:12.254654 25887 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.256183 25882 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.257032 25783 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:12.268358 25888 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.167433 21816 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.008s	sys 0.046s
I20260709 12:11:12.290050 21994 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:12.309324 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:12.323033 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:12.306259 21966 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:12.320391 25890 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:12.308665 25779 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.314831 25474 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:12.314760 25891 consensus_queue.cc:1243] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:12.336717 21995 raft_consensus.cc:2376] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10. Re-sending same reply.
W20260709 12:11:12.346577 21817 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.117s	user 0.015s	sys 0.039s
I20260709 12:11:12.346837 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.346989 25502 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.348387 25552 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:12.349182 25552 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.349752 25502 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.350636 21992 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.352059 25552 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:12.351783 25888 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.352685 25882 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.354627 25886 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:12.355103 25882 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.356006 25522 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.358942 22584 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:12.362802 25783 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.365700 25783 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:12.366997 22578 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:12.370697 22575 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:12.363334 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:12.371831 25905 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.372355 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.372772 25905 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.373967 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:12.374959 25864 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.383939 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:12.362816 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.375499 25474 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:12.376974 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 71096.5us
W20260709 12:11:12.336683 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 1.0857e+06us
W20260709 12:11:12.347074 21817 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.016s	sys 0.039s
W20260709 12:11:12.392135 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 1.23029e+06us
I20260709 12:11:12.377621 25617 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:12.334275 25887 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:12.343613 21816 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.357s	user 0.009s	sys 0.047s
W20260709 12:11:12.378227 25874 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 1.400s	user 0.012s	sys 0.010s
I20260709 12:11:12.378340 25552 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:12.397560 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.398533 22576 raft_consensus.cc:2393] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:12.354182 25888 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:12.379882 25875 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 1.228s	user 0.007s	sys 0.012s
I20260709 12:11:12.382098 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.382115 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:12.391054 22578 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:12.400949 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:12.401405 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.394567 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:12.396492 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2322) took 3219 ms. Trace:
I20260709 12:11:12.397248 25552 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.402992 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2363) took 3124 ms. Trace:
I20260709 12:11:12.403787 22576 raft_consensus.cc:2410] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:12.378660 25891 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.405714 25887 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.406296 22584 raft_consensus.cc:2410] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:12.404572 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:12.403623 21999 rpcz_store.cc:276] 0709 12:11:09.278743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.278881 (+   138us) service_pool.cc:224] Handling call
0709 12:11:09.280544 (+  1663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.163877 (+883333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.402453 (+2238576us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54003f4654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:12.402815 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020980480}
I20260709 12:11:12.412341 21995 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.400986 25905 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.423784 25888 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.424535 25888 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.426888 25474 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.410918 25864 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.437021 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:12.439105 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:12.439375 21845 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:12.447340 25115 raft_consensus.cc:1064] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
W20260709 12:11:12.450569 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 55172.5us
I20260709 12:11:12.402685 21921 rpcz_store.cc:276] 0709 12:11:09.177196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.177343 (+   147us) service_pool.cc:224] Handling call
0709 12:11:09.177759 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.178156 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.178196 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.178778 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.779791 (+601013us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b1800204640. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be49434bc 00007f3be1c9148b 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1
0709 12:11:09.779947 (+   156us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:09.779989 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.780059 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.372103 (+2592044us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b1800204640. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:11:12.395113 (+ 23010us) raft_consensus.cc:1685] finished
0709 12:11:12.395136 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.396211 (+  1075us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2454,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7851,"spinlock_wait_cycles":22788352,"thread_start_us":14084,"threads_started":1,"wal-append.queue_time_us":15162}
I20260709 12:11:12.452486 25794 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:12.453553 21818 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:12.453873 25901 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:12.454771 21817 connection.cc:256] RPC call timeout handler was delayed by -1.1784853130002375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 12:11:12.457113 25794 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:12.458014 25794 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:12.459463 21966 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:12.460639 25891 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.447345 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.461848 22582 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:12.463245 21850 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:12.462862 25838 consensus_queue.cc:1059] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:12.464186 25838 consensus_queue.cc:1243] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:12.452992 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:12.464444 25522 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:12.470690 21893 connection.cc:256] RPC call timeout handler was delayed by -1.0408993410001131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 12:11:12.472543 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:12.470733 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 80362.4us
I20260709 12:11:12.474768 21993 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:11:12.470026 25838 raft_consensus.cc:3055] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:12.475425 25838 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:12.475980 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:12.476897 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1736) took 2967 ms. Trace:
I20260709 12:11:12.476801 25838 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.477388 21993 rpcz_store.cc:276] 0709 12:11:09.509476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.475634 (+2966158us) service_pool.cc:224] Handling call
0709 12:11:12.476833 (+  1199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.470706 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.479475 22578 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
W20260709 12:11:12.480614 21844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 599) took 2404 ms (client timeout 1632 ms). Trace:
I20260709 12:11:12.480746 25888 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:12.481050 21844 rpcz_store.cc:269] 0709 12:11:10.076594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.076756 (+   162us) service_pool.cc:224] Handling call
0709 12:11:12.480375 (+2403619us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54003e0dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:12.480527 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4805316352}
W20260709 12:11:12.482040 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.469092 25115 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:12.485672 22000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1757) took 2526 ms (client timeout 1588 ms). Trace:
W20260709 12:11:12.486120 22000 rpcz_store.cc:269] 0709 12:11:09.958791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.076948 (+118157us) service_pool.cc:224] Handling call
0709 12:11:12.485212 (+2408264us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002b84d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:12.485419 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3135761152}
I20260709 12:11:12.486814 25794 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.489264 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2367) took 3208 ms. Trace:
I20260709 12:11:12.491274 21992 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:12.494899 21750 catalog_manager.cc:5697] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:12.497257 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.496894 21750 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 7 to 8, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 8 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.498360 21847 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:12.498682 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.489677 22001 rpcz_store.cc:276] 0709 12:11:09.280336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.281883 (+  1547us) service_pool.cc:224] Handling call
0709 12:11:09.282134 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.493777 (+211643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.488774 (+2994997us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54002b75d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:12.489051 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485476608}
W20260709 12:11:12.500648 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 329772us
I20260709 12:11:12.503108 21995 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:12.504773 21994 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:12.506069 25838 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.506189 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:12.506758 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.507229 22575 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:12.507526 22578 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:11:12.500140 25686 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.507663 21750 catalog_manager.cc:5697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.508740 25686 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:12.509073 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.511050 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.511294 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:12.512801 21921 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:12.510578 21750 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 7 to 8, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 8 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.517243 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.538852 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.542008 21994 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:12.542732 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2382) took 3206 ms. Trace:
I20260709 12:11:12.543057 21994 rpcz_store.cc:276] 0709 12:11:09.336269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.532041 (+3195772us) service_pool.cc:224] Handling call
0709 12:11:12.541754 (+  9713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.542478 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.542663 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.542945 21750 catalog_manager.cc:5697] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 5, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:12.543740 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.544111 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:12.545445 25891 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.545018 21750 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 4 to 7, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 7 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.546883 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.547080 22001 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:12.547840 22575 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:12.510077 25686 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.549542 25686 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.547763 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2380) took 3212 ms. Trace:
I20260709 12:11:12.553743 22001 rpcz_store.cc:276] 0709 12:11:09.335780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.534318 (+3198538us) service_pool.cc:224] Handling call
0709 12:11:12.546597 (+ 12279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.547480 (+   883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.547706 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.544111 25843 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:12.570643 21996 consensus_meta.cc:287] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.590s	user 0.016s	sys 0.001s
I20260709 12:11:12.571010 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.571847 22001 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:12.573117 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.574000 25864 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.577417 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.571170 21996 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:12.574056 22001 raft_consensus.cc:2410] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:12.586699 21994 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:12.587649 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:12.588387 21993 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 5.
I20260709 12:11:12.589618 21892 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:12.593036 21996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1755) took 2934 ms (client timeout 2530 ms). Trace:
I20260709 12:11:12.589334 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:12.593430 21996 rpcz_store.cc:269] 0709 12:11:09.656340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.761128 (+2104788us) service_pool.cc:224] Handling call
0709 12:11:12.586484 (+825356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.599244 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.600549 21923 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.603137 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.601130 22001 raft_consensus.cc:2376] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10. Re-sending same reply.
I20260709 12:11:12.608284 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:12.613855 21918 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.616596 21750 catalog_manager.cc:5697] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 1 to 5, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:12.621169 21750 catalog_manager.cc:5697] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 5, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 5 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:12.622514 21997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2396) took 3246 ms (client timeout 1731 ms). Trace:
W20260709 12:11:12.622967 21997 rpcz_store.cc:269] 0709 12:11:09.345517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.384482 (+ 38965us) service_pool.cc:224] Handling call
0709 12:11:12.579487 (+3195005us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54003f2d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:12.592224 (+ 12737us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824410880}
W20260709 12:11:12.623540 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 61605.1us
I20260709 12:11:12.623677 25890 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:12.624794 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2387) took 3281 ms. Trace:
I20260709 12:11:12.625237 21997 rpcz_store.cc:276] 0709 12:11:09.343176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.623884 (+3280708us) service_pool.cc:224] Handling call
0709 12:11:12.624250 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.624445 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.624469 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:12.624508 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:12.624555 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.624601 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.624710 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.625355 25787 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:11:12.626569 25673 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.626811 25787 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.627104 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2388) took 3283 ms. Trace:
I20260709 12:11:12.627398 25787 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:12.627658 21995 rpcz_store.cc:276] 0709 12:11:09.343410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.626150 (+3282740us) service_pool.cc:224] Handling call
0709 12:11:12.626559 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.626805 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.626828 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:12.626894 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:12.626923 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.626968 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.627059 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.628515 25787 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.629498 25830 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:12.630158 21749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58738 (request call id 283) took 17118 ms (client timeout 15000 ms). Trace:
I20260709 12:11:12.624800 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:12.632616 25880 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:12.633070 25880 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:12.587319 25903 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:11:12.611348 25843 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.633265 25673 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.640990 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:12.639839 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:12.650733 21922 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:12.650971 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:12.651888 25673 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.652284 25673 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:12.652650 25673 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.647472 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.655086 22577 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:12.657128 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:12.658022 25905 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:12.648113 21994 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:12.658478 25905 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:12.658987 25905 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:12.634177 25880 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.660130 21852 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:12.660146 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2394) took 3315 ms. Trace:
I20260709 12:11:12.660784 21997 rpcz_store.cc:276] 0709 12:11:09.345023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.626372 (+3281349us) service_pool.cc:224] Handling call
0709 12:11:12.638329 (+ 11957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.638629 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.638653 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:12.638711 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:12.638768 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.638852 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.660092 (+ 21240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.662752 21997 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:12.663296 25552 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.663420 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2399) took 3317 ms. Trace:
I20260709 12:11:12.663889 21997 rpcz_store.cc:276] 0709 12:11:09.346331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.661795 (+3315464us) service_pool.cc:224] Handling call
0709 12:11:12.662326 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.663121 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.663341 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:12.630650 21749 rpcz_store.cc:269] 0709 12:10:55.462187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.462368 (+   181us) service_pool.cc:224] Handling call
0709 12:11:12.567915 (+17105547us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:05.362532 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:05.619885 (+257353us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:05.693738 (+ 73853us) write_op.cc:435] Acquired schema lock
0709 12:11:05.698823 (+  5085us) tablet.cc:662] Decoding operations
0709 12:11:06.075599 (+376776us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:06.113643 (+ 38044us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:06.114931 (+  1288us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:11:06.214676 (+ 99745us) tablet.cc:701] Row locks acquired
0709 12:11:06.214744 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:11:06.215015 (+   271us) write_op.cc:270] Start()
0709 12:11:06.215230 (+   215us) write_op.cc:276] Timestamp: P: 1783599066214930 usec, L: 0
0709 12:11:06.215265 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:11:06.402300 (+187035us) log.cc:844] Serialized 8626 byte log entry
0709 12:11:06.848061 (+445761us) op_driver.cc:464] REPLICATION: finished
0709 12:11:06.849512 (+  1451us) write_op.cc:301] APPLY: starting
0709 12:11:06.849630 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:06.850125 (+   495us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:06.850254 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:06.852728 (+  2474us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:06.853172 (+   444us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:11:06.853244 (+    72us) write_op.cc:312] APPLY: finished
0709 12:11:06.853770 (+   526us) log.cc:844] Serialized 152 byte log entry
0709 12:11:06.853954 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:06.854173 (+   219us) write_op.cc:454] Released schema lock
0709 12:11:06.854260 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:07.163848 (+309588us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540041e1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d96e28 00007f3be87d1581 00007f3be87d0d58 00007f3be87d59f1 00007f3be87d59a9 00007f3be87d5939 00007f3be87d5901 00007f3be87d4b2d 0000000000388634 0000000000388479
0709 12:11:07.166696 (+  2848us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:07.166737 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24376,"reported_tablets":47,"spinlock_wait_cycles":4352,"child_traces":[["op",{"apply.queue_time_us":1166,"apply.run_cpu_time_us":5184,"apply.run_wall_time_us":5189,"num_ops":22,"prepare.queue_time_us":1141468,"prepare.run_cpu_time_us":33779,"prepare.run_wall_time_us":1839605,"raft.queue_time_us":6129,"raft.run_cpu_time_us":1338,"raft.run_wall_time_us":1339,"replication_time_us":632605,"spinlock_wait_cycles":243991424,"thread_start_us":1617082,"threads_started":4,"wal-append.queue_time_us":436330,"wal-append.run_cpu_time_us":5716,"wal-append.run_wall_time_us":1022308}]]}
W20260709 12:11:12.668394 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56010.6us
I20260709 12:11:12.671277 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:12.671162 25843 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.672209 21999 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:12.672272 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2383) took 3335 ms. Trace:
I20260709 12:11:12.672724 21993 rpcz_store.cc:276] 0709 12:11:09.336512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.592984 (+3256472us) service_pool.cc:224] Handling call
0709 12:11:12.671658 (+ 78674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.671893 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.671931 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:12.671989 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:12.672029 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.672086 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.672190 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.673552 25843 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.676648 21926 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:12.676704 21918 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
W20260709 12:11:12.677567 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.658839 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:12.678658 25830 consensus_queue.cc:1059] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:12.679108 25843 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.679921 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.659003 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2398) took 3312 ms. Trace:
I20260709 12:11:12.680891 21994 rpcz_store.cc:276] 0709 12:11:09.346083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.641978 (+3295895us) service_pool.cc:224] Handling call
0709 12:11:12.647672 (+  5694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.658702 (+ 11030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.658930 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.681499 25830 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:12.681788 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:12.682313 21994 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:12.682780 25843 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.683635 25843 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:12.673628 21999 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:11:12.683003 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1743) took 3143 ms. Trace:
I20260709 12:11:12.692234 21994 rpcz_store.cc:276] 0709 12:11:09.539211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.681707 (+3142496us) service_pool.cc:224] Handling call
0709 12:11:12.682085 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.682759 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.682956 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.692359 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1730) took 3184 ms. Trace:
I20260709 12:11:12.693152 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2397) took 3347 ms. Trace:
I20260709 12:11:12.693385 21999 rpcz_store.cc:276] 0709 12:11:09.508110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.672925 (+3164815us) service_pool.cc:224] Handling call
0709 12:11:12.673270 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.692073 (+ 18803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.692300 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.693780 21995 rpcz_store.cc:276] 0709 12:11:09.345826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.628754 (+3282928us) service_pool.cc:224] Handling call
0709 12:11:12.667526 (+ 38772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.667852 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.667877 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:12.667919 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:12.667957 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.668015 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.693085 (+ 25070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.665560 21750 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.674188 21993 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:12.702800 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.703585 21996 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 12:11:12.705102 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1742) took 3169 ms. Trace:
I20260709 12:11:12.705542 21993 rpcz_store.cc:276] 0709 12:11:09.538848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.673671 (+3134823us) service_pool.cc:224] Handling call
0709 12:11:12.673991 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.704799 (+ 30808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.705028 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:12.708225 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 85813.5us
I20260709 12:11:12.709718 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2384) took 3373 ms. Trace:
I20260709 12:11:12.710122 21996 rpcz_store.cc:276] 0709 12:11:09.336767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.608976 (+3272209us) service_pool.cc:224] Handling call
0709 12:11:12.703238 (+ 94262us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:12.704204 (+   966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.709666 (+  5462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.688932 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.684197 25841 raft_consensus.cc:3055] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.711879 25841 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:12.615162 25474 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.712385 25905 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.712999 25841 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:12.714440 21817 connection.cc:256] RPC call timeout handler was delayed by -1.1118853130001298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 12:11:12.624927 25890 consensus_queue.cc:1243] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:12.724418 22000 raft_consensus.cc:2368] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
I20260709 12:11:12.684152 25843 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:12.721599 21817 connection.cc:256] RPC call timeout handler was delayed by -1.0947853130001022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 12:11:12.726454 21923 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
W20260709 12:11:12.747087 21817 connection.cc:256] RPC call timeout handler was delayed by -1.06418531300028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 12:11:12.723793 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.751261 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:12.687247 25891 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.752545 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.709439 25787 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.757786 22584 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:12.756193 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.763605 25905 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.766383 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.767064 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:12.770690 25903 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:12.774659 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.776647 21845 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.778266 21845 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:12.778667 21845 pending_rounds.cc:85] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 6
I20260709 12:11:12.778934 21845 pending_rounds.cc:107] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:12.779227 21845 raft_consensus.cc:2889] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:12.780239 21995 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:11:12.780400 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.779042 25841 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.780828 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2403) took 1056 ms. Trace:
I20260709 12:11:12.781203 21995 rpcz_store.cc:276] 0709 12:11:11.724584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.724681 (+1000097us) service_pool.cc:224] Handling call
0709 12:11:12.779893 (+ 55212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.780601 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.780765 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.784310 22000 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:12.712379 25758 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:12.788589 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 102780us
I20260709 12:11:12.786149 22000 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:12.724114 25474 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.791889 21999 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:12.795202 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.796777 22581 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:12.797782 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:12.798516 21919 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:12.799837 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.800160 25673 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.801784 21926 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:12.800757 22575 raft_consensus.cc:2410] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:12.754382 25891 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:12.804697 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 650) took 1091 ms. Trace:
I20260709 12:11:12.807338 21999 rpcz_store.cc:276] 0709 12:11:11.712933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.715477 (+1002544us) service_pool.cc:224] Handling call
0709 12:11:12.761993 (+ 46516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.794208 (+ 32215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.804643 (+ 10435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.804847 22582 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:12.802829 21750 catalog_manager.cc:5697] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 2 to 3, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 3 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:12.812484 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.813144 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.815744 21998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 639) took 3600 ms (client timeout 3342 ms). Trace:
I20260709 12:11:12.816046 25880 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:12.816299 21998 rpcz_store.cc:269] 0709 12:11:09.215322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.215592 (+   270us) service_pool.cc:224] Handling call
0709 12:11:12.815328 (+3599736us) spinlock_profiling.cc:243] Waited 3.54 s on lock 0x7b54003f3254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:12.815536 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8137563904}
I20260709 12:11:12.818073 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:12.818944 21920 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:12.819222 25461 raft_consensus.cc:3055] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:12.819644 25461 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:12.820494 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.820694 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:12.820613 25461 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.821966 25461 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:12.823433 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.822990 25474 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:12.831477 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:12.832154 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.832418 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.832849 21845 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:12.833042 21852 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:12.833948 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.834506 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.836087 21993 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:12.838207 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.839147 22582 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:12.841536 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.842224 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:12.847114 22584 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.848752 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.849619 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2409) took 1001 ms. Trace:
I20260709 12:11:12.849992 21996 rpcz_store.cc:276] 0709 12:11:11.857126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.716904 (+859778us) service_pool.cc:224] Handling call
0709 12:11:12.765991 (+ 49087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.835691 (+ 69700us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:12.835741 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:12.844769 (+  9028us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:12.844815 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.844870 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.844970 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26559,"raft.queue_time_us":45500,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9787}
I20260709 12:11:12.852360 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2404) took 1127 ms. Trace:
I20260709 12:11:12.827353 25673 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:12.853909 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.855094 25898 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.855759 25898 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:12.852824 21993 rpcz_store.cc:276] 0709 12:11:11.725129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.711347 (+986218us) service_pool.cc:224] Handling call
0709 12:11:12.762073 (+ 50726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.836637 (+ 74564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.845521 (+  8884us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b54002c6354. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:12.852278 (+  6757us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150897536}
I20260709 12:11:12.861364 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.805919 25890 consensus_queue.cc:1059] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:12.894368 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.891266 21999 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:12.898423 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.899263 21993 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:12.895020 21892 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:12.903559 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.904546 22000 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:12.903220 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:12.907214 21847 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
W20260709 12:11:12.916601 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.916679 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 85387.9us
W20260709 12:11:12.926836 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.929229 22578 raft_consensus.cc:2410] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:11:12.903203 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.914966 22576 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:12.927623 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:12.962213 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 63805.5us
I20260709 12:11:12.905648 25830 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.972266 21924 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:12.890807 25905 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:11:12.973080 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:12.982710 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 212383us
I20260709 12:11:12.983417 25891 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:12.985291 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 123365us
I20260709 12:11:12.986074 25673 raft_consensus.cc:2764] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:12.998770 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:12.957319 25890 consensus_queue.cc:1243] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:12.927007 25898 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:13.002619 21998 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:12.993610 25843 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:13.023154 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:13.027441 21967 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:13.037546 21927 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:13.047027 21998 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:11:13.056890 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.041996 25830 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.027217 25901 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:13.036549 25794 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:13.069770 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.069933 21892 leader_election.cc:400] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:13.025547 25898 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:13.070483 21893 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:13.075374 21818 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:13.071401 25794 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.080889 25903 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:13.091533 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 72368.3us
W20260709 12:11:13.090005 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.098321 25843 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:13.098431 25905 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:13.101786 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 345075us
W20260709 12:11:13.102368 22549 connection.cc:256] RPC call timeout handler was delayed by -2.2046163179998075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:11:13.102903 22549 connection.cc:256] RPC call timeout handler was delayed by -1.937798636999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
I20260709 12:11:13.093456 25903 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:13.103641 25892 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.104298 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 73749.1us
I20260709 12:11:13.104652 25892 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.108525 25892 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:13.110558 21817 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:13.103377 22549 connection.cc:256] RPC call timeout handler was delayed by -1.3281854699998803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33420000000000005s for a response
W20260709 12:11:13.113039 22549 connection.cc:256] RPC call timeout handler was delayed by -1.275092991000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 12:11:13.113436 22549 connection.cc:256] RPC call timeout handler was delayed by -1.2570929910000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 12:11:13.113754 22549 connection.cc:256] RPC call timeout handler was delayed by -1.0991647999999259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 12:11:13.114504 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:13.115561 25892 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.116894 25721 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.024s	sys 0.046s
W20260709 12:11:13.117283 25721 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.024s	sys 0.046s
I20260709 12:11:13.117991 25749 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:13.118649 25749 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:13.119668 25749 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:13.124579 22579 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:13.106211 21892 leader_election.cc:400] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
I20260709 12:11:13.127395 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:13.103767 25748 consensus_queue.cc:1059] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:13.129268 25748 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:13.129662 25748 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:13.132506 25748 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.133792 25748 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.068032 25901 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:13.138262 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.104159 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.151646 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.092927 25794 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.138298 25901 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:13.158398 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 45724.7us
I20260709 12:11:13.159358 21892 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:13.160306 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:13.165856 21893 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:13.103858 25903 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.179298 22577 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:13.179919 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:13.180883 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:13.181463 25892 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.154002 25905 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:13.163463 25673 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.193703 21817 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:13.187460 25843 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.185856 25892 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.190135 25673 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:13.195501 25909 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:13.232772 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 52920.9us
W20260709 12:11:13.274369 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.232198 21998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:13.307082 21998 raft_consensus.cc:606] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:13.311756 21851 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:13.312196 25830 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.312762 25830 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.317811 25474 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.233829 25887 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:13.318632 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 137825us
I20260709 12:11:13.319271 25463 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.319511 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:13.319823 25463 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.320914 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:13.322793 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 148916us
I20260709 12:11:13.323331 25930 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.227226 25843 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.230852 25892 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.233156 25673 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:13.236326 25861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.892s	user 0.013s	sys 0.025s
I20260709 12:11:13.234730 25909 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:13.369829 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 66209.6us
I20260709 12:11:13.366691 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:13.232808 25461 consensus_queue.cc:765] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 8 is ahead of the local log (next sequential op: 8). Destination peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 9, Last known committed idx: 8, Time since last communication: 0.524s
I20260709 12:11:13.364630 22549 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:13.236135 25758 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.372630 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2381) took 4036 ms. Trace:
I20260709 12:11:13.392827 22582 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
W20260709 12:11:13.391963 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 68203.7us
I20260709 12:11:13.330291 25843 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:13.370555 25861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.212s	user 0.013s	sys 0.026s
I20260709 12:11:13.374322 25930 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:13.375142 25909 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:13.394630 21992 rpcz_store.cc:276] 0709 12:11:09.336036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.562769 (+3226733us) service_pool.cc:224] Handling call
0709 12:11:12.586968 (+ 24199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.666552 (+ 79584us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:13.036853 (+370301us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.372121 (+335268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.372197 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:13.372274 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.372360 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.372533 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":435815,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":44283,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":115,"thread_start_us":614597,"threads_started":2}
W20260709 12:11:13.416105 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.418354 21998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:13.419200 21998 raft_consensus.cc:606] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:13.419544 21998 raft_consensus.cc:614] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:13.425801 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.426877 21892 leader_election.cc:400] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
I20260709 12:11:13.428627 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:13.430001 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.429512 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.430119 21926 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.428996 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.432175 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.433704 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.434451 25461 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.435184 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.435000 25461 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:13.437294 25461 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:13.439230 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.443930 21919 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:13.448532 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 291909us
I20260709 12:11:13.447861 21817 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:13.396510 25887 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:13.453411 21926 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:11:13.460274 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:13.460952 21921 raft_consensus.cc:2376] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7. Re-sending same reply.
W20260709 12:11:13.452780 25880 consensus_meta.cc:287] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.636s	user 0.013s	sys 0.000s
I20260709 12:11:13.449519 25905 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:13.473472 25937 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:13.475515 25951 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.475847 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1759) took 3397 ms. Trace:
W20260709 12:11:13.472893 25925 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.197s	user 0.000s	sys 0.002s
I20260709 12:11:13.478077 25861 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.464908 25787 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:13.485016 25930 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.483567 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.463591 25953 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.491500 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:13.462517 25830 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.476255 21997 rpcz_store.cc:276] 0709 12:11:10.078659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.707070 (+2628411us) service_pool.cc:224] Handling call
0709 12:11:12.756237 (+ 49167us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:12.846523 (+ 90286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.846555 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:12.874655 (+ 28100us) log.cc:844] Serialized 52 byte log entry
0709 12:11:13.191285 (+316630us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:13.195884 (+  4599us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.196273 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.196455 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.224902 (+ 28447us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.475613 (+250711us) raft_consensus.cc:1685] finished
0709 12:11:13.475634 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.475788 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50571,"prepare.queue_time_us":26067,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":87,"raft.queue_time_us":62773,"raft.run_cpu_time_us":899,"raft.run_wall_time_us":79058,"thread_start_us":238036,"threads_started":1,"wal-append.queue_time_us":415583}
I20260709 12:11:13.501207 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.503948 21893 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:13.501626 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:13.508777 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.511528 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:13.513125 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 92853.2us
I20260709 12:11:13.502803 25670 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:13.516153 25948 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:11:13.522753 21997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207491536b034836987ee3a520d08ff6"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:13.524468 21997 raft_consensus.cc:606] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:13.494165 25787 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:13.526889 25787 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.513840 25903 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.528132 25673 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.546200 21893 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:13.549510 25474 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:11:13.546069 25945 log.cc:927] Time spent T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:11:13.550249 25474 consensus_queue.cc:1243] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:13.550570 25461 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:13.550951 25474 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:13.551352 25474 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:13.551457 25887 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:13.552274 25474 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:13.554250 25474 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.510923 25953 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:13.555624 21844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:13.556250 21844 raft_consensus.cc:606] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:13.556113 25953 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.545037 25957 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.558879 25957 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:13.559293 25957 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.563133 25918 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.563361 21993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:13.563740 25918 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:13.564391 25664 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:13.560763 25891 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.537463 25830 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.566542 21926 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:13.496825 25880 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:13.573006 25461 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.573228 25918 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:13.530547 25861 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:13.579737 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 215110us
I20260709 12:11:13.524644 25794 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.546417 25905 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:13.575469 25830 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.595049 25830 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.595953 25950 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:13.569320 25664 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:13.598255 25673 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.598635 25664 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:13.608351 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.609395 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.610360 21926 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:13.614078 25903 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.616636 25861 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:13.617862 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:13.618314 25794 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.618469 22581 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.603168 25952 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:13.619225 25952 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:13.619626 25952 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.619305 25892 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.621228 25892 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:13.623471 21995 raft_consensus.cc:3055] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:13.623862 21995 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:13.624688 21995 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.600790 25905 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:13.626698 25905 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.634871 21995 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.635563 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:13.636865 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 91537.7us
I20260709 12:11:13.642868 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:13.648072 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.654322 22581 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:13.657481 21818 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:13.593792 25461 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:13.684999 25794 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.685801 25794 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:13.687009 25794 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:13.688122 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.679827 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:13.691356 22577 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.695852 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:13.703475 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 59217.9us
W20260709 12:11:13.703743 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 57063.1us
I20260709 12:11:13.692612 25474 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.692613 25880 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.710615 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 123929us
I20260709 12:11:13.697620 25918 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.703541 25948 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.705886 25956 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.721606 21995 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:13.722195 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.722182 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.724740 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 653) took 1183 ms. Trace:
I20260709 12:11:13.725097 21995 rpcz_store.cc:276] 0709 12:11:12.541715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.781962 (+240247us) service_pool.cc:224] Handling call
0709 12:11:12.782267 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.623384 (+841117us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54001c7620. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d12dc0 00007f3be4d9d1c0 00007f3be4d9e231 00007f3be4d9ad8f 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c
0709 12:11:13.724479 (+101095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.724673 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523190528}
W20260709 12:11:13.741217 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.745847 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.751111 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.752939 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.725472 25474 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:13.723008 25918 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.764415 25957 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.765412 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:13.766534 25826 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:13.766973 22577 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:13.770049 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:13.770510 25953 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.771245 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.772078 21926 raft_consensus.cc:2410] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:13.772873 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.773177 25910 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.773715 25910 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:13.774016 21927 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:13.774231 21926 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:13.774667 25910 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:13.776024 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.776657 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.777045 25905 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.778319 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.779104 21921 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:13.781497 21921 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:13.784313 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:13.784938 21926 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.785609 25830 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.755180 25956 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:13.786576 25948 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:13.786933 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:13.787580 21919 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.787184 25956 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.787806 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:13.757752 25892 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:11:13.792302 21926 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:13.793032 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:13.793354 25905 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.794528 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:13.794723 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.795333 25664 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.798060 21926 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:13.798813 21922 raft_consensus.cc:1217] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[4.6-8.7]   Dedup: 8.7->[]
I20260709 12:11:13.799314 21918 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:13.800246 25957 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:13.801358 25962 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:11:13.801533 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:13.802676 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.796531 21849 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:13.787252 25948 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.804455 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.805280 21926 raft_consensus.cc:2410] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:13.805361 25948 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.758776 25861 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:11:13.806218 25461 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:13.796689 21919 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:13.799347 21922 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [4.6-8.7]
I20260709 12:11:13.807761 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.808343 21922 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
W20260709 12:11:13.808704 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50175.7us
I20260709 12:11:13.809082 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.773212 25463 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.795895 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:13.811475 21817 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:13.813489 21927 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:13.813963 25932 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:11:13.811080 25636 raft_consensus.cc:3055] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:13.814630 25636 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:13.815639 25636 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.817250 25636 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.800238 25664 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:13.818790 25463 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.819315 25463 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:13.820252 25463 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:13.823406 25964 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:13.825103 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2385) took 4488 ms. Trace:
I20260709 12:11:13.825716 22001 rpcz_store.cc:276] 0709 12:11:09.337007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.611628 (+3274621us) service_pool.cc:224] Handling call
0709 12:11:12.748689 (+137061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.749181 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:12.749223 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:12.793376 (+ 44153us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.029071 (+235695us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:13.029119 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.029202 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.813275 (+784073us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:13.824687 (+ 11412us) raft_consensus.cc:1685] finished
0709 12:11:13.824717 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.825004 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1346,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5610,"spinlock_wait_cycles":8933760,"thread_start_us":184563,"threads_started":1,"wal-append.queue_time_us":624482}
I20260709 12:11:13.810166 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.832616 21927 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:13.839864 25830 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.842527 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:13.843009 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:13.843608 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:13.796152 21851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 586) took 5293 ms (client timeout 1857 ms). Trace:
I20260709 12:11:13.844822 25843 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.845561 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:13.795336 21923 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:13.843658 25474 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:13.736055 25880 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.844827 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:13.863350 21844 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
W20260709 12:11:13.848272 21851 rpcz_store.cc:269] 0709 12:11:08.502502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.502625 (+   123us) service_pool.cc:224] Handling call
0709 12:11:13.795927 (+5293302us) spinlock_profiling.cc:243] Waited 4.65 s on lock 0x7b54003809d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:13.796076 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10686028288}
I20260709 12:11:13.861841 21925 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:13.857903 22580 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:13.863924 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.862308 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:13.867278 25968 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.867437 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:13.871204 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:13.872157 21918 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:13.871883 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:13.892930 21920 raft_consensus.cc:2368] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:13.875350 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:13.859233 25830 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:13.897585 22582 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:13.867928 25918 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:13.901094 22547 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.580s (SENT)
I20260709 12:11:13.901211 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.867858 25968 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.896425 25664 raft_consensus.cc:2764] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:13.903342 25966 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.904186 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:13.925618 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.906448 25758 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:11:13.907895 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.909428 25843 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.912160 25880 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:13.915504 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:13.934037 21922 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:13.916324 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:13.936055 21967 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:13.918380 21925 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:13.866392 25951 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.923373 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:13.862208 25787 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:13.931675 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.865887 25826 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.946704 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 48304.2us
I20260709 12:11:13.937849 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:13.947398 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:13.950641 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.951449 21918 raft_consensus.cc:2410] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:13.947547 22575 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:13.928401 25966 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.929455 25918 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.955475 21921 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:13.893503 25952 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:13.948622 25880 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.953366 25861 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.975947 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:13.955073 25552 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:13.977496 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:13.976030 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.002328 22001 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:11:13.976667 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:13.975555 21994 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:14.002404 21997 raft_consensus.cc:2393] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:13.929787 25830 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:13.982599 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:13.959352 25892 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:13.977046 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.004814 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.005497 21995 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:14.004814 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.003326 21994 pending_rounds.cc:85] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 7
I20260709 12:11:14.006636 21994 pending_rounds.cc:107] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:14.006961 21994 raft_consensus.cc:2889] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.956125 25966 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.008502 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:13.991093 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 58598.5us
I20260709 12:11:14.003923 21999 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
W20260709 12:11:13.973510 25909 consensus_meta.cc:287] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.518s	user 0.014s	sys 0.006s
I20260709 12:11:14.011657 21993 raft_consensus.cc:606] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.013352 21993 raft_consensus.cc:614] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:14.002084 25552 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:14.014564 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.015861 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1760) took 3936 ms. Trace:
I20260709 12:11:14.016163 21994 rpcz_store.cc:276] 0709 12:11:10.078993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.712502 (+2633509us) service_pool.cc:224] Handling call
0709 12:11:12.712973 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.011393 (+1298420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.015599 (+  4206us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400235fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:14.015817 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2902866688}
I20260709 12:11:13.978912 25787 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:13.963936 25968 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:14.021821 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.024523 21921 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.004335 25861 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:13.959621 25664 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:11:14.017628 25552 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.030653 21922 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:14.019976 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 84014.9us
I20260709 12:11:14.033998 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.037823 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:14.038359 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.045714 25664 consensus_queue.cc:1243] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:14.010538 25900 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:14.046257 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.053941 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.054689 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.055152 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.036022 25861 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.058076 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.064158 21921 raft_consensus.cc:2410] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:14.059020 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.065021 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.065075 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:14.065626 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.065971 21995 raft_consensus.cc:2410] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:14.089323 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:14.089942 22000 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.090521 21849 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:14.091428 21993 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:14.093545 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.095255 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.096437 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.097265 21994 raft_consensus.cc:2410] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:14.095353 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:14.097836 21992 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.088902 25952 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.098381 21850 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:11:14.102479 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 56331.7us
I20260709 12:11:14.018760 25909 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.098917 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.095912 21999 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:14.066500 25918 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.110431 25918 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:14.110772 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.112735 25918 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:14.112864 25830 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:14.113246 25909 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:14.066313 25981 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.111033 21922 raft_consensus.cc:2410] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:11:14.114862 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.120097 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:14.120759 21995 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.118716 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.122076 21921 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
W20260709 12:11:14.122789 21964 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.684s (SENT)
W20260709 12:11:14.103570 21892 connection.cc:256] RPC call timeout handler was delayed by -2.5818383660000563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:11:14.097065 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.124389 21998 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:14.093294 25664 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.125416 22547 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:14.123229 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.126333 21992 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:14.128994 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.130761 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.099025 25880 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.134821 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:14.130554 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.127084 25892 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:14.141362 21967 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:14.142717 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.132351 25636 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:11:14.144732 25826 raft_consensus.cc:993] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:11:14.145232 25461 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.146080 25461 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.146479 25461 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.146858 25461 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.150280 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.152403 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.150935 21921 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:14.154887 21922 raft_consensus.cc:2368] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:14.136477 25745 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:14.157965 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:14.160477 25918 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.160980 25918 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.134078 25830 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:14.162724 25830 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.164721 25830 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.164429 25966 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:14.168048 22001 raft_consensus.cc:2368] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:14.167883 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.169358 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:14.169790 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.152956 25794 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:14.170847 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.172340 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:14.153056 25981 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.173866 21844 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:14.174304 25966 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:14.174751 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.175021 25966 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.175333 25981 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.150115 25953 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.175565 25966 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.176054 25953 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.176460 25953 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.166965 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.177667 25966 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.165236 25830 raft_consensus.cc:1081] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:11:14.170953 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:14.178561 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:14.179147 21849 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.179497 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.167125 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.151588 25880 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.184520 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.185552 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:14.188896 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.188907 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:14.199869 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.207697 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 51675.3us
I20260709 12:11:14.211700 21922 raft_consensus.cc:2410] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:11:14.215121 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 57710.9us
I20260709 12:11:14.226516 25968 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.230119 25968 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.229969 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:14.226735 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:14.229441 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.241559 21995 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:14.243777 21849 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:14.244059 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:14.244860 21921 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.247124 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:14.249387 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.250367 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.250761 22582 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:14.252223 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.249728 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.230523 25968 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.255048 25918 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.244865 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.256753 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.257602 21922 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:14.258018 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 127779us
I20260709 12:11:14.258993 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.207944 25892 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.265597 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:14.249235 22000 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:11:14.271080 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.274380 25522 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.274982 25522 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.276614 22575 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:14.277851 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:14.281806 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 140521us
I20260709 12:11:14.283771 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.285328 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:14.267517 25880 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.287838 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:14.289434 21851 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:14.275913 25952 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.269524 25985 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.289959 21845 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:14.296159 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:14.292352 25830 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.298130 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:14.299998 21922 raft_consensus.cc:2376] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9. Re-sending same reply.
I20260709 12:11:14.301378 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.304505 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.299702 25948 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:14.307122 25956 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.306941 25948 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:14.307812 25956 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:14.309406 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.312387 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:14.317464 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:14.318356 21922 raft_consensus.cc:2376] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11. Re-sending same reply.
I20260709 12:11:14.318871 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:14.270547 25745 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:11:14.293043 25959 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.342867 21923 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:14.334451 21919 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:14.345150 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.325254 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.349951 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:14.297376 25952 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:14.351809 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.354885 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:14.353451 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47364.1us
I20260709 12:11:14.356391 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:14.348346 21922 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:14.286727 25900 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:11:14.358096 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.359546 21924 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:14.359670 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:14.365536 21996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:14.366500 21996 raft_consensus.cc:606] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.366881 21996 raft_consensus.cc:614] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:14.365886 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:14.368396 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 83760.1us
I20260709 12:11:14.343458 25843 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.375272 25636 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.342873 25966 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:14.354543 25880 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.317466 25985 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:14.322137 25909 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.375754 25948 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:14.359054 25952 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.390771 22549 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.299358 25830 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:14.375826 25636 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.321967 25951 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:14.358592 25891 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:11:14.370318 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 93315.6us
I20260709 12:11:14.402997 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:14.394645 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 75824.6us
I20260709 12:11:14.378594 25843 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.406044 25843 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.406709 25787 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.407193 25787 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.407598 25787 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.407716 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:14.405622 25522 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.403453 25910 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:11:14.396481 25948 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.410310 25522 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:14.410594 25948 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.411098 25948 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.411859 25522 raft_consensus.cc:2764] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:14.397864 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:14.414757 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.404567 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:14.397367 25990 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.416934 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:14.400928 25636 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.423602 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:14.399631 25956 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.387099 25966 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.431864 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.430481 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:14.435694 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.440753 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.449183 25664 raft_consensus.cc:697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:14.450649 25664 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.456295 25981 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:14.456920 25981 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.457376 25981 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.481328 25981 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.441735 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:14.484074 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 43989.4us
I20260709 12:11:14.488775 21967 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:14.487154 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.490166 22581 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:14.491770 21893 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:14.426577 25909 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.499727 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.500313 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:14.415848 25968 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:14.511014 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:14.401913 25880 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.511878 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.413452 25891 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.515240 22581 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 12: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:11:14.530220 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.503664 25474 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.493343 22579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:58892
I20260709 12:11:14.538065 21923 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:14.538561 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 46894.9us
I20260709 12:11:14.539273 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:14.540474 25991 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.542152 21893 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:14.440433 25901 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 12:11:14.534171 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 135604us
W20260709 12:11:14.541033 25987 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.298s	user 0.002s	sys 0.000s
I20260709 12:11:14.486825 25996 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:14.534709 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 127074us
I20260709 12:11:14.494726 25892 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:14.548967 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.549932 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.534320 25990 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:14.536110 25474 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:14.566919 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 136516us
I20260709 12:11:14.547812 25951 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.550348 25996 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.581655 21921 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:14.560647 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:14.582893 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.583817 21995 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:14.585064 22583 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:14.557610 25900 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:14.617868 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.600683 25794 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:11:14.527674 25998 consensus_queue.cc:1059] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:11:14.603536 25745 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:14.627454 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.628998 25880 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.632826 25891 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.618731 25999 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.635701 25830 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:14.636610 25966 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.637760 25968 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:14.638319 26004 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:14.639071 25552 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.001s
I20260709 12:11:14.639627 26005 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:14.640741 25861 consensus_meta.cc:287] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.003s
I20260709 12:11:14.535909 25985 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:14.541035 25991 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:14.572500 25474 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.623761 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:14.737741 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 114094us
I20260709 12:11:14.715957 25880 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.659117 25959 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.586957 25996 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:14.663661 25992 log.cc:927] Time spent T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:11:14.664788 25952 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:14.653890 25953 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.668491 25948 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:14.672408 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.678630 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 261779us
I20260709 12:11:14.714534 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:14.734030 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 153077us
I20260709 12:11:14.765990 21845 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.633906 25461 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.733492 25861 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.750550 22579 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:14.770102 21964 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:14.761618 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 161394us
I20260709 12:11:14.727610 26004 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:14.766180 21892 leader_election.cc:400] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:14.770612 22579 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.771262 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:14.747476 25968 raft_consensus.cc:3055] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:14.759725 25892 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:14.779296 21964 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.773991 21892 leader_election.cc:403] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:14.775113 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.796186 25787 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:14.803293 25997 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:11:14.805099 21999 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:14.805351 25991 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:14.806464 25636 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.807379 22582 raft_consensus.cc:2368] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:14.808864 25861 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:14.809976 22584 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.810220 25463 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:14.812088 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:14.867394 21997 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:14.813483 25953 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:14.815137 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.818706 26001 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.878993 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:14.779325 25892 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:14.823520 21993 raft_consensus.cc:2368] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:14.735898 25552 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.718209 25999 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:14.832125 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 66120.1us
I20260709 12:11:14.892522 21892 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:14.838383 25826 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.893532 25830 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:14.894477 25983 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.729s	user 0.003s	sys 0.006s
I20260709 12:11:14.894121 25830 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.895228 25843 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.896263 25830 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.896711 21992 raft_consensus.cc:1217] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[4.6-9.8]   Dedup: 4.6->[7.7-9.8]
I20260709 12:11:14.897017 22583 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:14.897295 25843 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:14.838516 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 59306.2us
I20260709 12:11:14.779676 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.834362 22579 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.842733 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:14.759541 25880 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:14.838776 26010 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.776099 26004 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:14.846979 25998 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:14.776734 25968 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:14.880173 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 45398.3us
I20260709 12:11:14.888172 25948 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:14.881108 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 109922us
I20260709 12:11:14.884886 22581 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:14.888024 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.914440 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.915053 21996 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:14.897167 21992 pending_rounds.cc:85] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 6
I20260709 12:11:14.916308 21992 pending_rounds.cc:107] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:11:14.916687 21992 raft_consensus.cc:2889] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:14.902480 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.840166 21845 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:14.904270 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:14.866869 25463 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:14.906802 22576 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:14.889011 25892 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.889302 25794 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.890386 25664 consensus_queue.cc:1059] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:11:14.898902 26001 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:14.903479 26005 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.933531 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:14.822790 25461 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.942394 21964 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:14.932844 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:14.972704 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:14.976773 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:14.980914 21923 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
W20260709 12:11:14.985005 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 51583us
W20260709 12:11:14.987337 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 66256.4us
I20260709 12:11:14.988886 25968 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:14.990667 25968 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.992193 26019 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:14.993013 26019 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:14.994349 25115 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.996086 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.026463 21995 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.014010 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 893) took 1042 ms. Trace:
I20260709 12:11:14.988111 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:15.029057 21993 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:11:15.030292 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.018877 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.032124 21918 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:15.024040 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:15.016554 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.028487 22584 rpcz_store.cc:276] 0709 12:11:13.972097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.972261 (+   164us) service_pool.cc:224] Handling call
0709 12:11:13.972669 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.863555 (+890886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.013712 (+150157us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54005c0154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:15.013926 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925177216}
W20260709 12:11:15.035220 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 116272us
W20260709 12:11:15.037355 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 48981.4us
I20260709 12:11:15.038403 21964 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.035022 21893 leader_election.cc:400] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:15.039459 21893 leader_election.cc:403] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:15.040663 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.042742 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:15.043576 21848 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:15.047641 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.048586 21993 raft_consensus.cc:2393] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:15.003772 25861 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:15.017716 25461 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.995847 25880 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:15.014760 26010 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:15.056641 22579 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.042188 26013 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:15.004349 25998 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.997277 25999 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.059592 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.061439 26009 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.965092 25794 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.077508 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.092218 21995 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:11:15.068629 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:15.070606 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:15.055126 25918 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:15.144806 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:15.071185 25993 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:15.093508 25664 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.100883 25636 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.011430 26001 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.055768 25861 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:14.970283 26005 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.041559 21999 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.076269 26013 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.108777 25994 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.189s
I20260709 12:11:15.109700 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:15.110248 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 47811.3us
I20260709 12:11:15.110613 25787 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:14.994163 26019 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.115759 26009 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:15.119104 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.121028 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:15.121627 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:15.122040 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:15.131146 25758 consensus_queue.cc:1059] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:15.206883 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.207469 25758 raft_consensus.cc:3055] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:15.206904 21919 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.207911 25758 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:15.208985 25758 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.209888 26013 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.131563 26015 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:15.133834 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:15.136543 21925 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:15.135339 21926 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:15.210321 25758 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.149691 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.213027 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:15.214082 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:15.072819 25952 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.166375 21847 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:11:15.168275 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 63443.2us
I20260709 12:11:15.095048 25998 raft_consensus.cc:697] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:15.172688 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:15.176324 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.177934 21964 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.181571 21966 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:15.113935 25996 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.106339 26010 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:11:15.135352 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 220992us
I20260709 12:11:15.153177 25918 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:15.195307 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.196157 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:15.198050 25794 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.199440 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:15.222398 22579 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:15.208065 22581 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:15.151942 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.168711 25956 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:15.215098 21996 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:15.216303 26005 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.234334 21922 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:15.143738 21997 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
W20260709 12:11:15.225112 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 43661.4us
I20260709 12:11:15.224534 22547 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.232379 21919 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:15.237228 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:15.237557 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 59689.8us
I20260709 12:11:15.238358 21997 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:15.241144 21852 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:15.241473 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.242215 21995 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.242599 21995 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:15.243458 21995 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.244844 21995 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.223841 25918 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.230067 25636 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.260816 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.233775 25461 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.170897 25664 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.250758 26013 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.234031 26015 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:15.176261 26012 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:11:15.270936 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:15.267652 21997 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.246848 26009 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:15.280369 21995 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:15.282684 21964 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.290331 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:15.255875 25552 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.294528 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.295120 21995 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.283133 26013 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.269716 25636 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:15.298987 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.309372 21997 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:15.296936 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:15.311362 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.314661 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.315412 21997 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.284122 26015 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:15.312155 26013 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.321079 25787 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.321307 22581 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:15.321620 25787 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.325721 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.297863 26009 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.326938 22581 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:15.327224 25522 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:15.328220 26009 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.328540 25522 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:15.328825 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46246.3us
I20260709 12:11:15.330127 21964 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.321615 25664 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.330950 25880 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.331310 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.332072 25880 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.332439 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.333355 25880 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.333642 25787 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.333843 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:15.334851 22581 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 11: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:15.339781 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.341122 21995 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
W20260709 12:11:15.343314 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 44444.4us
W20260709 12:11:15.358381 25951 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.005s	sys 0.026s
I20260709 12:11:15.349309 21964 leader_election.cc:400] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:15.314253 25636 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.293530 25994 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:15.316978 25959 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.315850 25461 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.364382 21997 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:15.383996 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:15.384994 22001 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:15.385118 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.370699 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.311977 25953 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.377024 21964 leader_election.cc:403] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:15.351296 25990 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.352324 25952 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.389266 21927 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.395694 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.396493 22001 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:15.397240 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:15.397886 22001 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 11: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:11:15.399753 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.399694 26013 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.389968 26024 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
W20260709 12:11:15.381800 25951 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.005s	sys 0.026s
I20260709 12:11:15.403101 26020 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.404086 25981 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.410763 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:15.430676 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 60083.4us
I20260709 12:11:15.431282 22582 raft_consensus.cc:2393] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 6: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:15.431979 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:15.411332 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 66586.3us
I20260709 12:11:15.433348 21964 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.434794 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.411969 25891 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:15.415328 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:15.416049 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:15.416736 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:15.439498 22580 raft_consensus.cc:2393] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:15.417402 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:15.358105 26009 consensus_queue.cc:1059] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:15.439936 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.392298 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.418757 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:15.418828 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:15.443306 21817 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.386562 25880 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.338058 26010 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.436395 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:15.455699 22575 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:15.383989 25959 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:15.441088 21995 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:15.443441 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.319006 25998 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.444604 22581 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 12: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:11:15.425503 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 201032us
I20260709 12:11:15.458803 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:15.445842 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 120165us
I20260709 12:11:15.449344 21999 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:15.450718 21817 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.453384 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:15.464378 22577 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 13: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:15.466591 21919 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:15.473839 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.425160 26007 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.475366 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.427186 26020 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:15.479349 21999 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:15.501294 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:15.424783 25951 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:15.501355 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50761.3us
I20260709 12:11:15.510424 21817 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:15.503232 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44515.6us
I20260709 12:11:15.510980 21921 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:15.507019 21919 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:15.455224 26024 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.541039 26024 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.514339 25994 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.515035 21920 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:15.515326 21817 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:15.515945 25951 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:15.517650 26004 consensus_meta.cc:287] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.003s
I20260709 12:11:15.555147 26004 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.557623 26004 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.506187 26020 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.521241 25552 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:15.523698 26022 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:11:15.474972 25999 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.524112 26018 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.475629 25981 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.456804 25996 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.530555 26025 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.532979 21995 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
W20260709 12:11:15.535293 25892 consensus_meta.cc:287] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.001s
I20260709 12:11:15.502213 25891 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.455070 25461 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.475726 25952 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.477660 26005 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:15.550277 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 75027.5us
I20260709 12:11:15.503466 26019 raft_consensus.cc:3055] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:15.552585 21920 raft_consensus.cc:1240] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:15.553719 25474 consensus_meta.cc:287] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.000s
I20260709 12:11:15.541503 26024 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.509025 25794 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.558586 21926 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:15.562675 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:15.558193 25900 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.646653 25900 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.647044 25900 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.649210 21997 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:11:15.649569 21997 pending_rounds.cc:85] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 7
I20260709 12:11:15.649827 21997 pending_rounds.cc:107] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:15.650043 21997 raft_consensus.cc:2889] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:15.481789 26026 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:11:15.563730 21919 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.652019 26026 consensus_queue.cc:1243] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:15.652545 26026 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:15.652837 26026 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:15.597749 26025 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:15.626030 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:15.563900 25985 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.025s	sys 0.018s
W20260709 12:11:15.635141 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 161405us
I20260709 12:11:15.597424 26008 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.638141 22578 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:11:15.638656 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:15.581475 25918 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.645777 25463 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.652753 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.541705 25956 raft_consensus.cc:697] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:15.564827 25664 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.622578 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.654723 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.666800 21844 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.666891 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 665) took 1071 ms. Trace:
I20260709 12:11:15.667577 25918 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:15.625180 25892 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.669169 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2416) took 1016 ms. Trace:
I20260709 12:11:15.669523 21996 rpcz_store.cc:276] 0709 12:11:14.652745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.938912 (+286167us) service_pool.cc:224] Handling call
0709 12:11:15.668997 (+730085us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54000d3c54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:15.669116 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555316480}
I20260709 12:11:15.669870 25892 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.670902 25636 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.672291 26025 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.673032 25636 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:15.673868 26025 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.674808 21844 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:15.664036 25952 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.678825 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.679505 21920 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 5.
W20260709 12:11:15.679657 22547 leader_election.cc:336] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.579s (SENT)
I20260709 12:11:15.632230 26019 raft_consensus.cc:740] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:15.679869 21966 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:15.680171 22547 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.680709 26019 consensus_queue.cc:260] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.667352 22000 rpcz_store.cc:276] 0709 12:11:14.595582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.602310 (+  6728us) service_pool.cc:224] Handling call
0709 12:11:15.622376 (+1020066us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:11:15.666809 (+ 44433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36240768}
I20260709 12:11:15.681834 26035 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.682063 26019 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.570604 25999 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.714494 25664 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.715216 25664 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.717839 25664 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.718909 22549 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:15.723873 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:15.665203 25463 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.727229 25861 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.728477 26036 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:15.728608 25861 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.729058 26036 raft_consensus.cc:697] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:15.663147 25956 consensus_queue.cc:237] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.730443 26035 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:15.730939 26035 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.661280 21999 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:15.733247 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2417) took 1080 ms. Trace:
I20260709 12:11:15.733613 21999 rpcz_store.cc:276] 0709 12:11:14.652961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.505649 (+852688us) service_pool.cc:224] Handling call
0709 12:11:15.514330 (+  8681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.732477 (+218147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.733040 (+   563us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000c4ed4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:15.733192 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337220992}
I20260709 12:11:15.735146 21999 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:11:15.735684 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2427) took 1008 ms. Trace:
I20260709 12:11:15.735958 21999 rpcz_store.cc:276] 0709 12:11:14.727285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.734629 (+1007344us) service_pool.cc:224] Handling call
0709 12:11:15.734944 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.735465 (+   521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.735637 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:15.642290 25474 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.682669 22000 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.682783 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 668) took 1086 ms. Trace:
I20260709 12:11:15.684652 21920 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.685844 25952 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:15.637463 26005 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.686652 25918 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:15.692236 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.765488 26020 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.765978 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:15.766155 25918 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:15.767032 25918 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.768482 21818 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:15.692248 22581 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.769120 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:15.769634 21843 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.769989 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.770570 21850 raft_consensus.cc:2376] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8. Re-sending same reply.
I20260709 12:11:15.770602 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.771483 21846 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 12: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:15.771251 25900 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.772140 25993 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:15.773440 25900 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.773849 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.693959 22578 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.686393 21994 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:15.777449 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:15.657193 25985 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.027s	sys 0.019s
I20260709 12:11:15.685218 26026 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.682796 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.782683 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.782823 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.697950 25953 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.789335 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2420) took 1135 ms. Trace:
I20260709 12:11:15.790307 21994 rpcz_store.cc:276] 0709 12:11:14.653649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.652441 (+998792us) service_pool.cc:224] Handling call
0709 12:11:15.686066 (+ 33625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.777786 (+ 91720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.789075 (+ 11289us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b54000d3c50. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:15.789262 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76488448}
I20260709 12:11:15.792582 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.793812 21994 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.404680 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:15.703874 21995 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:15.708341 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2414) took 1106 ms. Trace:
I20260709 12:11:15.799294 21849 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:15.799162 21993 rpcz_store.cc:276] 0709 12:11:14.601712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.213867 (+612155us) service_pool.cc:224] Handling call
0709 12:11:15.708085 (+494218us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54002c6d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:15.708272 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007427456}
I20260709 12:11:15.719750 21739 maintenance_manager.cc:419] P 18e701898a2848c494bb06576eb2cdd4: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033392
I20260709 12:11:15.819285 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:15.721015 26015 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.564927 25552 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:15.725147 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.724434 25959 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.663633 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.737655 21967 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.740901 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2422) took 1086 ms. Trace:
I20260709 12:11:15.864516 22000 rpcz_store.cc:276] 0709 12:11:14.654194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.682176 (+1027982us) service_pool.cc:224] Handling call
0709 12:11:15.682502 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.740601 (+ 58099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.740833 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:15.741963 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2419) took 1088 ms. Trace:
I20260709 12:11:15.743628 26035 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.743973 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:15.693986 21996 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.730019 26036 consensus_queue.cc:237] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.873090 21852 raft_consensus.cc:2410] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:15.874078 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.755928 25474 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.757961 26005 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:15.718032 25999 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.758663 25952 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:15.875574 21852 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:15.876621 25952 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:15.876950 21852 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:15.759454 22001 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.738315 21998 rpcz_store.cc:276] 0709 12:11:14.596593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.602811 (+  6218us) service_pool.cc:224] Handling call
0709 12:11:14.805828 (+203017us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:11:14.806028 (+   200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.870860 (+ 64832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.870910 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.885085 (+ 14175us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.052796 (+167711us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:15.365543 (+312747us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.365869 (+   326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.365964 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.682478 (+316514us) raft_consensus.cc:1685] finished
0709 12:11:15.682574 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.682726 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62622,"prepare.queue_time_us":361939,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":61121,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":13211,"spinlock_wait_cycles":34551680,"thread_start_us":372662,"threads_started":2,"wal-append.queue_time_us":354087}
I20260709 12:11:15.881093 21998 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:15.881831 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2430) took 1150 ms. Trace:
I20260709 12:11:15.631114 25981 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.882767 25981 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.885229 25981 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:15.762233 21848 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.762965 26024 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:15.764590 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:15.764947 26022 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 12:11:15.886373 21851 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.887742 26024 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:15.785919 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.701381 21750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42850 (request call id 207) took 18906 ms (client timeout 15000 ms). Trace:
I20260709 12:11:15.800357 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.803356 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.891314 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.892164 21850 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.892884 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.882211 21998 rpcz_store.cc:276] 0709 12:11:14.731733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.880368 (+1148635us) service_pool.cc:224] Handling call
0709 12:11:15.880794 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.881545 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.881770 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:15.784832 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:15.894639 21998 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:15.802639 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.895331 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2431) took 1163 ms. Trace:
I20260709 12:11:15.895602 21920 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:15.895810 21998 rpcz_store.cc:276] 0709 12:11:14.732070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.893910 (+1161840us) service_pool.cc:224] Handling call
0709 12:11:15.894230 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.895046 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.895244 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:15.896634 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.897354 21998 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.897694 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:15.765609 25892 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:15.773543 25993 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:15.815250 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 64882.5us
I20260709 12:11:15.802882 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.818184 21924 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.827286 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:15.836766 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.820055 21927 raft_consensus.cc:2376] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8. Re-sending same reply.
I20260709 12:11:15.866086 21997 rpcz_store.cc:276] 0709 12:11:14.653397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.648579 (+995182us) service_pool.cc:224] Handling call
0709 12:11:15.648890 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.741682 (+ 92792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.741900 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:15.866035 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:15.868042 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 124313us
I20260709 12:11:15.868882 21918 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:15.869913 22583 raft_consensus.cc:1240] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:15.871960 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 134353us
I20260709 12:11:15.873090 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2423) took 1218 ms. Trace:
I20260709 12:11:15.898388 21920 raft_consensus.cc:2393] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:15.925722 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.926623 21920 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:15.898913 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:15.929450 21923 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:15.901382 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 67488.1us
W20260709 12:11:15.901767 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 60398us
I20260709 12:11:15.902427 21993 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.904874 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:15.901598 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:15.920063 21994 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:15.906972 21996 rpcz_store.cc:276] 0709 12:11:14.673886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.693550 (+1019664us) service_pool.cc:224] Handling call
0709 12:11:15.693820 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.872831 (+179011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.873029 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:15.905303 21967 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.956429 21927 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
W20260709 12:11:15.955997 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 54497.2us
W20260709 12:11:15.957027 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 51822.3us
I20260709 12:11:15.957952 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:15.903023 22000 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
W20260709 12:11:15.923329 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 86649.4us
W20260709 12:11:15.908349 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 244793us
I20260709 12:11:15.959908 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.962951 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.964095 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.961057 21964 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:15.898026 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2432) took 1165 ms. Trace:
I20260709 12:11:15.965112 21998 rpcz_store.cc:276] 0709 12:11:14.732425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.896706 (+1164281us) service_pool.cc:224] Handling call
0709 12:11:15.897096 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.897751 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.897963 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:15.966375 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.968467 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.965993 21851 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:15.973347 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:15.980825 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.974320 21892 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:16.005738 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 50829.8us
W20260709 12:11:16.005841 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50453us
W20260709 12:11:16.006996 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46023.3us
I20260709 12:11:16.007743 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:16.009004 26008 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.014395 21998 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:15.900110 26015 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.926370 26018 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:16.015278 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2438) took 1204 ms. Trace:
I20260709 12:11:15.908753 25996 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.022018 21998 rpcz_store.cc:276] 0709 12:11:14.810492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.967053 (+1156561us) service_pool.cc:224] Handling call
0709 12:11:16.014175 (+ 47122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.014954 (+   779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.015222 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.019188 21892 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.901014 25892 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:15.914788 21746 catalog_manager.cc:5697] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 4 to 6, term changed from 4 to 8, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65), VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 8 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:15.889817 21750 rpcz_store.cc:269] 0709 12:10:56.794840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.846133 (+ 51293us) service_pool.cc:224] Handling call
0709 12:10:57.393269 (+547136us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540041e1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d05090 00007f3be4da3f3a 00007f3beab59e9c 00007f3beac5804e 00007f3be91192a4 00007f3be9119232 00007f3be9119161 00007f3be91190dc 00007f3be9118392 00007f3be30d648c 00007f3be30d58c6
0709 12:11:15.701308 (+18308039us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:13.479870 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:13.519023 (+ 39153us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:13.519076 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:11:13.519096 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:13.520272 (+  1176us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:13.520356 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:13.520386 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:11:13.521336 (+   950us) tablet.cc:701] Row locks acquired
0709 12:11:13.521389 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:11:13.521576 (+   187us) write_op.cc:270] Start()
0709 12:11:13.521720 (+   144us) write_op.cc:276] Timestamp: P: 1783599073521515 usec, L: 0
0709 12:11:13.521743 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:11:13.541060 (+ 19317us) log.cc:844] Serialized 3954 byte log entry
0709 12:11:14.303062 (+762002us) op_driver.cc:464] REPLICATION: finished
0709 12:11:14.405653 (+102591us) write_op.cc:301] APPLY: starting
0709 12:11:14.405792 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:14.406054 (+   262us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:14.406197 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:14.407453 (+  1256us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:14.407836 (+   383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:11:14.407883 (+    47us) write_op.cc:312] APPLY: finished
0709 12:11:14.408215 (+   332us) log.cc:844] Serialized 77 byte log entry
0709 12:11:14.425320 (+ 17105us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:14.435554 (+ 10234us) write_op.cc:454] Released schema lock
0709 12:11:14.494785 (+ 59231us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:14.561192 (+ 66407us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:14.567471 (+  6279us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":211,"mutex_wait_us":2852628,"reported_tablets":29,"spinlock_wait_cycles":444342144,"child_traces":[["op",{"apply.queue_time_us":102084,"apply.run_cpu_time_us":3858,"apply.run_wall_time_us":135936,"num_ops":10,"prepare.queue_time_us":354719,"prepare.run_cpu_time_us":20682,"prepare.run_wall_time_us":261875,"raft.queue_time_us":346778,"raft.run_cpu_time_us":49146,"raft.run_wall_time_us":100065,"replication_time_us":781064,"thread_start_us":687898,"threads_started":4,"wal-append.queue_time_us":216182,"wal-append.run_cpu_time_us":20376,"wal-append.run_wall_time_us":1645796}]]}
I20260709 12:11:16.027845 21996 raft_consensus.cc:1240] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:16.035835 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2435) took 1302 ms. Trace:
I20260709 12:11:16.036326 21996 rpcz_store.cc:276] 0709 12:11:14.733428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.002561 (+1269133us) service_pool.cc:224] Handling call
0709 12:11:16.027589 (+ 25028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.035456 (+  7867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.035746 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:15.905730 25758 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.903518 26044 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:16.042843 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 69653.5us
I20260709 12:11:16.043638 21967 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:15.971463 25998 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.904279 25901 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:11:15.976475 26012 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:15.977274 26017 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.970783 26009 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.011924 26008 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:16.003511 25981 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:16.047644 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2439) took 1236 ms. Trace:
I20260709 12:11:16.074462 21998 rpcz_store.cc:276] 0709 12:11:14.810829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.022982 (+1212153us) service_pool.cc:224] Handling call
0709 12:11:16.047109 (+ 24127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.047295 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.047319 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:16.047360 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:16.047398 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.047465 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.047580 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.016076 25999 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.057782 21923 raft_consensus.cc:2468] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:15.976203 26024 consensus_queue.cc:1059] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 12:11:16.067472 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 59814.3us
I20260709 12:11:16.031970 26018 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:16.053491 26005 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.974445 26001 consensus_queue.cc:1059] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:11:16.018472 25794 consensus_queue.cc:1059] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:11:16.083189 26034 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:16.050630 25948 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.025462 25900 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:11:16.031114 26025 consensus_queue.cc:1059] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:11:16.030304 25664 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:11:16.094379 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:16.095239 22579 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:16.078620 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:16.078882 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 71978.3us
W20260709 12:11:16.078923 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 121043us
I20260709 12:11:16.093761 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:16.074178 25981 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.101454 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:16.096606 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:15.971052 25952 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.102867 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:16.105899 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.124142 22576 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.079926 26018 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:16.134213 21996 pending_rounds.cc:85] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 6
I20260709 12:11:16.137066 21996 pending_rounds.cc:107] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 8.7
W20260709 12:11:16.136058 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 93665.4us
I20260709 12:11:16.137626 21996 raft_consensus.cc:2889] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:16.080863 26009 raft_consensus.cc:3055] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:16.140574 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:16.108764 21746 catalog_manager.cc:5697] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 5 to 6, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 6 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.140666 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:16.142557 22584 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:16.146023 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.146485 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.142385 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:16.155902 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.100591 26034 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:16.154018 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:16.122560 25981 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:16.191151 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 88350.9us
I20260709 12:11:16.123929 26024 raft_consensus.cc:3055] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:16.192157 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 54084.3us
I20260709 12:11:16.192373 21964 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:16.134835 26020 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:16.135427 25985 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:16.140980 26017 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.208211 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:16.142289 26009 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:16.150700 26001 raft_consensus.cc:3055] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:15.899658 26016 consensus_queue.cc:1175] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" responder_term: 13 status { last_received { term: 12 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:16.168874 25552 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:16.176172 25956 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:15.905501 25951 consensus_queue.cc:1175] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" responder_term: 11 status { last_received { term: 8 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11. Ops: [10.8-10.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:16.165014 25948 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:16.226239 21964 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:16.196982 26024 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:16.204154 25880 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:16.204540 26010 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.212213 25985 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:16.290403 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 85019.2us
I20260709 12:11:16.291419 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:16.233569 26001 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:16.243952 26066 raft_consensus.cc:3055] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:16.244321 25956 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.249651 26020 consensus_queue.cc:1059] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:11:16.253189 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2418) took 1600 ms. Trace:
I20260709 12:11:16.240602 25918 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:16.242528 26036 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:16.286885 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 60745.3us
I20260709 12:11:16.320011 26004 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:16.324195 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.302314 25664 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:16.427309 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.347438 21995 rpcz_store.cc:276] 0709 12:11:14.653169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.598270 (+945101us) service_pool.cc:224] Handling call
0709 12:11:15.598728 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.798780 (+200052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.252925 (+454145us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002d14d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:16.253130 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241197952}
I20260709 12:11:16.164310 25892 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.349210 21746 catalog_manager.cc:5697] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 6 to 8, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 8 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
W20260709 12:11:16.347182 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 199430us
I20260709 12:11:16.352448 25758 raft_consensus.cc:3055] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:16.354053 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 256725us
I20260709 12:11:16.291472 25985 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.302181 25891 raft_consensus.cc:2804] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:16.276909 25552 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
W20260709 12:11:16.422554 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.423348 26047 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
W20260709 12:11:16.424118 26051 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
W20260709 12:11:16.425058 26050 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:11:16.430469 21927 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.304389 25880 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:16.432485 21851 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:16.410638 26046 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 12:11:16.340381 25998 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.338312 26066 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:16.338622 25956 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:16.408685 26058 log.cc:927] Time spent T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260709 12:11:16.348984 25918 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:16.439966 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.442118 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 71376.2us
I20260709 12:11:16.338939 26052 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.443882 25891 raft_consensus.cc:697] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:16.438735 25758 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:16.446383 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:16.360411 26009 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:16.346951 25948 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:16.547710 21993 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.006s
I20260709 12:11:16.568526 21993 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:16.570070 21927 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:11:16.570401 26064 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:11:16.563216 25998 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.571022 25474 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:16.572307 26060 log.cc:927] Time spent T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:11:16.572824 25998 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:16.573472 25891 consensus_queue.cc:237] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:16.573822 26066 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:16.430531 26034 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.575115 26066 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.576953 25758 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.578006 25758 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.582181 25880 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.565630 25918 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.584551 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 670) took 1987 ms. Trace:
I20260709 12:11:16.584946 21992 rpcz_store.cc:276] 0709 12:11:14.597235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.599083 (+  1848us) service_pool.cc:224] Handling call
0709 12:11:14.896315 (+297232us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b5800003698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:11:14.896514 (+   199us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:14.934687 (+ 38173us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:15.709682 (+774995us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b180045b980. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cab455 00007f3be87933c7 00007f3be4da59a7 00007f3be4dae5e5 00007f3be4dae568
0709 12:11:15.882915 (+173233us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.075930 (+193015us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:16.123445 (+ 47515us) log.cc:844] Serialized 52 byte log entry
0709 12:11:16.123600 (+   155us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.123826 (+   226us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.135441 (+ 11615us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.138757 (+  3316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.138847 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.458334 (+319487us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b180045b980. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:11:16.584319 (+125985us) raft_consensus.cc:1685] finished
0709 12:11:16.584343 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.584493 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19365,"prepare.queue_time_us":502738,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":10310,"raft.queue_time_us":11619,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":26322,"spinlock_wait_cycles":42541440,"thread_start_us":334251,"threads_started":2,"wal-append.queue_time_us":547033}
I20260709 12:11:16.587422 21992 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:16.587997 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1788) took 1413 ms. Trace:
I20260709 12:11:16.588280 21992 rpcz_store.cc:276] 0709 12:11:15.175081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.586966 (+1411885us) service_pool.cc:224] Handling call
0709 12:11:16.587264 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.587782 (+   518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.587953 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.589370 21992 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.435014 26036 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:16.548291 21995 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.478933 25794 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 12:11:16.593225 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2442) took 1781 ms. Trace:
W20260709 12:11:16.542550 25861 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.813s	user 0.013s	sys 0.000s
W20260709 12:11:16.565964 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.493276 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.437060 26008 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:11:16.446586 26013 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:16.598457 21995 rpcz_store.cc:276] 0709 12:11:14.811606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.459172 (+1647566us) service_pool.cc:224] Handling call
0709 12:11:16.548096 (+ 88924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.592938 (+ 44842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.593161 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.602718 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1791) took 1335 ms. Trace:
I20260709 12:11:16.603231 21992 rpcz_store.cc:276] 0709 12:11:15.256805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.588922 (+1332117us) service_pool.cc:224] Handling call
0709 12:11:16.589185 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.589661 (+   476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.592610 (+  2949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.604158 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2443) took 1287 ms. Trace:
I20260709 12:11:16.607059 21995 rpcz_store.cc:276] 0709 12:11:15.316752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.603043 (+1286291us) service_pool.cc:224] Handling call
0709 12:11:16.603365 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.603550 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.603818 (+   268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:16.603883 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.603919 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.603979 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.604092 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.608428 21995 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:16.608992 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2446) took 1253 ms. Trace:
I20260709 12:11:16.609328 21995 rpcz_store.cc:276] 0709 12:11:15.355947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.607952 (+1252005us) service_pool.cc:224] Handling call
0709 12:11:16.608245 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.608771 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.608942 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:16.573837 26061 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:11:16.604468 26036 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:16.602283 25463 consensus_meta.cc:287] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.001s
I20260709 12:11:16.602577 26052 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.601163 21997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.002s	sys 0.024s
I20260709 12:11:16.636232 21995 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:11:16.736187 21995 pending_rounds.cc:85] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 3
I20260709 12:11:16.736517 21995 pending_rounds.cc:107] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:16.736744 21995 raft_consensus.cc:2889] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:16.736773 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:16.735823 21997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.002s	sys 0.025s
I20260709 12:11:16.737452 22576 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:16.738641 25948 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:16.739216 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2448) took 1265 ms. Trace:
I20260709 12:11:16.694633 21746 catalog_manager.cc:5697] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 7 to 10, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 10 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
W20260709 12:11:16.696130 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.739650 21995 rpcz_store.cc:276] 0709 12:11:15.473616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.610017 (+1136401us) service_pool.cc:224] Handling call
0709 12:11:16.610283 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.738959 (+128676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.739160 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:16.740186 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.709817 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 514661us
W20260709 12:11:16.698693 22549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 2.210s (SENT) [suppressed 27 similar messages]
I20260709 12:11:16.741681 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:16.561874 25999 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:16.729637 26049 log.cc:927] Time spent T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.462s	user 0.000s	sys 0.001s
I20260709 12:11:16.732156 26009 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.532648 26024 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:16.651592 21815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.026s	sys 0.047s
W20260709 12:11:16.757944 21815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.032s	sys 0.047s
W20260709 12:11:16.758286 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 742519us
W20260709 12:11:16.747905 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.750033 21892 leader_election.cc:400] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:16.759509 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:16.728932 25994 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:16.455195 26001 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.763346 21995 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [10.10-11.11]
I20260709 12:11:16.764106 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 682) took 1016 ms. Trace:
I20260709 12:11:16.764469 21995 rpcz_store.cc:276] 0709 12:11:15.747874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.756484 (+1008610us) service_pool.cc:224] Handling call
0709 12:11:16.763111 (+  6627us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:16.763808 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.764024 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:16.764861 25901 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:16.766333 21893 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:16.757611 25948 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.767397 25948 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:16.756600 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2366) took 1284 ms. Trace:
I20260709 12:11:16.767895 25948 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.767839 21922 rpcz_store.cc:276] 0709 12:11:15.465651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.467601 (+  1950us) service_pool.cc:224] Handling call
0709 12:11:15.467954 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.502701 (+ 34747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.502745 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.513833 (+ 11088us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.877007 (+363174us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:15.877056 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.877136 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.749571 (+872435us) raft_consensus.cc:1685] finished
0709 12:11:16.749593 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.749742 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":33685,"thread_start_us":321762,"threads_started":1,"wal-append.queue_time_us":620997}
I20260709 12:11:16.770149 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:16.760152 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:16.763059 26076 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:16.742925 26052 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.766274 25901 consensus_queue.cc:1059] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:16.777184 25951 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.775372 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:16.610278 25956 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.777529 21921 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:16.792532 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:16.794198 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:16.783296 25843 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:16.803982 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.770476 25994 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:16.763371 26074 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.780856 25996 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.808316 25948 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:16.782349 25951 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.808108 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:16.780897 25999 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:16.904356 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 96360.4us
W20260709 12:11:16.810137 22584 consensus_meta.cc:287] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
W20260709 12:11:16.858655 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 64569.8us
I20260709 12:11:16.905895 22584 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:16.866714 26096 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:16.870863 26079 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:16.872030 26084 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:11:16.872493 26087 raft_consensus.cc:3055] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:16.916792 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:16.802449 25843 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:16.901496 25996 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:16.889819 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2372) took 1376 ms. Trace:
I20260709 12:11:16.881443 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 921) took 1190 ms. Trace:
W20260709 12:11:16.874167 26070 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:11:16.882370 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 673) took 2284 ms. Trace:
W20260709 12:11:16.885200 26083 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 12:11:16.857746 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:16.907482 21921 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:16.878577 26082 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:16.810871 26013 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:11:16.894068 26004 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.915182 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:16.873235 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.982738 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.930735 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:16.874100 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 919) took 1183 ms. Trace:
I20260709 12:11:16.799906 26076 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.923699 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:16.930235 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:16.917588 26087 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:16.905880 25951 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.892326 26088 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.119s
I20260709 12:11:16.944801 22001 rpcz_store.cc:276] 0709 12:11:14.598106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.398355 (+800249us) service_pool.cc:224] Handling call
0709 12:11:15.398674 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.877923 (+479249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.882125 (+1004202us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54002c5454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:16.882309 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829292416}
W20260709 12:11:16.971974 26095 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:16.975486 21921 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:16.919005 26019 consensus_meta.cc:287] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.208s	user 0.011s	sys 0.001s
W20260709 12:11:16.931484 26081 log.cc:927] Time spent T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
W20260709 12:11:16.934636 25981 consensus_meta.cc:287] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.002s
W20260709 12:11:16.932832 26069 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 12:11:16.943436 21918 rpcz_store.cc:276] 0709 12:11:15.506367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.506515 (+   148us) service_pool.cc:224] Handling call
0709 12:11:15.514684 (+  8169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.906384 (+391700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.882158 (+975774us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400170cd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:16.882373 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814080384}
W20260709 12:11:17.044319 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.911254 26096 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:16.983690 22583 rpcz_store.cc:276] 0709 12:11:15.690730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.691190 (+   460us) service_pool.cc:224] Handling call
0709 12:11:15.691567 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.904017 (+212450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.873815 (+969798us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54004d12d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:16.874009 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409726720}
W20260709 12:11:16.928820 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.969107 25996 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:16.968808 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 63524.4us
W20260709 12:11:16.985510 25993 consensus_meta.cc:287] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.077s	user 0.011s	sys 0.000s
I20260709 12:11:16.901724 26074 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.917685 25994 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:16.997933 26068 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.002560 26100 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.004802 25843 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.022511 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.064509 21922 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:17.065546 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.025277 21843 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:17.031313 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:17.043532 21926 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:11:16.944476 22577 rpcz_store.cc:276] 0709 12:11:15.691327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.691808 (+   481us) service_pool.cc:224] Handling call
0709 12:11:15.692506 (+   698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.905908 (+213402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.905938 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.905979 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:15.906007 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.881103 (+975096us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400715054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:16.881163 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.881360 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491250944}
I20260709 12:11:17.030578 21921 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.067442 21921 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.049409 21818 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:16.987056 26082 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:17.053048 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2440) took 2242 ms. Trace:
I20260709 12:11:17.030145 26079 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:16.991583 26004 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.066311 21922 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:17.077037 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2436) took 2343 ms. Trace:
I20260709 12:11:17.105515 22000 rpcz_store.cc:276] 0709 12:11:14.733737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.978350 (+1244613us) service_pool.cc:224] Handling call
0709 12:11:15.978712 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:16.012771 (+ 34059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.012810 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:16.026492 (+ 13682us) log.cc:844] Serialized 52 byte log entry
0709 12:11:16.158154 (+131662us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:16.158205 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.158290 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.076808 (+918518us) raft_consensus.cc:1685] finished
0709 12:11:17.076829 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.076979 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15448,"raft.queue_time_us":24782,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11125,"thread_start_us":90046,"threads_started":1,"wal-append.queue_time_us":649617}
I20260709 12:11:17.107409 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:17.108732 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:17.109263 22000 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:17.109809 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.076445 21996 rpcz_store.cc:276] 0709 12:11:14.811109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.037318 (+1226209us) service_pool.cc:224] Handling call
0709 12:11:16.072671 (+ 35353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.186560 (+113889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.186607 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.187154 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.300067 (+112913us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:16.300111 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.874999 (+574888us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b540018f1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:16.875054 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.884372 (+  9318us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:17.052833 (+168461us) raft_consensus.cc:1685] finished
0709 12:11:17.052859 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.052986 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187018880,"thread_start_us":21027,"threads_started":1,"wal-append.queue_time_us":330328}
I20260709 12:11:17.087272 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:17.093022 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1786) took 1930 ms. Trace:
I20260709 12:11:17.110777 21993 rpcz_store.cc:276] 0709 12:11:15.162543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.569455 (+1406912us) service_pool.cc:224] Handling call
0709 12:11:16.569785 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.570096 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.570124 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.591685 (+ 21561us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.708913 (+117228us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:16.708966 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.709062 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.092762 (+383700us) raft_consensus.cc:1685] finished
0709 12:11:17.092783 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.092932 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":390,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":116769,"threads_started":1,"wal-append.queue_time_us":219998}
W20260709 12:11:17.095793 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 64611.4us
W20260709 12:11:17.113618 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.096357 26019 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:17.097913 22001 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.105185 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.098620 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:17.099797 26074 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:17.101966 26015 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.071s	user 0.011s	sys 0.000s
W20260709 12:11:17.102543 26066 consensus_meta.cc:287] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.527s	user 0.002s	sys 0.008s
I20260709 12:11:17.054069 25993 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.051744 25981 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.115317 21995 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.056162 25664 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.116920 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:17.120271 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1890) took 1976 ms. Trace:
I20260709 12:11:17.060974 26052 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.104255 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:17.075896 26068 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:17.138772 21848 rpcz_store.cc:276] 0709 12:11:15.136172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.136299 (+   127us) service_pool.cc:224] Handling call
0709 12:11:15.136560 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.751744 (+615184us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b54000eb8a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d12dc0 00007f3be4d9d1c0 00007f3be4d9e231 00007f3be4d9ad8f 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c
0709 12:11:15.885940 (+134196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.112502 (+1226562us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b54000eb8a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d12dc0 00007f3be4d9ea02 00007f3be4d9add6 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:11:17.112712 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210532992}
I20260709 12:11:17.132085 26074 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:17.157681 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 79955us
I20260709 12:11:17.131280 25956 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:17.158730 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2434) took 2425 ms. Trace:
I20260709 12:11:17.160682 21997 rpcz_store.cc:276] 0709 12:11:14.733085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.902860 (+1169775us) service_pool.cc:224] Handling call
0709 12:11:15.903241 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.926694 (+ 23453us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:16.016438 (+ 89744us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.737629 (+721191us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.738108 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.738235 (+   127us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:16.738504 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.738677 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.738752 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.158487 (+419735us) raft_consensus.cc:1685] finished
0709 12:11:17.158509 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.158659 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24413,"prepare.queue_time_us":102760,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":89,"raft.queue_time_us":23027,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":6662,"thread_start_us":665901,"threads_started":1,"wal-append.queue_time_us":844770}
I20260709 12:11:17.138495 26066 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:17.161082 22000 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:17.165131 21921 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:11:17.166512 21921 pending_rounds.cc:85] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 5
I20260709 12:11:17.167086 21921 pending_rounds.cc:107] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 11.6
W20260709 12:11:17.166566 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 115089us
I20260709 12:11:17.167424 21921 raft_consensus.cc:2889] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.174260 21995 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:17.179205 21844 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:17.182340 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:17.185292 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 68450.3us
W20260709 12:11:17.199990 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.269666 21918 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:17.270354 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.157998 26076 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.158152 25999 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:17.148190 25664 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.119585 26079 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.232241 26080 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:17.225709 26062 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.480s	user 0.000s	sys 0.002s
W20260709 12:11:17.282119 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.152966 26096 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.204870 26068 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:17.270893 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 108050us
I20260709 12:11:17.271607 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2117) took 1468 ms. Trace:
I20260709 12:11:17.187080 26066 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.236675 26088 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:17.279400 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 102888us
W20260709 12:11:17.267328 26018 consensus_meta.cc:287] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.102s	user 0.010s	sys 0.004s
W20260709 12:11:17.272044 25985 consensus_meta.cc:287] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.761s	user 0.003s	sys 0.007s
I20260709 12:11:17.294162 21920 rpcz_store.cc:276] 0709 12:11:15.803197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.953238 (+150041us) service_pool.cc:224] Handling call
0709 12:11:15.954008 (+   770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.954277 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.954307 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.012585 (+ 58278us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.205531 (+192946us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:16.243702 (+ 38171us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.243949 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.244032 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.931994 (+687962us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:17.225424 (+293430us) raft_consensus.cc:1685] finished
0709 12:11:17.271397 (+ 45973us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.271546 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37828,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":11737,"raft.queue_time_us":175548,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8989,"spinlock_wait_cycles":41959680,"thread_start_us":136643,"threads_started":1,"wal-append.queue_time_us":532256}
W20260709 12:11:17.268947 25918 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.011s
I20260709 12:11:17.118966 26087 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:17.282934 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.158645 26019 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:17.268282 25956 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:17.279012 26074 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:17.284162 26111 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:17.287215 26076 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:17.341171 26079 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.341288 26076 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.329593 25918 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.342635 25956 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.343531 21996 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:17.344496 21847 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:17.344722 25956 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:17.288991 25664 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:17.277523 26101 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:11:17.292603 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:17.350298 26004 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.350466 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:17.272872 26094 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:17.303610 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.320945 26018 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.354491 26066 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.320719 25993 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:17.325555 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2385) took 1487 ms. Trace:
I20260709 12:11:17.191974 26082 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.328862 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.334650 21918 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:17.338507 26015 consensus_queue.cc:1059] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:11:17.338271 26108 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:11:17.328431 25985 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.339107 26074 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.340476 26111 consensus_queue.cc:1059] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:17.351608 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.355600 21994 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:17.357996 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 53176.8us
I20260709 12:11:17.354035 25918 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:17.356899 26094 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.356873 21923 rpcz_store.cc:276] 0709 12:11:15.838292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.110174 (+271882us) service_pool.cc:224] Handling call
0709 12:11:16.157011 (+ 46837us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:16.354878 (+197867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.354923 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:16.886871 (+531948us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b2c00000e98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:11:16.895344 (+  8473us) log.cc:844] Serialized 78 byte log entry
0709 12:11:17.055448 (+160104us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:17.289936 (+234488us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.290359 (+   423us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.294240 (+  3881us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.294987 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.307469 (+ 12482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.307534 (+    65us) raft_consensus.cc:1685] finished
0709 12:11:17.307552 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.325500 (+ 17948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103565,"prepare.queue_time_us":248900,"raft.queue_time_us":301597,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":102392,"spinlock_wait_cycles":192461440,"thread_start_us":359180,"threads_started":3,"wal-append.queue_time_us":146107}
I20260709 12:11:17.374816 21921 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:17.362723 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2118) took 1557 ms. Trace:
I20260709 12:11:17.344585 25951 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.290031 26080 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.345474 25463 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.368912 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2429) took 2637 ms. Trace:
I20260709 12:11:17.345158 26019 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.348577 26088 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 12:11:17.375432 26105 log.cc:927] Time spent T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:17.346903 25996 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.338353 26107 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:17.380991 21999 rpcz_store.cc:276] 0709 12:11:14.731383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.736609 (+1005226us) service_pool.cc:224] Handling call
0709 12:11:15.736860 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.750825 (+ 13965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.750870 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.782244 (+ 31374us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.918166 (+135922us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:15.930907 (+ 12741us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.931411 (+   504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.931488 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.277774 (+1346286us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b2400255728. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1b349c4 00007f3be1b32acb 00007f3be1ceddc9 00007f3be1ceda55 00007f3be1cecfb0 00007f3be4963488 00007f3be4963be8 00007f3be493b398 00007f3be493676a 00007f3be4935bb6
0709 12:11:17.362446 (+ 84672us) raft_consensus.cc:1685] finished
0709 12:11:17.368706 (+  6260us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.368852 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9602,"prepare.queue_time_us":13006,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":1455,"raft.queue_time_us":1468,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":21240,"spinlock_wait_cycles":32503168,"thread_start_us":55009,"threads_started":1,"wal-append.queue_time_us":613441}
I20260709 12:11:17.375617 21925 rpcz_store.cc:276] 0709 12:11:15.805491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.096319 (+290828us) service_pool.cc:224] Handling call
0709 12:11:16.152784 (+ 56465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.289199 (+136415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.306141 (+ 16942us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.307974 (+  1833us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.116405 (+808431us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b18002dfe80. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be49434bc 00007f3be1c9148b 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1
0709 12:11:17.116554 (+   149us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:17.299351 (+182797us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.353591 (+ 54240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.353676 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.353714 (+    38us) raft_consensus.cc:1685] finished
0709 12:11:17.362522 (+  8808us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.362670 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51266,"prepare.queue_time_us":205929,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":174649,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":43062,"spinlock_wait_cycles":12825344,"thread_start_us":405974,"threads_started":4,"wal-append.queue_time_us":258056}
I20260709 12:11:17.363816 26096 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.366273 25981 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.380470 25463 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:17.440426 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 118121us
I20260709 12:11:17.443557 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:17.451608 21920 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.444499 21922 raft_consensus.cc:2393] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:17.445303 25993 raft_consensus.cc:3055] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:17.445322 25918 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:17.445854 21925 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:17.446455 21921 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:17.447166 26015 consensus_queue.cc:1059] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:17.449278 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 124585us
W20260709 12:11:17.451027 21926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 2115) took 1641 ms (client timeout 2168 ms). Trace:
I20260709 12:11:17.466933 25993 raft_consensus.cc:740] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:11:17.470376 21926 rpcz_store.cc:269] 0709 12:11:15.802541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.802659 (+   118us) service_pool.cc:224] Handling call
0709 12:11:17.408799 (+1606140us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000415d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:17.444169 (+ 35370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2624729984}
I20260709 12:11:17.375797 26110 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:17.471067 25918 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.471524 26110 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:11:17.466987 26104 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.192s	user 0.000s	sys 0.006s
W20260709 12:11:17.481413 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 105674us
I20260709 12:11:17.473405 26076 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:17.472967 26020 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:11:17.493744 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:17.494402 21926 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:17.497756 25959 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:17.498325 21844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 625) took 1724 ms (client timeout 2018 ms). Trace:
W20260709 12:11:17.498775 21844 rpcz_store.cc:269] 0709 12:11:15.774311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.782528 (+  8217us) service_pool.cc:224] Handling call
0709 12:11:17.498136 (+1715608us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400208d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:17.498246 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3151961344}
I20260709 12:11:17.502770 26118 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.507261 21926 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:11:17.503319 26118 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.472491 26110 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.515355 26100 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:17.516062 26110 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:17.517413 26094 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:17.518091 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.508966 26065 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:17.519663 26065 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:17.520453 26065 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.521275 25981 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:17.521502 26065 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.521867 25981 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.513600 26118 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:17.523922 25981 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.514778 26019 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:17.515348 26026 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.533970 26010 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.535494 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2444) took 2198 ms. Trace:
I20260709 12:11:17.535992 21992 rpcz_store.cc:276] 0709 12:11:15.336716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.607087 (+1270371us) service_pool.cc:224] Handling call
0709 12:11:16.607400 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.936851 (+329451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.936901 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:16.936962 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:16.937017 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.530258 (+593241us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54002355d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:17.530298 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.535415 (+  5117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757045504}
I20260709 12:11:17.537598 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.539152 21995 raft_consensus.cc:1240] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:17.545662 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.534899 25985 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.547775 22000 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:17.496179 26018 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:17.549279 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:17.534498 26010 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.552161 21992 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:17.558660 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.557952 21920 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:17.552176 25981 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:17.533653 25993 consensus_queue.cc:260] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.565706 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.575748 21995 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:17.579288 26010 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.560688 26018 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:17.580149 26018 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.566565 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.574376 25993 raft_consensus.cc:3060] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.583855 21919 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:17.584254 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.583885 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.585099 21920 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:17.585902 21992 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:17.587968 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.588935 21920 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:17.564464 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:17.569186 26040 log.cc:927] Time spent T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.652s	user 0.007s	sys 0.003s
I20260709 12:11:17.596349 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:17.596838 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 45890.7us
I20260709 12:11:17.585114 26012 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.582337 26018 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:17.598017 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:17.604604 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 124082us
W20260709 12:11:17.602784 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.575780 26111 consensus_queue.cc:1243] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:17.596385 26010 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:17.607005 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.566232 25981 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.607983 21992 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:17.611102 21845 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:17.612300 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:17.613689 25956 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:17.597211 26005 consensus_queue.cc:1059] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:17.614329 25956 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.615415 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:17.614267 21850 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:17.616768 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:17.620734 25880 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:17.620873 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:17.621243 25880 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:17.622361 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:17.622213 25880 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.623418 25880 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.623620 25996 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:17.625834 21997 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:11:17.626542 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.626976 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:17.628665 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:17.631064 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.632642 21995 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [8.9-11.11]
I20260709 12:11:17.607501 26127 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:17.631980 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.608256 25552 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:17.635442 21997 raft_consensus.cc:1240] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.637262 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:17.645254 22576 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:17.631812 26080 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:17.640949 22001 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:11:17.640861 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 154131us
I20260709 12:11:17.643220 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:17.644002 22581 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:17.646601 22579 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:17.615408 25999 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.612741 26010 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:17.654976 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:17.655020 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:17.662391 21997 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:17.662951 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.665156 21921 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:11:17.670938 21922 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:17.651887 21818 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:17.608026 26108 consensus_queue.cc:1059] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:17.621017 25956 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:17.631852 26121 raft_consensus.cc:3055] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:17.686573 26121 raft_consensus.cc:740] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:17.689569 26025 raft_consensus.cc:3055] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:17.690097 26025 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:17.691154 26025 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.692459 26025 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:17.695186 21847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 624) took 1921 ms (client timeout 1889 ms). Trace:
W20260709 12:11:17.695782 21847 rpcz_store.cc:269] 0709 12:11:15.774050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.782372 (+  8322us) service_pool.cc:224] Handling call
0709 12:11:17.694922 (+1912550us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540024c554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:17.695094 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3083085184}
I20260709 12:11:17.697541 21925 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:17.699296 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2386) took 1854 ms. Trace:
I20260709 12:11:17.699687 21924 rpcz_store.cc:276] 0709 12:11:15.845056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.327733 (+482677us) service_pool.cc:224] Handling call
0709 12:11:16.328053 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.592904 (+264851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.592935 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:16.592975 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.593007 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.699063 (+1106056us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400040454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:17.699110 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.699243 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608687872}
I20260709 12:11:17.701749 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:17.702497 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 2384) took 2087 ms. Trace:
I20260709 12:11:17.702867 21919 rpcz_store.cc:276] 0709 12:11:15.615053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.652500 (+ 37447us) service_pool.cc:224] Handling call
0709 12:11:17.702295 (+2049795us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54001711d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:17.702443 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4423558016}
I20260709 12:11:17.703747 25981 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:17.704775 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.702541 21997 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:17.642976 26036 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:17.714496 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.715835 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:17.716442 21847 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:17.716473 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:17.681202 25891 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.718348 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:17.672618 25999 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.661262 25552 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:17.660245 25474 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:11:17.707631 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.709401 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:17.727787 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:17.615881 25664 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:11:17.713104 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.604152 26012 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.731590 25664 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:17.731734 21845 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:17.645570 26127 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.732123 25664 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:17.732519 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:17.733031 25664 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.733844 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:17.728467 22584 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
W20260709 12:11:17.735074 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 83255us
I20260709 12:11:17.735576 26094 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:17.728138 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.731665 21919 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:17.733903 26127 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.738180 26103 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.738371 21997 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:17.739038 25999 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.738754 26103 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:17.740845 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.740398 25552 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:17.741422 22547 leader_election.cc:336] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.239s (SENT)
I20260709 12:11:17.741809 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:17.651351 26128 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:17.756531 22001 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:11:17.757616 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.766052 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 112507us
I20260709 12:11:17.738696 25990 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.770804 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:17.772208 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:17.773468 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.778343 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:17.779665 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.784261 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 80187.2us
I20260709 12:11:17.785701 21893 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:17.721627 26005 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:17.771615 26026 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:17.760175 25956 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:17.742676 25891 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.722934 26036 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.784327 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.791097 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:17.767575 25892 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:17.798277 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:17.782359 25990 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.801919 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 851) took 1708 ms. Trace:
I20260709 12:11:17.806401 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2441) took 2995 ms. Trace:
W20260709 12:11:17.808775 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.808115 21964 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:17.771992 26080 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.824085 21964 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:17.819967 21998 rpcz_store.cc:276] 0709 12:11:14.811362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.085040 (+1273678us) service_pool.cc:224] Handling call
0709 12:11:16.101884 (+ 16844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.355573 (+1253689us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:17.364981 (+  9408us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.482260 (+117279us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.483023 (+   763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.483079 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:17.483128 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.806096 (+322968us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000c3fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:17.806157 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.806327 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11897,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1981,"raft.queue_time_us":346,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":2924,"spinlock_wait_cycles":2884036736,"thread_start_us":113822,"threads_started":1,"wal-append.queue_time_us":209957}
I20260709 12:11:17.819804 22578 rpcz_store.cc:276] 0709 12:11:16.093344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.093463 (+   119us) service_pool.cc:224] Handling call
0709 12:11:17.801684 (+1708221us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54005c0154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:17.801837 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213095808}
I20260709 12:11:17.783949 25999 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:17.802454 26130 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.810976 25996 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.781805 26065 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:11:17.841421 26020 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.846482 26020 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:17.847558 25990 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:17.847750 26096 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:17.802856 26026 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:17.843746 26127 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:17.814352 26005 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.809978 26109 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:17.851580 26026 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.848227 26096 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.819357 26128 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:17.792275 26010 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:17.916862 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.034157 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.977142 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 255992us
I20260709 12:11:17.999338 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:17.838270 25996 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:18.048084 21997 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:18.048209 25996 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.860091 21844 raft_consensus.cc:1275] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:11:17.875345 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 104480us
I20260709 12:11:18.053109 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:17.876150 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.002478 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 168447us
I20260709 12:11:18.055801 21966 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:18.061133 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 237146us
I20260709 12:11:17.837663 25474 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.049670 26128 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.851735 26135 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:18.131525 26135 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.939458 26020 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:18.077293 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:18.062361 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:18.121316 26089 log.cc:927] Time spent T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 1.131s	user 0.000s	sys 0.003s
I20260709 12:11:17.903196 25892 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:17.845467 26130 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.010076 26140 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:18.002228 26065 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:17.833194 26080 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.905435 25990 raft_consensus.cc:2764] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:11:18.151191 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 88910.3us
I20260709 12:11:18.022225 26012 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:17.906494 26146 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.298s
I20260709 12:11:18.020440 26036 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.160024 25880 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:18.171756 25892 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.060101 26052 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.135068 25474 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:17.958384 26143 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.217s
I20260709 12:11:18.183550 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:18.136121 26135 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.155566 21998 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:18.059136 26005 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:17.848874 25999 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.051604 26109 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.180236 26140 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:18.059150 26127 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.116241 26018 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:11:18.180819 25891 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.181020 26155 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:18.209856 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:18.207072 25474 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.208467 26096 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.211345 25880 raft_consensus.cc:697] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:18.236328 21964 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:18.247937 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:18.244417 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.250291 21926 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.227185 25990 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:18.229005 26135 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.209730 26036 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:18.229848 26150 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:18.277536 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 224500us
I20260709 12:11:18.253082 25891 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.283512 26036 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:18.287978 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:18.255364 25959 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.314733 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 106847us
I20260709 12:11:18.254670 26156 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:18.286827 25891 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.229562 26144 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:11:18.330086 21924 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.244666 26155 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.343734 26155 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:18.343853 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 277242us
I20260709 12:11:18.345129 26109 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:18.323341 26020 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:18.346002 26020 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.274535 25990 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.346787 25880 consensus_queue.cc:237] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.348064 25990 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.280427 26065 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:18.333083 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:18.333963 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:18.334590 21920 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:18.313674 25981 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.338883 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:18.339702 26152 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:11:18.339963 26005 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.279781 26158 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:11:18.341246 26121 consensus_queue.cc:260] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.341773 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:18.346369 26020 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.288473 26146 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:18.290225 26154 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:18.356315 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:18.357059 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:18.354882 26155 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:11:18.355600 21925 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:18.379948 21920 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:18.357226 26109 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.315937 25787 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:11:18.349937 25891 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.322546 26036 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:18.385601 26036 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.368114 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:18.368978 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:18.335345 26156 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:18.390995 26156 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.381363 21921 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:18.381299 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:18.389631 26036 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.318190 26160 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:18.392906 26160 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.395144 26160 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:18.391031 26005 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.395921 26005 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.392259 21851 raft_consensus.cc:2376] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13. Re-sending same reply.
I20260709 12:11:18.398340 26005 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.399070 26156 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.401371 26156 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.405493 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:18.405773 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 383976us
I20260709 12:11:18.406226 21924 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:18.407769 22547 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:18.409336 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:18.411401 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:18.426935 26162 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:18.427030 25891 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.430445 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:18.431092 21927 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.366061 26153 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.349072 25959 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:18.435036 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 66974us
I20260709 12:11:18.472658 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:18.430195 26025 consensus_meta.cc:287] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.000s
I20260709 12:11:18.434151 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:18.451061 21927 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:18.430747 25994 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.434751 26121 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:18.288252 26140 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:18.432269 26157 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:11:18.446318 22547 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:11:18.463490 26163 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:11:18.499325 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:18.447070 25891 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.456511 26156 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.507859 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:18.447342 26159 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.542589 26159 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.542999 26159 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.372090 25474 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.448417 25552 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:18.363521 25981 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.512423 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:18.556141 21993 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:18.557394 21993 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:18.512262 25892 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.500382 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:18.478811 26088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.014s	sys 0.021s
I20260709 12:11:18.513978 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:18.493543 21999 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:18.514019 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:18.517316 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:18.523640 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:18.524443 25948 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:18.383147 26146 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.526247 25956 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.533097 26005 consensus_queue.cc:1059] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:18.502642 26150 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:18.534225 26025 consensus_queue.cc:1059] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:18.535638 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:18.536623 26103 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.538054 26001 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.540457 26128 consensus_queue.cc:1059] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:18.466863 26080 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.448768 26170 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.482033 26130 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:18.410907 26109 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.554730 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:18.558971 21993 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:11:18.602810 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 48178.8us
I20260709 12:11:18.447827 26162 raft_consensus.cc:3055] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:18.561173 21992 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:18.410588 26154 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:18.567701 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 205927us
I20260709 12:11:18.564967 22001 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:18.544938 26012 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:18.515749 26127 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:18.553282 26143 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.606781 26012 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.607069 26143 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.609858 26012 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.467147 26166 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.121s
W20260709 12:11:18.611370 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.551962 25552 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.552239 26018 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:18.574556 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 128365us
I20260709 12:11:18.619585 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:18.480789 26153 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:18.580551 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 45011.7us
W20260709 12:11:18.622447 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.569531 26088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.014s	sys 0.022s
I20260709 12:11:18.586480 21998 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:18.468690 26065 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.591562 21997 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:18.550578 26156 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.571419 25956 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:18.599649 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:18.632831 21852 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:18.576442 25951 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:18.605607 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 194290us
I20260709 12:11:18.544796 25999 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.588536 26016 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.622972 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:18.575848 25948 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.567047 26145 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 12:11:18.625078 25892 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.611060 26162 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:18.619472 25552 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.618696 26170 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:18.649163 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:18.662876 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:18.705881 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 82979.1us
W20260709 12:11:18.696892 26026 consensus_meta.cc:287] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.001s
I20260709 12:11:18.629393 26088 consensus_queue.cc:1243] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:18.630249 26005 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:18.623428 25959 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:18.720953 22547 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:18.720255 21852 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:18.696205 25891 raft_consensus.cc:3055] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.629757 26012 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:18.697006 25996 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 12:11:18.632639 26165 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.621124 26143 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.732898 22547 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:18.635583 25956 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.661401 26156 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.665226 26146 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.680560 25981 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.678977 25463 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.703564 26016 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:18.761299 26016 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.664129 26109 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:18.662799 26153 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.681963 25474 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.729290 25901 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:11:18.635512 26150 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.678846 26154 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.736227 25891 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:18.776746 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2452) took 1680 ms. Trace:
I20260709 12:11:18.777307 21996 rpcz_store.cc:276] 0709 12:11:17.096734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.110818 (+ 14084us) service_pool.cc:224] Handling call
0709 12:11:17.111107 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.343881 (+232774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.776388 (+1432507us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002369d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:18.776653 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534135040}
I20260709 12:11:18.777827 25891 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.779330 25891 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.718071 26166 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.625900 26018 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:18.787446 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.737071 25892 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.744113 26005 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:18.820545 25948 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.821319 26165 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.823737 26129 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:18.826053 26140 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.844138 21995 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:18.728219 26162 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:18.827714 26167 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:11:18.728170 26026 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.744361 26158 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:11:18.743937 26012 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.747488 25996 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:18.884461 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 76345.8us
I20260709 12:11:18.848156 25892 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:18.847783 26129 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:18.860497 26154 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:18.879977 26162 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.894287 21918 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.906621 25892 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.906697 25951 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:18.911724 25951 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.915992 26012 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:18.916719 26175 log.cc:927] Time spent T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.239s	user 0.000s	sys 0.004s
I20260709 12:11:18.918998 21845 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:18.904062 25948 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.921401 26026 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.923095 25996 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.904223 26160 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.924058 26160 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.925314 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 685) took 1316 ms. Trace:
I20260709 12:11:18.926060 26160 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.921296 25948 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.928323 25948 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:18.929178 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.929617 26065 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:18.930181 26065 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.930779 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:18.932546 26065 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:18.936499 26020 consensus_meta.cc:287] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.002s
I20260709 12:11:18.937546 26018 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:18.937659 25951 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:18.898979 26036 consensus_meta.cc:287] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.505s	user 0.003s	sys 0.008s
I20260709 12:11:18.939754 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 959) took 1157 ms. Trace:
I20260709 12:11:18.946446 22584 rpcz_store.cc:276] 0709 12:11:17.782806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.782926 (+   120us) service_pool.cc:224] Handling call
0709 12:11:17.783226 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.526306 (+743080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.526354 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:18.526434 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.526489 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.939531 (+413042us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54007a0154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:18.939574 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.939699 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708239616}
I20260709 12:11:18.911175 21999 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:18.899535 26005 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.948307 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:18.925702 22000 rpcz_store.cc:276] 0709 12:11:17.608922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.609034 (+   112us) service_pool.cc:224] Handling call
0709 12:11:17.609288 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.639814 (+ 30526us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:17.728045 (+ 88231us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.030089 (+302044us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:18.030174 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:18.030244 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.925098 (+894854us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b540018e7d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:18.925142 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.925258 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17107,"prepare.queue_time_us":38351,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":46396,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":11352,"spinlock_wait_cycles":69523840,"thread_start_us":377472,"threads_started":3,"wal-append.queue_time_us":114973,"wal-append.run_cpu_time_us":1270,"wal-append.run_wall_time_us":1001420}
I20260709 12:11:18.944846 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:18.945374 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:18.887810 26170 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.952747 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:18.903855 25959 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.951975 22580 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:11:18.938490 26129 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:18.960757 26129 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.896447 26154 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.968686 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:18.968156 25959 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.981307 25959 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:18.959081 25951 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.983786 21892 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:18.976961 26012 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.964450 25952 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.979166 26177 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.298s	user 0.004s	sys 0.002s
I20260709 12:11:18.978905 26008 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:18.964740 25948 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.943704 26020 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:18.975919 25996 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:18.998164 25952 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.007035 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:19.014138 21892 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:19.005995 26189 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.016089 21849 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:19.017897 25951 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.018366 25951 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:19.018832 25951 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.018965 26024 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.027978 26082 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:11:19.014554 26036 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:11:19.036717 26036 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.037139 26036 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:19.040225 25918 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:19.040846 25918 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:19.041499 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2437) took 4276 ms. Trace:
I20260709 12:11:19.041380 25918 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.042049 21994 rpcz_store.cc:276] 0709 12:11:14.765379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.002650 (+1237271us) service_pool.cc:224] Handling call
0709 12:11:16.096211 (+ 93561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.373926 (+1277715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.041166 (+1667240us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003f2854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:19.041419 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2895971200}
I20260709 12:11:19.014652 25664 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.049791 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:19.051604 26154 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:19.062433 25994 consensus_meta.cc:287] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 12:11:19.065348 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:19.045055 26145 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:19.006700 25552 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:19.066166 21737 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1238ec38c933498cadf6153a5554f6e0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac07267c8cab47d4b59dc27d6fe9a386 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:19.016037 25948 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.073632 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:19.079052 26154 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.079180 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.079744 25959 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.080148 25787 raft_consensus.cc:3055] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:19.080377 26158 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.080502 26080 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.080636 25787 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:19.081123 26080 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:19.081627 26080 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.073825 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:19.075508 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:19.075524 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.085008 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.085301 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.085644 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.085937 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:19.086505 21924 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:19.086360 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.087751 21922 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:11:19.088058 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.089011 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.022303 26189 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:11:19.077980 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.089715 21925 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.089798 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.091414 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.092330 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.092370 21999 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:19.094352 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.094820 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.095710 21925 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:19.099309 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:19.084854 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.101378 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.101385 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.102290 21920 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:19.103127 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.105237 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.096861 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:19.107312 22549 leader_election.cc:336] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 2.210s (SENT)
I20260709 12:11:19.107641 21922 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:19.110921 26160 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:19.101505 26189 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:19.112947 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 490260us
I20260709 12:11:19.113415 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.102131 22582 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:19.113725 21920 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:19.021646 26159 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.121004 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.122906 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.138149 21920 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:19.140496 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.142897 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:19.142911 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44995.7us
I20260709 12:11:19.141752 21920 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:19.148475 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.026800 26012 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:11:19.149484 21997 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:19.149881 22579 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 13: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:19.150300 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.155646 21923 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:19.038026 26036 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.158303 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.159171 22582 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
W20260709 12:11:19.160588 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 61367.5us
I20260709 12:11:19.162912 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:19.162468 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:19.114769 26140 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.106479 26188 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:19.080164 25959 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:19.142290 26160 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.112716 25948 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.076490 26082 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
W20260709 12:11:19.173933 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 469748us
I20260709 12:11:19.175679 21817 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:19.169284 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.176685 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.081899 25787 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:19.168496 26121 consensus_meta.cc:287] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.001s
I20260709 12:11:19.175501 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:19.157855 26154 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.189033 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:19.168685 26119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.005s	sys 0.030s
I20260709 12:11:19.191210 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.169447 26165 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.198104 22575 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:19.204058 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.174600 25959 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.174919 26160 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.177759 25948 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.163146 26166 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:11:19.200440 26119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.005s	sys 0.030s
I20260709 12:11:19.152323 25956 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.177184 25985 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:19.175459 26016 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.175838 26140 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:19.225836 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.116710 26158 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.203958 26154 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.205998 26008 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.241036 22584 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:19.214102 26160 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.216347 25948 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:19.246500 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 70904.5us
I20260709 12:11:19.221230 25892 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:19.249655 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.267170 21998 raft_consensus.cc:2410] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:11:19.252895 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.254691 22577 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:11:19.268644 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.248420 22547 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:19.241855 26187 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:11:19.247393 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.236954 25787 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:19.274904 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.277724 22578 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:19.178356 26188 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.252357 25463 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.307874 21850 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.248494 26020 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:19.315502 21851 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:19.314232 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.252741 26008 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.317721 22576 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:19.259184 26110 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.321415 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:19.329398 22575 raft_consensus.cc:1240] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:19.316797 21852 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:11:19.311245 25463 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:19.325457 26186 log.cc:927] Time spent T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 12:11:19.325788 21923 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:11:19.330551 21923 pending_rounds.cc:85] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 7
I20260709 12:11:19.330879 21923 pending_rounds.cc:107] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:11:19.331185 21923 raft_consensus.cc:2889] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.242010 25985 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.336606 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.283720 26145 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.338014 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.335139 22582 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:19.342276 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:19.375418 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.386211 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.323333 25952 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:19.387223 22575 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
W20260709 12:11:19.311185 26190 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.265s	user 0.003s	sys 0.006s
W20260709 12:11:19.389039 26193 log.cc:927] Time spent T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:11:19.332851 25463 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.337361 26107 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:19.396327 26197 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:11:19.398483 26203 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:11:19.406400 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 146660us
I20260709 12:11:19.408579 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.412437 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.422156 21846 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 6.
I20260709 12:11:19.327276 26008 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.414601 26087 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.279193 25892 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.381654 25552 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.418567 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:19.387759 26145 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.406167 26159 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:19.453910 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.409608 26107 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:19.338533 26110 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.423024 26168 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:19.462435 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:19.461925 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.463714 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.467998 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.467825 21923 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:19.469395 26001 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.469617 21927 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.469945 26001 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.472613 26001 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:19.455160 26145 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.483666 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.487608 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.488590 21851 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:19.488755 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.497272 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2105) took 1878 ms. Trace:
I20260709 12:11:19.497853 21844 rpcz_store.cc:276] 0709 12:11:17.619064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.619173 (+   109us) service_pool.cc:224] Handling call
0709 12:11:17.619442 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.052538 (+433096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.496940 (+1444402us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54001da1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:19.497187 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552634240}
I20260709 12:11:19.500275 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.498793 26020 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.487244 26178 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.501233 25951 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.503078 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.501716 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.521309 21925 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.522192 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.513085 22580 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:11:19.523221 22580 pending_rounds.cc:85] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 10
I20260709 12:11:19.523499 22580 pending_rounds.cc:107] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:11:19.523718 22580 raft_consensus.cc:2889] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.521350 21922 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:19.519657 26178 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:19.527094 26204 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:19.504881 26107 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.528277 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2145) took 1240 ms. Trace:
I20260709 12:11:19.528481 26158 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.506244 26148 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.529310 26148 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.528682 21926 rpcz_store.cc:276] 0709 12:11:18.287713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.287960 (+   247us) service_pool.cc:224] Handling call
0709 12:11:18.288291 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.318975 (+ 30684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.319182 (+   207us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.344769 (+ 25587us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.927301 (+582532us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b1800353680. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:11:18.993562 (+ 66261us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.993604 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.993695 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.527989 (+534294us) raft_consensus.cc:1685] finished
0709 12:11:19.528009 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.528219 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30285,"raft.queue_time_us":44226,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":9066,"spinlock_wait_cycles":16495360,"thread_start_us":66075,"threads_started":1,"wal-append.queue_time_us":774107}
I20260709 12:11:19.528620 26107 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.535017 26154 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:19.539368 25985 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:19.519135 26020 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.543860 25892 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.544052 21852 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:19.485376 26159 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.551033 26159 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.552971 26008 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.556428 25959 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:19.561719 26196 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 12:11:19.570974 26205 log.cc:927] Time spent T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:11:19.574100 26008 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.584856 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.586288 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.586913 21998 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:19.588063 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.588846 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.590066 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.590837 21993 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:19.588862 21992 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:19.592332 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.597810 21999 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:19.600113 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 480613us
I20260709 12:11:19.601243 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:19.608376 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:19.610867 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:19.612397 22576 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:19.616036 21967 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:19.618815 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.619966 22582 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:19.621762 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.619400 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:19.620658 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:19.591048 26140 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:19.595541 25990 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.596486 26052 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.522330 25951 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:19.701421 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:19.494320 26168 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:19.660830 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 150269us
W20260709 12:11:19.710860 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.711001 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.712050 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:19.639904 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.628469 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.703984 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.644013 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:19.730774 21843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 633) took 2013 ms (client timeout 1950 ms). Trace:
W20260709 12:11:19.708956 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 107784us
I20260709 12:11:19.627501 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.731616 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.725876 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:19.679069 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.713948 22579 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:19.610327 25985 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.649523 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:19.730439 21844 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:19.734493 21925 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:11:19.622051 26080 consensus_meta.cc:287] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.003s
I20260709 12:11:19.607025 26158 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.737816 21994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.025s	sys 0.054s
I20260709 12:11:19.738307 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:19.748255 21994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.026s	sys 0.054s
W20260709 12:11:19.703145 26189 consensus_meta.cc:287] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.006s
W20260709 12:11:19.731171 21843 rpcz_store.cc:269] 0709 12:11:17.716894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.717501 (+   607us) service_pool.cc:224] Handling call
0709 12:11:19.703844 (+1986343us) spinlock_profiling.cc:243] Waited 997 us on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:11:19.730703 (+ 26859us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294144}
I20260709 12:11:19.744860 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:19.745667 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.756878 22576 raft_consensus.cc:2410] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:19.746793 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.700942 26018 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.757704 26018 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:19.758101 26018 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.638643 26144 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:19.762624 26144 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:19.763068 26144 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.764192 21926 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:19.764732 25952 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.765260 25952 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.750574 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.679791 26154 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.659238 26074 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.771425 26074 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.754968 21927 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:19.769094 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:19.767473 25952 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:19.774184 26074 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.783107 21844 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:19.714167 26188 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.736711 26052 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.806643 26052 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:19.806937 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.803536 21892 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:19.808980 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:19.809494 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1804) took 1317 ms. Trace:
I20260709 12:11:19.809865 21995 rpcz_store.cc:276] 0709 12:11:18.491916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.492119 (+   203us) service_pool.cc:224] Handling call
0709 12:11:19.809346 (+1317227us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400221d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:19.809440 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642890240}
I20260709 12:11:19.787853 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.659456 26130 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:19.678965 26024 consensus_queue.cc:1059] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:11:19.751611 26140 consensus_queue.cc:1059] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:11:19.713773 26161 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.729223 25959 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:19.797899 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59678.6us
I20260709 12:11:19.823150 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:19.797266 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 85311.8us
I20260709 12:11:19.825305 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:19.751875 26206 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:11:19.744278 25951 consensus_queue.cc:1059] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:11:19.808903 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.813369 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:19.808822 25552 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:19.814608 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 69914.3us
I20260709 12:11:19.814836 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.755692 25956 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.747805 26080 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.822343 21818 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:19.818399 25952 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:19.806699 26210 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:11:19.824731 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:19.809013 26025 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.808261 26103 raft_consensus.cc:3055] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.831245 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 2144) took 1579 ms. Trace:
I20260709 12:11:19.847988 21919 rpcz_store.cc:276] 0709 12:11:18.252286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.252422 (+   136us) service_pool.cc:224] Handling call
0709 12:11:19.808764 (+1556342us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d610a0 00007f3be9d60984 00007f3be32db6d4 00007f3be32db662
0709 12:11:19.831186 (+ 22422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3309440}
I20260709 12:11:19.795923 26189 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.836076 21843 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:19.855594 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:19.747540 25985 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.814109 26082 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.837002 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:19.819625 26161 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:19.831585 26124 raft_consensus.cc:3055] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.818250 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.747664 25990 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.879101 25990 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:19.879660 25990 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:19.880221 26144 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.881264 22580 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:19.881680 21998 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:19.884857 26208 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.885555 26208 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.841910 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.894660 21852 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:19.895565 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.896458 26208 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.896648 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.756757 26158 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:19.898768 26158 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.899117 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:19.898880 21998 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:19.906304 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.907517 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.908522 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.910399 25985 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:19.874221 26161 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:19.916239 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 295678us
I20260709 12:11:19.846390 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:19.847019 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:19.917493 21967 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:19.917991 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 71067.9us
I20260709 12:11:19.857369 21999 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:19.847528 25745 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.847630 26066 consensus_queue.cc:1059] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:19.860129 22000 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:19.860816 26211 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:19.841939 25891 consensus_meta.cc:287] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.062s	user 0.009s	sys 0.005s
I20260709 12:11:19.834376 26188 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.838562 26024 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.835584 25552 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:19.872726 26052 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.889765 26144 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:19.890913 25880 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:19.872897 26124 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:19.893517 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:19.816733 26150 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.919721 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:19.921139 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:19.848297 25951 consensus_queue.cc:1243] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:19.843592 26025 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.853463 26140 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.929268 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:19.824703 26130 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:19.853770 26103 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:19.946277 21818 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:20.015697 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 69489.9us
I20260709 12:11:19.947398 21920 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.952293 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:19.960565 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.019702 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:20.021323 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:19.985862 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:19.923313 26107 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.926519 25985 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.953140 25552 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.991576 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.001634 21925 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:19.985029 26052 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:19.948707 26024 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.008695 21851 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:20.010969 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.071861 21850 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
W20260709 12:11:20.011698 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 92099.7us
I20260709 12:11:20.073501 21967 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:20.075094 21967 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:20.025287 26209 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 12:11:20.019549 21844 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:20.015786 25951 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:20.033857 25787 consensus_meta.cc:287] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.002s
I20260709 12:11:20.012494 26025 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:20.035159 26087 consensus_meta.cc:287] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.005s
W20260709 12:11:20.035981 25463 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.613s	user 0.005s	sys 0.005s
W20260709 12:11:20.037431 26160 consensus_meta.cc:287] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.000s
I20260709 12:11:20.038585 26080 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:19.950131 26211 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.049060 21966 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.070468 26168 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:20.050649 25880 consensus_queue.cc:1048] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:20.051914 22000 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:20.061246 21843 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:20.063127 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:19.958766 26108 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:11:20.059471 26066 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:20.111917 26214 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:20.061719 26210 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:20.078927 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:20.132723 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.133442 21844 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:20.134745 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1822) took 1043 ms. Trace:
I20260709 12:11:20.135234 22001 rpcz_store.cc:276] 0709 12:11:19.091820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.092653 (+   833us) service_pool.cc:224] Handling call
0709 12:11:19.111238 (+ 18585us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:19.111659 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.111686 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:19.112292 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 12:11:19.464263 (+351971us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:19.464597 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.745395 (+280798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.745469 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.134486 (+389017us) raft_consensus.cc:1685] finished
0709 12:11:20.134510 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.134675 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122754,"prepare.queue_time_us":184,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":154725,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":22218,"spinlock_wait_cycles":29056,"thread_start_us":509751,"threads_started":2,"wal-append.queue_time_us":538538}
I20260709 12:11:20.022596 26150 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.080317 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.139298 21851 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:20.140491 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.141888 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.147925 26130 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.110908 25951 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.152719 25951 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.153430 25951 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.129755 26080 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:20.155185 26080 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.155833 26161 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.157244 26080 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.158157 26189 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.118173 26160 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.123855 26216 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.161243 21918 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.167297 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.082682 21967 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:20.061384 21993 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:20.059330 25952 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.114215 21848 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:20.050436 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.077688 26024 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:20.119680 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 70716.6us
I20260709 12:11:20.189150 21966 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.070989 26052 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.068333 26082 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.122099 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.072036 21999 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:20.081990 25891 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.115697 25463 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.178723 21844 raft_consensus.cc:2393] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:20.171866 21851 raft_consensus.cc:2410] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:11:20.178922 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 96331.9us
W20260709 12:11:20.191892 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 128905us
I20260709 12:11:20.204928 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:20.193989 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.196583 21843 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:20.206856 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.112144 26124 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.208859 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.161005 26160 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.212225 21925 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:20.188273 26216 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.158380 26161 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.209954 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:20.210209 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:20.210741 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.167147 25951 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.210855 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.222466 21851 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:20.222922 21967 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.188328 26015 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:20.206032 25948 consensus_meta.cc:287] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.925s	user 0.000s	sys 0.012s
I20260709 12:11:20.200132 26214 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.226032 21966 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.223644 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.217983 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.224913 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:20.199841 25891 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:20.251345 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:20.252038 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.224709 25951 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.212628 26082 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:20.254837 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 44728.4us
I20260709 12:11:20.254751 21844 raft_consensus.cc:2410] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:20.256527 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:20.262604 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:20.273347 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.274576 21843 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:20.275295 21851 raft_consensus.cc:2410] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:20.220695 26216 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:20.168365 26103 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.252698 25891 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.250173 26188 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.214982 25952 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:11:20.230261 26214 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:20.291368 21843 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:11:20.295977 21843 pending_rounds.cc:85] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 5
I20260709 12:11:20.296422 21843 pending_rounds.cc:107] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:20.296977 21843 raft_consensus.cc:2889] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.289686 21851 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:20.262073 26080 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.299387 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:20.302918 21851 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:20.264492 26168 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.305562 26168 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.278962 26160 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.289752 21844 raft_consensus.cc:2393] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:20.314986 25463 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.250449 26015 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.328938 21843 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.226624 26018 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.336144 26036 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.254804 26221 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
W20260709 12:11:20.289249 26145 consensus_meta.cc:287] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.788s	user 0.009s	sys 0.003s
I20260709 12:11:20.347664 22582 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:20.227535 26150 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:11:20.233363 25948 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.298580 26214 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.286319 26082 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.295881 26148 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:20.348212 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 135286us
W20260709 12:11:20.334892 26172 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.829s	user 0.000s	sys 0.010s
I20260709 12:11:20.287295 26216 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.348783 26103 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:20.334453 26220 log.cc:927] Time spent T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.161s	user 0.001s	sys 0.002s
I20260709 12:11:20.349712 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:20.344571 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 121732us
W20260709 12:11:20.347083 26222 log.cc:927] Time spent T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:11:20.362993 21921 raft_consensus.cc:2368] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9.
I20260709 12:11:20.338157 26025 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.365708 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.356032 26173 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.357748 26082 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.383536 26018 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.352506 26145 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.393965 21893 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:20.406383 21846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 630) took 2690 ms (client timeout 2210 ms). Trace:
I20260709 12:11:20.427928 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:20.388089 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 637) took 2023 ms. Trace:
I20260709 12:11:20.407279 21847 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:11:20.393906 21737 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1238ec38c933498cadf6153a5554f6e0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:11:20.349049 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 123138us
I20260709 12:11:20.406885 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 869) took 1235 ms. Trace:
W20260709 12:11:20.444352 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 50479.9us
I20260709 12:11:20.433954 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:20.488493 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 122894us
I20260709 12:11:20.487560 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:20.445837 21737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 51983.5us
I20260709 12:11:20.490864 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.491532 22580 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:20.493630 21818 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.516516 22579 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:20.510425 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:20.391870 26188 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.489363 22577 rpcz_store.cc:276] 0709 12:11:19.171734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.172487 (+   753us) service_pool.cc:224] Handling call
0709 12:11:20.406687 (+1234200us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54005a9bd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.406830 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130009856}
I20260709 12:11:20.489616 21852 raft_consensus.cc:2368] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
W20260709 12:11:20.443919 21846 rpcz_store.cc:269] 0709 12:11:17.716078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.716211 (+   133us) service_pool.cc:224] Handling call
0709 12:11:20.406202 (+2689991us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400381dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.406312 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3403575680}
I20260709 12:11:20.403290 26020 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:20.538673 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 45157.3us
I20260709 12:11:20.528453 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:20.540069 22578 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:11:20.529021 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 156844us
I20260709 12:11:20.370124 26008 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.492245 21817 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:20.543112 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 51015.3us
I20260709 12:11:20.408105 26159 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.444522 21849 rpcz_store.cc:276] 0709 12:11:18.364310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.364424 (+   114us) service_pool.cc:224] Handling call
0709 12:11:18.364742 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.016492 (+651750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.387826 (+1371334us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54003e3ad4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:20.388028 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497548672}
I20260709 12:11:20.445603 26162 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.553256 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.546924 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:20.529613 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:20.548789 21993 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:20.549347 21966 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:20.374779 26082 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.556348 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.386204 26160 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.558089 21993 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:20.560649 21817 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:20.561198 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:20.561822 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.397866 26211 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.408947 25918 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:20.564355 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:20.565027 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.384965 26140 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.584676 21966 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.567646 21919 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:20.407838 25952 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 12:11:20.387532 26178 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.407972 26080 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 12:11:20.398211 25948 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.559746 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.583964 21993 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.459182 26161 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:20.585530 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:20.568154 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.610809 21995 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:20.589038 21998 raft_consensus.cc:1240] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:20.374580 26173 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.564577 26162 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.571069 26235 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.544113 26148 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.408131 26225 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.162s
I20260709 12:11:20.551659 26188 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.551177 25463 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.599102 22583 raft_consensus.cc:2410] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:20.599268 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.399540 25552 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:20.601392 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.562925 26024 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.615142 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.568678 26159 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:20.609339 25787 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:11:20.619320 26110 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.567233 26233 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.620812 25880 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.615113 26161 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.624630 21925 raft_consensus.cc:2368] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:20.626896 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:20.746027 22576 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:20.587509 26066 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:20.628221 26218 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.641s	user 0.004s	sys 0.000s
W20260709 12:11:20.628321 26212 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.669s	user 0.001s	sys 0.000s
I20260709 12:11:20.569199 26221 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.571224 26231 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:20.634187 22577 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:20.708735 25952 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:20.596230 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:20.651259 26025 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.660570 25891 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:20.667066 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.754390 26161 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:20.753947 26066 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.680477 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 970) took 1007 ms. Trace:
I20260709 12:11:20.775427 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:20.681710 22581 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:11:20.683418 26077 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:20.700992 21999 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:20.597440 25918 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.705802 21846 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:20.563195 26008 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:20.743938 22582 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:20.790588 22582 pending_rounds.cc:85] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 10
I20260709 12:11:20.790884 22582 pending_rounds.cc:107] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:20.791132 22582 raft_consensus.cc:2889] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.642925 26189 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:20.750154 21927 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.690105 26225 consensus_queue.cc:1243] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:11:20.756186 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 171596us
I20260709 12:11:20.761202 21964 leader_election.cc:400] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:20.797319 21964 leader_election.cc:403] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.791877 25463 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.798197 25463 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.799013 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2115) took 1329 ms. Trace:
I20260709 12:11:20.799640 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1924) took 1048 ms. Trace:
I20260709 12:11:20.792096 26110 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.705677 26206 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.799522 21851 rpcz_store.cc:276] 0709 12:11:19.469947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.307746 (+837799us) service_pool.cc:224] Handling call
0709 12:11:20.308073 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:20.316517 (+  8444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.316552 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:20.330473 (+ 13921us) log.cc:844] Serialized 52 byte log entry
0709 12:11:20.759611 (+429138us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:20.759657 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.759733 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.798744 (+ 39011us) raft_consensus.cc:1685] finished
0709 12:11:20.798767 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.798945 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1750,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"thread_start_us":398361,"threads_started":1,"wal-append.queue_time_us":415132}
I20260709 12:11:20.801348 26206 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:20.761909 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59383.5us
I20260709 12:11:20.800153 21852 rpcz_store.cc:276] 0709 12:11:19.751401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.896425 (+145024us) service_pool.cc:224] Handling call
0709 12:11:20.799415 (+902990us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b540017e8d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.799568 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1291766016}
I20260709 12:11:20.708889 26159 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.803576 26159 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:20.803984 21848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 632) took 3087 ms (client timeout 1946 ms). Trace:
I20260709 12:11:20.804215 21852 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:11:20.804450 21848 rpcz_store.cc:269] 0709 12:11:17.716634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.717401 (+   767us) service_pool.cc:224] Handling call
0709 12:11:20.803818 (+3086417us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b5400207454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.803919 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5472215296}
I20260709 12:11:20.805675 21852 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:20.805774 21848 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:20.635744 21993 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:20.743170 26233 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:20.806978 26233 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.807132 26179 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.773229 21850 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:20.673851 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 634) took 2956 ms. Trace:
W20260709 12:11:20.678359 21845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 640) took 2203 ms (client timeout 2230 ms). Trace:
I20260709 12:11:20.807778 26179 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.808437 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2128) took 1076 ms. Trace:
W20260709 12:11:20.808583 21845 rpcz_store.cc:269] 0709 12:11:18.475135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.632331 (+157196us) service_pool.cc:224] Handling call
0709 12:11:20.678131 (+2045800us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400206554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.678280 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458043264}
I20260709 12:11:20.808836 21850 rpcz_store.cc:276] 0709 12:11:19.732269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.770779 (+1038510us) service_pool.cc:224] Handling call
0709 12:11:20.772853 (+  2074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.808191 (+ 35338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.808388 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.809406 26124 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.809757 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:20.751581 25951 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.810354 21845 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.681427 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 963) took 1733 ms. Trace:
I20260709 12:11:20.776142 22577 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.810391 26179 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.811421 22584 rpcz_store.cc:276] 0709 12:11:18.947953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.948074 (+   121us) service_pool.cc:224] Handling call
0709 12:11:20.681209 (+1733135us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54002cef54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.681361 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613726976}
I20260709 12:11:20.814361 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:20.815001 22584 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:20.815177 21852 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:11:20.815635 21852 pending_rounds.cc:85] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 4
I20260709 12:11:20.815440 21893 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:20.815858 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:20.773970 25952 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.816382 25996 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.817092 25996 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:20.817538 26016 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.818275 25996 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.819490 25891 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.802237 21851 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:20.821328 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1929) took 1029 ms. Trace:
I20260709 12:11:20.821750 21851 rpcz_store.cc:276] 0709 12:11:19.792248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.801634 (+1009386us) service_pool.cc:224] Handling call
0709 12:11:20.802027 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.821050 (+ 19023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.821265 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.808274 21847 rpcz_store.cc:276] 0709 12:11:17.717170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.717356 (+   186us) service_pool.cc:224] Handling call
0709 12:11:17.798782 (+ 81426us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800030f98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:11:20.406956 (+2608174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.446816 (+ 39860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.673515 (+226699us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b5400381dd0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.673724 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6000512128}
I20260709 12:11:20.823556 21851 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:20.815886 21852 pending_rounds.cc:107] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:20.827281 21852 raft_consensus.cc:2889] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.767822 26012 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:20.775241 22579 rpcz_store.cc:276] 0709 12:11:19.672921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.746612 (+ 73691us) service_pool.cc:224] Handling call
0709 12:11:20.680213 (+933601us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400733054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.680397 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711624960}
W20260709 12:11:20.785830 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 190392us
I20260709 12:11:20.835456 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.837296 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:20.839663 21926 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.840197 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:20.842137 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.843350 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.841461 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:20.800319 25463 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:20.812249 22583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 860) took 1737 ms (client timeout 1707 ms). Trace:
I20260709 12:11:20.787313 26034 raft_consensus.cc:3055] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:20.785880 26066 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.785403 26077 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:20.857353 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.846905 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.861068 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:20.866087 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 105057us
I20260709 12:11:20.863485 21923 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:20.864598 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:20.816421 22584 raft_consensus.cc:1813] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Handling vote request from an unknown peer 73070a828b23480e9c3588e376bce2ab
W20260709 12:11:20.854001 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 57193.2us
W20260709 12:11:20.870214 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 168886us
I20260709 12:11:20.856364 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:20.857059 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.782390 22578 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:20.870833 21966 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:20.848793 22583 rpcz_store.cc:269] 0709 12:11:19.074365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.074504 (+   139us) service_pool.cc:224] Handling call
0709 12:11:20.812047 (+1737543us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400655254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.812187 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3492149120}
I20260709 12:11:20.861399 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.860062 21817 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:20.874707 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:20.876098 22584 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:20.876912 25892 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.877379 25892 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.880743 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.855793 25994 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.863020 26179 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:20.848644 26145 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:20.884473 22577 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:20.888223 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:20.891104 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:20.889585 21845 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:20.897212 21923 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.893138 21817 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:20.854772 26034 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:20.882902 21919 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:20.860711 26140 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:20.894523 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.890686 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:20.872233 25891 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.835345 26189 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.898039 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:20.877768 25892 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:20.882915 26052 consensus_meta.cc:287] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.674s	user 0.006s	sys 0.005s
I20260709 12:11:20.906669 26145 consensus_queue.cc:1059] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:20.926739 26052 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.929345 26052 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:20.901098 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:20.907542 22578 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:20.908577 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:20.900224 21817 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:20.934437 22578 pending_rounds.cc:85] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 10
I20260709 12:11:20.934760 22578 pending_rounds.cc:107] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:20.934986 22578 raft_consensus.cc:2889] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.878875 25952 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.909548 26024 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.903621 26140 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.909859 26188 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.910631 25951 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.879143 26036 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:20.914525 26077 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.915151 26082 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.963434 26077 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.964794 26082 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.916164 26162 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.917209 25552 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:20.893036 26148 consensus_queue.cc:1059] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:11:20.967841 26148 raft_consensus.cc:3055] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:20.918015 26239 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:20.896096 26016 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.872712 25463 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:20.918951 26173 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:20.918998 26130 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.919837 26034 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:20.920671 26074 consensus_queue.cc:1059] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:11:20.903896 25880 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.878038 26211 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.855980 26012 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.935053 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:20.997700 22577 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:20.948385 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:20.954284 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1820) took 1863 ms. Trace:
I20260709 12:11:20.960237 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1918) took 1519 ms. Trace:
W20260709 12:11:20.961746 21921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 611) took 1867 ms (client timeout 2230 ms). Trace:
I20260709 12:11:20.917759 26189 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.969271 21818 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:20.907032 26179 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:20.930236 26110 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.899138 26005 consensus_queue.cc:1059] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 12:11:20.982024 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 73493.9us
I20260709 12:11:20.984020 21923 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:20.947301 26140 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.968278 26148 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:20.950114 26100 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.969718 26052 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.942806 26238 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:11:20.907909 26221 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:11:20.975144 26239 consensus_queue.cc:1243] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:20.999191 21843 rpcz_store.cc:276] 0709 12:11:19.441303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.298702 (+857399us) service_pool.cc:224] Handling call
0709 12:11:20.328746 (+ 30044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.331221 (+  2475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.960030 (+628809us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b54003813d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.960167 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68381440}
W20260709 12:11:20.999459 21921 rpcz_store.cc:269] 0709 12:11:19.094951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.101132 (+  6181us) service_pool.cc:224] Handling call
0709 12:11:20.961550 (+1860418us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540013a1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:20.961682 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899136768}
I20260709 12:11:20.974795 26016 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.021957 26016 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.023870 26179 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.017675 26189 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:21.026913 26148 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:20.992934 26161 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.027484 26189 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.028522 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1824) took 1856 ms. Trace:
I20260709 12:11:21.029429 26161 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.029765 26189 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:20.997044 26034 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:21.004828 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56576.9us
W20260709 12:11:21.020968 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 115277us
I20260709 12:11:20.974447 26036 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.007941 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:21.009075 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:21.011266 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:20.991273 25951 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.986842 26162 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.999065 21996 rpcz_store.cc:276] 0709 12:11:19.091209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.091340 (+   131us) service_pool.cc:224] Handling call
0709 12:11:19.091665 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:19.092060 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.092091 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:19.117262 (+ 25171us) log.cc:844] Serialized 52 byte log entry
0709 12:11:19.218892 (+101630us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:19.246312 (+ 27420us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.246606 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.246720 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.554313 (+307593us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b180000a2a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be8c6f58f 00007f3be1cae571 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd
0709 12:11:20.952002 (+1397689us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b2400255728. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1b349c4 00007f3be1b32acb 00007f3be1ceddc9 00007f3be1ceda55 00007f3be1cecfb0 00007f3be4963488 00007f3be4963be8 00007f3be493b398 00007f3be493676a 00007f3be4935bb6
0709 12:11:20.954048 (+  2046us) raft_consensus.cc:1685] finished
0709 12:11:20.954070 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.954219 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14533,"prepare.queue_time_us":23218,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":10168,"raft.queue_time_us":2992,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":38981,"spinlock_wait_cycles":68783744,"thread_start_us":46971,"threads_started":1,"wal-append.queue_time_us":229652}
I20260709 12:11:21.117249 26162 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:21.005791 26216 consensus_meta.cc:287] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
W20260709 12:11:21.017357 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 144279us
I20260709 12:11:21.120919 26216 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.122598 21992 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.124300 26216 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.031160 26025 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.015242 26024 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.031484 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.133802 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.133894 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.134874 21996 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:20.997385 26211 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.030651 26159 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:21.003525 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 551024us
I20260709 12:11:21.109997 26012 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:21.102137 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 94300.9us
I20260709 12:11:21.156172 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.074947 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.042682 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:21.056998 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.046648 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.065132 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.108078 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:21.107618 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 215476us
I20260709 12:11:21.101835 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:21.045418 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.160190 21843 raft_consensus.cc:2368] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:20.994661 26130 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.163709 22577 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:21.031297 26087 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:21.021405 26082 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:21.041282 26052 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:21.041182 26230 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.101658 26100 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:21.177011 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:21.181664 26012 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.183954 21995 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 12:11:21.108078 26178 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.015120 26235 consensus_queue.cc:1059] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:11:21.145650 26211 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:21.143244 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 111836us
I20260709 12:11:21.207705 21815 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.209479 26074 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.108346 25880 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.210341 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:21.164098 25891 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) with higher term. Message: Invalid argument: T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:20.932412 26008 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:21.151835 26243 log.cc:927] Time spent T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 12:11:21.152186 26145 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:21.144958 26110 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.152702 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 656) took 1097 ms. Trace:
I20260709 12:11:21.202793 26178 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.152827 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:21.159049 21966 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.162385 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:21.164727 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:21.233878 22577 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:21.166646 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.234890 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.168357 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.169409 26233 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.240950 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:21.170846 26087 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:21.171321 26082 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.172564 26052 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.194020 21850 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:21.135433 26024 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.195510 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:21.257941 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:21.195817 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:21.196269 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:21.196425 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:21.196465 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:21.258935 21922 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 11: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:21.132809 25951 raft_consensus.cc:697] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:21.198755 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 300884us
I20260709 12:11:21.260367 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:21.143149 22000 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 11: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:21.123344 26162 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.138592 26188 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:11:21.221860 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.267479 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.224519 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:21.267771 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 108906us
I20260709 12:11:21.268304 21925 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:21.138726 26170 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:21.227692 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:21.226184 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 74333.9us
I20260709 12:11:21.227200 21848 rpcz_store.cc:276] 0709 12:11:20.055642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.819733 (+764091us) service_pool.cc:224] Handling call
0709 12:11:20.825390 (+  5657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.835267 (+  9877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.835317 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.835798 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.015481 (+179683us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:21.015529 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.015602 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.152483 (+136881us) raft_consensus.cc:1685] finished
0709 12:11:21.152506 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.152633 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5197,"raft.queue_time_us":12797,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4598,"thread_start_us":179320,"threads_started":1,"wal-append.queue_time_us":278925}
I20260709 12:11:21.271118 21927 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 12: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:21.267069 26242 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:11:21.240127 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.243618 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.254272 26233 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:21.289853 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.254489 26082 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:21.264149 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 67823.5us
W20260709 12:11:21.293696 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 169401us
I20260709 12:11:21.226706 26129 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.237509 26178 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.269551 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:21.295351 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.268134 22000 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:11:21.299479 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.300364 22000 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:21.301644 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.264232 26024 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.210721 25880 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.179251 26100 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.255774 26087 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.295914 25891 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.278239 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.279680 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 863) took 2196 ms. Trace:
I20260709 12:11:21.327345 22581 rpcz_store.cc:276] 0709 12:11:19.083119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.083483 (+   364us) service_pool.cc:224] Handling call
0709 12:11:20.681379 (+1597896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.776179 (+ 94800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.279468 (+503289us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54002cef50. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:21.279590 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3674060544}
I20260709 12:11:21.328043 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.328934 21848 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:21.328820 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:21.329824 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.280826 25892 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.332405 25892 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:21.282163 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 621) took 1819 ms. Trace:
I20260709 12:11:21.333629 21920 rpcz_store.cc:276] 0709 12:11:19.463270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.463413 (+   143us) service_pool.cc:224] Handling call
0709 12:11:19.463722 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.055967 (+592245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.281887 (+1225920us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b540008f054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:21.282102 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069777280}
W20260709 12:11:21.334755 26253 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:11:21.335243 22578 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:21.277422 22547 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:21.289870 21851 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:21.330117 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:21.336856 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.337393 22581 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.337598 21851 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:21.229888 26124 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.294024 21892 leader_election.cc:400] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
W20260709 12:11:21.295403 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.345016 21892 leader_election.cc:403] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:21.303205 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.303452 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:21.345175 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 67870.7us
I20260709 12:11:21.345806 21848 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:21.346515 21993 raft_consensus.cc:2410] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:11:21.345471 21997 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.235407 26145 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:21.311112 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.302400 22000 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:21.313026 26018 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.272317 26012 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.274228 26255 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.319044 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.321257 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:21.275898 26260 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:21.357729 25951 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.342363 21925 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.362556 26260 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.363103 26260 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:21.265576 26251 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:11:21.326578 25891 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.348632 26254 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.294436 26188 consensus_queue.cc:1059] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:11:21.308799 26110 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.431991 26110 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.432399 26110 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:21.428668 26214 consensus_meta.cc:287] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.065s	user 0.011s	sys 0.004s
I20260709 12:11:21.434782 26214 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.434824 26211 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.435871 22001 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:21.438308 26178 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.440443 26178 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.442224 26214 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:21.447005 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 976) took 1530 ms. Trace:
I20260709 12:11:21.447404 22576 rpcz_store.cc:276] 0709 12:11:19.916693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.916859 (+   166us) service_pool.cc:224] Handling call
0709 12:11:19.917129 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.754024 (+836895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.446766 (+692742us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b540054a454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:21.446941 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905839872}
I20260709 12:11:21.449291 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 658) took 1080 ms. Trace:
I20260709 12:11:21.449656 21846 rpcz_store.cc:276] 0709 12:11:20.369201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.529315 (+160114us) service_pool.cc:224] Handling call
0709 12:11:21.449134 (+919819us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400207954. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:21.449234 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345960320}
I20260709 12:11:21.450752 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.378088 25891 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:21.355211 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 61335.7us
I20260709 12:11:21.361572 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.293109 26232 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:11:21.343648 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.308934 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:21.466172 21851 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.466288 22575 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:21.466521 22581 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:21.303993 26066 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.353538 26124 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:21.472245 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.472873 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 955) took 1044 ms. Trace:
I20260709 12:11:21.474210 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 953) took 1046 ms. Trace:
I20260709 12:11:21.320279 26252 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:11:21.417717 22580 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:21.311856 26129 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.434919 26188 raft_consensus.cc:3055] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:21.335745 26159 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.419230 21817 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.364041 26260 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:21.390918 26237 log.cc:927] Time spent T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.681s	user 0.002s	sys 0.005s
W20260709 12:11:21.370347 26103 consensus_meta.cc:287] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 1.002s	user 0.011s	sys 0.000s
I20260709 12:11:21.424732 21998 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:21.357858 26012 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:21.366575 26082 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:21.429015 21997 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:21.513728 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.514313 21997 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.430579 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.344672 25892 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:11:21.028906 21994 rpcz_store.cc:276] 0709 12:11:19.172163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.172304 (+   141us) service_pool.cc:224] Handling call
0709 12:11:19.172657 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:19.173054 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.173086 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:19.173698 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 12:11:19.748707 (+575009us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:20.627701 (+878994us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:21.027845 (+400144us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b18004256e0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be49434bc 00007f3be1c9148b 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cab455 00007f3be87933c7 00007f3be4da59a7 00007f3be4db50bf
0709 12:11:21.027994 (+   149us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.028220 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.028290 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.028327 (+    37us) raft_consensus.cc:1685] finished
0709 12:11:21.028338 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.028466 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1950,"prepare.queue_time_us":52941,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2729,"raft.queue_time_us":12289,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":11538,"spinlock_wait_cycles":75439360,"thread_start_us":579389,"threads_started":2,"wal-append.queue_time_us":663214}
I20260709 12:11:21.457707 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:21.461470 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:21.351552 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 56318.1us
I20260709 12:11:21.416826 26258 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:21.473425 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.475965 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2122) took 2003 ms. Trace:
I20260709 12:11:21.523829 21849 rpcz_store.cc:276] 0709 12:11:19.472295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.558656 (+1086361us) service_pool.cc:224] Handling call
0709 12:11:20.762996 (+204340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.763164 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.763189 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.763246 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:20.763274 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.763327 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.475847 (+712520us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54000901d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:21.475924 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469236608}
I20260709 12:11:21.525178 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.525348 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.476680 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 652) took 1610 ms. Trace:
I20260709 12:11:21.525853 21850 rpcz_store.cc:276] 0709 12:11:19.865993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.809687 (+943694us) service_pool.cc:224] Handling call
0709 12:11:20.810013 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.264397 (+454384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.476516 (+212119us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540024c554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:21.476636 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882657536}
I20260709 12:11:21.473218 22583 rpcz_store.cc:276] 0709 12:11:20.428517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.901783 (+473266us) service_pool.cc:224] Handling call
0709 12:11:20.932594 (+ 30811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.128717 (+196123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.128760 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.128818 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:21.128862 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.472663 (+343801us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540054db54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:21.472703 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.472821 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450466176}
I20260709 12:11:21.365114 26018 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.484541 26188 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:21.373359 26256 consensus_queue.cc:1059] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:11:21.474577 22582 rpcz_store.cc:276] 0709 12:11:20.427868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.515486 (+ 87618us) service_pool.cc:224] Handling call
0709 12:11:20.515890 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.791639 (+275749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.474004 (+682365us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540057c6d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:21.474153 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522986368}
I20260709 12:11:21.387497 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.535620 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:21.470332 26189 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:11:21.486814 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 67646.7us
I20260709 12:11:21.395026 26140 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.501593 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.541990 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:21.509459 21846 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:21.510879 21851 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:21.471144 26232 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:21.518487 21925 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:21.518605 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 57220.3us
I20260709 12:11:21.545457 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.545998 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:21.522639 21997 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:21.547281 21817 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.527902 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.548532 21996 raft_consensus.cc:2410] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:21.549275 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.493901 26211 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:21.423475 26130 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:21.467907 25996 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:11:21.494139 26214 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:21.565263 26214 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.533285 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:21.567049 26077 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.003s
I20260709 12:11:21.568706 26148 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.569216 26015 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.496438 25994 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.512742 26012 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.478549 26124 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.544402 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.549568 21817 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.554497 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.529464 26226 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.532703 26258 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.560639 26159 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.561703 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:21.580241 22583 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.557512 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2118) took 2086 ms. Trace:
I20260709 12:11:21.571434 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.572623 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.534034 26082 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.584022 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.584741 21852 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:21.574757 22584 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:21.575238 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.577531 21994 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:21.587821 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.532979 26251 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:11:21.607919 22000 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.546116 26230 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.535169 26034 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:11:21.554744 26239 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.575748 25956 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.591338 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2477) took 1045 ms. Trace:
I20260709 12:11:21.581007 21844 rpcz_store.cc:276] 0709 12:11:19.470950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.329139 (+858189us) service_pool.cc:224] Handling call
0709 12:11:20.329587 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.341098 (+ 11511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.341129 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.341575 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.444945 (+103370us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.444991 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.445093 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.354557 (+909464us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:21.543373 (+188816us) raft_consensus.cc:1685] finished
0709 12:11:21.543398 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.557414 (+ 14016us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":573,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":9635,"spinlock_wait_cycles":26500864,"thread_start_us":83949,"threads_started":1,"wal-append.queue_time_us":262034}
I20260709 12:11:21.606911 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.614811 21992 rpcz_store.cc:276] 0709 12:11:20.546258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.547407 (+  1149us) service_pool.cc:224] Handling call
0709 12:11:20.569637 (+ 22230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.122997 (+553360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.591124 (+468127us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54000c3fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:21.591282 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271261056}
I20260709 12:11:21.615414 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.615619 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.616012 21844 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:21.578730 25996 consensus_queue.cc:1243] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:21.588614 21994 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.585781 21850 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:21.606431 26082 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.609726 21817 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.579231 25994 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.578310 26238 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:21.577355 26145 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:21.586585 26077 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.645012 21994 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:21.658761 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.563171 26232 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.608816 26255 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:21.607754 25880 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:21.656876 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 110967us
I20260709 12:11:21.672834 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.679744 21992 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.682951 22000 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:21.640159 26239 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:21.653795 26159 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:21.695228 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 153293us
I20260709 12:11:21.698087 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.607602 26188 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.710399 21996 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 6.
I20260709 12:11:21.710822 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:21.670840 25996 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.713948 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:21.717669 21844 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
W20260709 12:11:21.697811 26264 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:11:21.725298 22549 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.728811 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 619) took 2323 ms. Trace:
I20260709 12:11:21.729084 26008 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.729249 21892 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:21.729741 26008 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.730497 26077 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.730885 26211 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.731657 21892 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:21.729239 21918 rpcz_store.cc:276] 0709 12:11:19.405227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.408529 (+  3302us) service_pool.cc:224] Handling call
0709 12:11:19.440541 (+ 32012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.177371 (+736830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.728594 (+1551223us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002e7054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:21.728760 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656886656}
I20260709 12:11:21.699728 26129 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.712424 26251 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.698396 26145 consensus_queue.cc:1059] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:11:21.750032 22576 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:21.684486 26255 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.723738 25892 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:21.744220 26272 log.cc:927] Time spent T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:11:21.777081 22583 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
W20260709 12:11:21.778362 26016 consensus_meta.cc:287] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.000s
I20260709 12:11:21.778704 26239 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.779706 26018 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.783741 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.798972 21843 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.784863 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:21.772022 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:21.786741 26140 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:21.737464 21992 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:21.659705 26238 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.771538 26275 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.740167 26254 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:21.795157 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.746385 26214 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.796459 22575 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.720383 25996 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:21.724035 26261 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:11:21.799851 22581 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:21.800856 26082 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:21.787171 26232 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.791987 26024 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.794080 25892 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:21.806977 26255 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:21.808209 26124 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.809341 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:21.752205 26258 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.819783 21843 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:21.729413 26280 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:11:21.743369 26077 consensus_queue.cc:1059] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:11:21.827812 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.830204 21849 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:21.837383 26283 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.832288 26254 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.798100 26016 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.842792 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:21.817898 26066 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.853324 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:21.856822 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.857316 21843 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.862879 21996 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.855568 26254 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.875593 26110 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:21.832084 26012 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:21.870994 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.849009 25892 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.849490 26082 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.850389 26008 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.881745 21851 raft_consensus.cc:2368] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:21.881933 21852 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:21.861943 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:21.856066 26267 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:21.879276 21997 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.879848 21843 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:21.844185 25891 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.892767 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:21.893195 26012 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:21.855675 26283 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.896306 26283 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.896420 21920 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.897145 21992 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:21.897807 26124 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:21.893198 25891 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.899552 26238 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:21.900635 26267 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:21.903468 21847 pending_rounds.cc:85] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 4
I20260709 12:11:21.903939 21847 pending_rounds.cc:107] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:21.904217 21847 raft_consensus.cc:2889] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:21.918749 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 56903us
I20260709 12:11:21.919656 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:11:21.874856 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 102916us
I20260709 12:11:21.925981 22583 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:21.930900 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:21.929253 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:21.934512 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:21.935097 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:21.921237 26252 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.941393 26012 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:21.945297 26012 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:21.945746 26012 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.950048 26280 raft_consensus.cc:3055] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:21.950579 26280 raft_consensus.cc:740] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:21.901562 26267 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:21.925267 26251 raft_consensus.cc:2764] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:21.968766 21843 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:21.955804 26124 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.958145 26291 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:21.998288 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:22.001704 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 64565us
I20260709 12:11:22.004045 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:21.965870 26077 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:22.009966 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:21.994892 26124 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:22.069670 21994 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:22.066210 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 109124us
I20260709 12:11:21.999620 26285 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:22.075714 21995 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:22.046641 26016 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:22.083063 26124 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:22.084947 26292 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.094940 26292 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:22.097208 26292 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:22.098024 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:22.098701 21844 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:21.999928 26291 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:22.107682 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 97796.2us
I20260709 12:11:22.126101 26025 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:22.126667 26025 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.136140 21995 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 12:11:22.116482 26296 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.118141 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:22.844853 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:22.845271 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2475) took 2306 ms. Trace:
I20260709 12:11:22.845856 22582 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:22.302222 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 879) took 1761 ms. Trace:
I20260709 12:11:22.212263 26012 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:22.190763 25892 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:22.893656 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:22.895066 26255 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:22.895713 25892 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:22.200757 26254 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:22.916760 26254 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:22.259222 26110 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:22.289431 26173 raft_consensus.cc:3055] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.190888 26025 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:22.924912 26025 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:22.140025 26226 consensus_meta.cc:287] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.003s
W20260709 12:11:22.966586 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 790182us
I20260709 12:11:22.155122 26298 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.970044 26298 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:22.191557 26291 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:22.165675 26286 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:11:22.140254 26301 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.487237 21993 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:22.545481 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2489) took 1254 ms. Trace:
I20260709 12:11:22.588234 26036 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:22.597846 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56610 (request call id 2140) took 1509 ms. Trace:
I20260709 12:11:22.979476 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 727) took 1021 ms. Trace:
I20260709 12:11:22.603945 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 2441) took 1375 ms. Trace:
I20260709 12:11:22.606184 26307 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.600520 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1932) took 1434 ms. Trace:
I20260709 12:11:22.614318 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1836) took 1455 ms. Trace:
W20260709 12:11:22.616488 21998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1829) took 1460 ms (client timeout 1857 ms). Trace:
I20260709 12:11:22.980262 21921 rpcz_store.cc:276] 0709 12:11:21.228189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.240728 (+ 12539us) service_pool.cc:224] Handling call
0709 12:11:22.603422 (+1362694us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540013a1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:22.603692 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735070592}
I20260709 12:11:22.980904 26307 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:22.981089 21998 rpcz_store.cc:269] 0709 12:11:21.155800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.155915 (+   115us) service_pool.cc:224] Handling call
0709 12:11:22.616090 (+1460175us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b5400236ed4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:22.616301 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166125312}
I20260709 12:11:22.606880 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2182) took 1265 ms. Trace:
I20260709 12:11:22.617508 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:22.982579 21920 rpcz_store.cc:276] 0709 12:11:21.340983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.342908 (+  1925us) service_pool.cc:224] Handling call
0709 12:11:21.343309 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.896835 (+553526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.606277 (+709442us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54002e8454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:22.606667 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271603072}
I20260709 12:11:22.983809 26307 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:22.620185 21927 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:11:22.619562 22001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2486) took 2047 ms (client timeout 2118 ms). Trace:
I20260709 12:11:22.983863 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:22.984807 22001 rpcz_store.cc:269] 0709 12:11:20.574819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.578630 (+  3811us) service_pool.cc:224] Handling call
0709 12:11:22.619171 (+2040541us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54000d3754. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:22.619360 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677471616}
I20260709 12:11:22.622514 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:22.621083 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:22.986367 21926 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:22.986652 21925 raft_consensus.cc:2393] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 12: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:22.624078 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:22.625707 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:22.979173 21992 rpcz_store.cc:276] 0709 12:11:21.291122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.852366 (+561244us) service_pool.cc:224] Handling call
0709 12:11:21.854497 (+  2131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.897533 (+ 43036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.544848 (+647315us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b54002364d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:22.545283 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97588608}
I20260709 12:11:22.666234 26168 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.988610 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:22.988729 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:22.638650 26206 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:22.714226 22580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58908 (request call id 988) took 1680 ms (client timeout 1966 ms). Trace:
I20260709 12:11:22.644161 26282 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:22.980928 21994 rpcz_store.cc:276] 0709 12:11:21.158610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.659940 (+501330us) service_pool.cc:224] Handling call
0709 12:11:21.660277 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.070244 (+409967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.613878 (+543634us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400235fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:22.614169 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888490880}
I20260709 12:11:22.658888 26154 raft_consensus.cc:3055] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.989681 21925 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:22.729097 25996 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:22.742056 26024 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:22.794209 21852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1941) took 1625 ms. Trace:
I20260709 12:11:22.990760 21922 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:11:22.991145 21852 rpcz_store.cc:276] 0709 12:11:21.169057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.728013 (+558956us) service_pool.cc:224] Handling call
0709 12:11:21.728311 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.882351 (+154040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.793442 (+911091us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400206a54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:22.793928 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352747392}
I20260709 12:11:22.811470 25891 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.993171 25891 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:22.812196 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:22.811561 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.815526 26077 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.814038 26189 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:22.839186 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1945) took 1617 ms. Trace:
I20260709 12:11:22.846530 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:22.849627 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:22.850963 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:22.845671 21999 rpcz_store.cc:276] 0709 12:11:20.539182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.539317 (+   135us) service_pool.cc:224] Handling call
0709 12:11:20.539595 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.785929 (+246334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.844766 (+2058837us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002355d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:22.845090 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345491328}
I20260709 12:11:22.852734 22578 rpcz_store.cc:276] 0709 12:11:20.540635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.947677 (+407042us) service_pool.cc:224] Handling call
0709 12:11:20.948035 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.335720 (+387685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.301884 (+966164us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54004ad3d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:22.302140 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889858432}
I20260709 12:11:22.844911 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2429) took 1986 ms. Trace:
I20260709 12:11:22.860761 26103 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.861300 26283 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:22.862594 26280 consensus_queue.cc:260] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:22.868737 26087 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:22.869343 25787 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.870918 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:22.873371 26020 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:22.886935 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.887571 26188 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.896243 21966 leader_election.cc:400] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:22.835808 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:22.897650 22583 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:22.899924 21844 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:22.900329 21848 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:22.898267 21851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1934) took 1731 ms (client timeout 2099 ms). Trace:
I20260709 12:11:22.906800 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:22.913595 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55322 (request call id 5) took 1681 ms. Trace:
I20260709 12:11:22.921790 26173 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:22.935940 26255 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.938448 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:22.939911 26252 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.940428 26025 consensus_queue.cc:1059] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:22.994177 21922 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:23.012791 22577 rpcz_store.cc:276] 0709 12:11:21.232188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.242868 (+ 10680us) service_pool.cc:224] Handling call
0709 12:11:22.912936 (+1670068us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54006a4da0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d18520 00007f3be4da1b42 00007f3be4da0800 00007f3be4d999fa 00007f3be9d614c9 00007f3be32ddc54 00007f3be32ddbe2 00007f3be32ddb11 00007f3be32dda8c 00007f3be32dcd42
0709 12:11:22.913401 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614864640}
I20260709 12:11:23.013371 26025 raft_consensus.cc:3055] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:23.013571 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:23.013965 26025 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:23.014495 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:23.015293 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:23.015661 21922 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.015411 26025 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.016376 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:23.016559 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:23.017416 26025 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.998050 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:23.018693 26252 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.018967 26087 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.019681 26173 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.021306 26252 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:23.019652 21926 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 12: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:23.021791 26255 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:22.982287 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:23.024608 21921 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:22.990295 26154 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:22.947852 26316 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:23.027513 26316 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.958990 26267 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:23.026490 21847 rpcz_store.cc:276] 0709 12:11:21.221488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.893904 (+672416us) service_pool.cc:224] Handling call
0709 12:11:21.894313 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:21.923337 (+ 29024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.923372 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:21.923992 (+   620us) log.cc:844] Serialized 52 byte log entry
0709 12:11:22.129195 (+205203us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:22.129235 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.129302 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.838691 (+709389us) raft_consensus.cc:1685] finished
0709 12:11:22.838738 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.838998 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17954,"raft.queue_time_us":18060,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3036,"thread_start_us":204873,"threads_started":1,"wal-append.queue_time_us":247535}
I20260709 12:11:23.021328 26087 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:23.028417 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:23.028992 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:23.028445 26267 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.029714 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:23.027249 26154 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.031558 26267 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:23.031926 26154 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.983976 21849 rpcz_store.cc:276] 0709 12:11:21.166278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.524942 (+358664us) service_pool.cc:224] Handling call
0709 12:11:22.600174 (+1075232us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54000a87d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:22.600351 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663836928}
I20260709 12:11:23.034714 26283 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:23.035997 22581 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:23.036377 26283 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:22.990000 26282 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:23.037817 21851 rpcz_store.cc:269] 0709 12:11:21.166876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.544225 (+377349us) service_pool.cc:224] Handling call
0709 12:11:22.897887 (+1353662us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540011dfd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:22.898121 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706974464}
I20260709 12:11:23.038837 26280 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.039263 22575 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:23.039536 26282 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:22.967015 26226 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.123916 26292 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:22.286301 26211 raft_consensus.cc:3055] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:23.048584 21922 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:23.048899 26255 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:23.049006 26211 raft_consensus.cc:740] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:23.018553 21924 rpcz_store.cc:276] 0709 12:11:20.857904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.858520 (+   616us) service_pool.cc:224] Handling call
0709 12:11:20.858888 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.019184 (+160296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.019215 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.019255 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:21.019288 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.844400 (+1825112us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54001928d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:22.844462 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.844708 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368196864}
I20260709 12:11:23.018477 22582 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:22.971691 26298 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:22.976675 26238 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:23.058473 21924 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:23.058705 26238 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:22.979594 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 1938) took 1811 ms. Trace:
I20260709 12:11:22.985298 21918 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.985666 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:22.980189 21993 rpcz_store.cc:276] 0709 12:11:21.958217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.478092 (+519875us) service_pool.cc:224] Handling call
0709 12:11:22.483385 (+  5293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.979105 (+495720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.979379 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.988837 26168 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:22.668295 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 880) took 2127 ms. Trace:
I20260709 12:11:22.721477 25951 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:22.980018 21846 rpcz_store.cc:276] 0709 12:11:21.088345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.450495 (+362150us) service_pool.cc:224] Handling call
0709 12:11:22.597432 (+1146937us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b5400341cd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:22.597618 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133488384}
W20260709 12:11:22.989538 22580 rpcz_store.cc:269] 0709 12:11:21.033813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.101447 (+ 67634us) service_pool.cc:224] Handling call
0709 12:11:22.713813 (+1612366us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400715054. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:22.714018 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488849664}
I20260709 12:11:22.722173 25552 raft_consensus.cc:3055] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.718952 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 963) took 1206 ms. Trace:
I20260709 12:11:23.025753 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:23.030809 26189 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.040640 21847 pending_rounds.cc:85] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 3
I20260709 12:11:23.021989 26173 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.028074 26316 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:23.046392 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 157267us
I20260709 12:11:22.984287 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:23.047428 26024 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:22.968400 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:23.047750 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 52284.3us
I20260709 12:11:23.047717 26077 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:22.994791 25996 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.047435 21923 raft_consensus.cc:2393] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:22.897327 26012 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:23.050271 26211 consensus_queue.cc:260] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:22.988987 21967 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:23.226944 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:23.018316 22578 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:23.227660 21852 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 12:11:23.059808 21851 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:23.191627 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:23.225070 21746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58736 (request call id 280) took 25328 ms (client timeout 15000 ms). Trace:
I20260709 12:11:23.192941 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:23.169288 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.245651 22579 rpcz_store.cc:276] 0709 12:11:21.511976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.512085 (+   109us) service_pool.cc:224] Handling call
0709 12:11:22.716814 (+1204729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.717280 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.717302 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.717356 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:22.717385 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.717472 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.718649 (+  1177us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400715050. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:22.718798 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2769884544}
I20260709 12:11:23.244429 21847 pending_rounds.cc:107] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:23.248122 22584 rpcz_store.cc:276] 0709 12:11:20.540877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.955356 (+414479us) service_pool.cc:224] Handling call
0709 12:11:20.955693 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.585299 (+629606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.667578 (+1082279us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b540060f254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:22.668140 (+   562us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423198592}
I20260709 12:11:23.258035 21920 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.253473 21847 raft_consensus.cc:2889] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:22.996596 25891 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:23.245421 25552 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:23.246196 25951 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:23.262943 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 277010us
I20260709 12:11:23.154026 26252 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:23.228000 26238 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:23.266042 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 370132us
I20260709 12:11:23.229141 26292 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:23.248642 26267 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.270797 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:23.276625 21843 raft_consensus.cc:2368] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:23.275309 21818 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:23.265507 26211 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.250108 21850 rpcz_store.cc:276] 0709 12:11:21.168025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.718602 (+550577us) service_pool.cc:224] Handling call
0709 12:11:21.719192 (+   590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.787795 (+ 68603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.787841 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.793834 (+  5993us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.939345 (+145511us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:21.939400 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.939475 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.977400 (+1037925us) raft_consensus.cc:1685] finished
0709 12:11:22.977451 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.979386 (+  1935us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52470,"raft.queue_time_us":71468,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3813,"thread_start_us":90700,"threads_started":1,"wal-append.queue_time_us":122557}
I20260709 12:11:23.282266 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:23.262091 26024 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:23.048902 25787 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.282158 25891 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:23.021695 26103 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.291139 26179 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.292219 26168 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:23.291972 26179 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.293668 25787 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:23.291755 26024 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:23.296428 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 226330us
I20260709 12:11:23.271272 26252 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:23.295089 21852 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
W20260709 12:11:23.304054 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 44534.9us
W20260709 12:11:23.307152 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.171046 21737 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1238ec38c933498cadf6153a5554f6e0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:23.313005 21849 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:23.315722 21845 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:23.299605 26012 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:23.294286 26179 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:23.315527 21893 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.68:40043 timed out after 1.966s (SENT) [suppressed 8 similar messages]
I20260709 12:11:23.294404 25891 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.323025 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:23.330258 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:23.331545 21999 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:23.322813 21737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 152013us
W20260709 12:11:23.332752 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56231.4us
I20260709 12:11:23.336544 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:23.336814 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:23.337464 21992 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.309691 26255 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.340736 21966 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:23.344318 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:23.294478 21748 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 4 to 6, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 6 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:23.318102 26206 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:11:23.349074 22001 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.348927 26087 consensus_queue.cc:1059] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:23.350037 26087 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:23.350438 26087 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:23.350744 26170 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:23.351223 26170 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:23.329319 26267 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.351485 26087 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.352450 26170 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.353070 26087 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.353942 26170 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.345821 21817 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:23.333647 25787 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:23.298287 26292 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:23.357368 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.359937 21920 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:23.340055 26255 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:23.361639 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 393546us
I20260709 12:11:23.337980 26036 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.340245 26012 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:23.370661 22022 debug-util.cc:398] Leaking SignalData structure 0x7b08002855e0 after lost signal to thread 20708
I20260709 12:11:23.370767 21964 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:23.371711 26238 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:23.371796 26235 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:23.323535 25552 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.373304 26235 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:23.373466 25552 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.373834 26235 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:23.374665 25892 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.375283 25892 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.376387 25951 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.377488 25951 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.377758 25892 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:23.379942 21964 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:23.381438 26150 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.381836 26150 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:23.381924 22549 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:23.390695 26020 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:23.391063 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 61259.9us
I20260709 12:11:23.391369 26077 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:23.391678 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:23.392272 26020 consensus_queue.cc:1059] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:23.393679 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:23.382229 26150 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:23.393760 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 94490.6us
I20260709 12:11:23.382534 26168 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.339941 26316 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.382897 26258 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:23.383069 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:23.383911 26036 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.384982 26238 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:23.393740 26318 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:23.404780 26179 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:23.404932 26318 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:23.405426 26179 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:23.406287 26318 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.406534 26179 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.407792 26318 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.360715 25787 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.354257 26267 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:23.395747 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:23.365427 26255 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.396458 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:23.367157 21748 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 6 to 7, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 7 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:23.399317 21918 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:23.401428 26258 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:23.400470 26254 raft_consensus.cc:2764] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:11:23.403146 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 140529us
I20260709 12:11:23.403788 26110 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:23.372087 22022 debug-util.cc:398] Leaking SignalData structure 0x7b0800212820 after lost signal to thread 21784
W20260709 12:11:23.435760 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.407109 26316 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:23.406553 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.436571 22001 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
W20260709 12:11:23.436777 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.395843 21999 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
W20260709 12:11:23.419000 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62551.6us
I20260709 12:11:23.432955 26258 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.433049 26235 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.434229 26261 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.440527 25891 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:23.447184 26103 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:23.447841 26036 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:23.448004 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 52501.9us
I20260709 12:11:23.448424 21994 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.449266 26189 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:23.448917 21748 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 10, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 10 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:23.248903 21746 rpcz_store.cc:269] 0709 12:10:57.896650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.913999 (+ 17349us) service_pool.cc:224] Handling call
0709 12:10:58.035081 (+121082us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54002eff90. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c770b2 00007f3beabf0759 00007f3beab88a76 00007f3beab59d58 00007f3beac5804e 00007f3be91192a4 00007f3be9119232 00007f3be9119161 00007f3be91190dc
0709 12:10:58.251820 (+216739us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54002eff90. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76e9c 00007f3be1c770f6 00007f3beabf0759 00007f3beab88a76 00007f3beab59d58 00007f3beac5804e 00007f3be91192a4 00007f3be9119232 00007f3be9119161 00007f3be91190dc
0709 12:10:58.654656 (+402836us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540041e1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d05090 00007f3be4da3f3a 00007f3beab59e9c 00007f3beac5804e 00007f3be91192a4 00007f3be9119232 00007f3be9119161 00007f3be91190dc 00007f3be9118392 00007f3be30d648c 00007f3be30d58c6
0709 12:11:23.224829 (+24570173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:17.148911 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:17.272749 (+123838us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:17.275412 (+  2663us) write_op.cc:435] Acquired schema lock
0709 12:11:17.278667 (+  3255us) tablet.cc:662] Decoding operations
0709 12:11:17.384788 (+106121us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:17.450899 (+ 66111us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:17.467839 (+ 16940us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:11:17.490040 (+ 22201us) tablet.cc:701] Row locks acquired
0709 12:11:17.490916 (+   876us) write_op.cc:260] PREPARE: finished
0709 12:11:17.494606 (+  3690us) write_op.cc:270] Start()
0709 12:11:17.494721 (+   115us) write_op.cc:276] Timestamp: P: 1783599077494555 usec, L: 0
0709 12:11:17.494744 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:11:17.496821 (+  2077us) log.cc:844] Serialized 1684 byte log entry
0709 12:11:17.796035 (+299214us) op_driver.cc:464] REPLICATION: finished
0709 12:11:17.858833 (+ 62798us) write_op.cc:301] APPLY: starting
0709 12:11:17.858939 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:17.859637 (+   698us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:17.859762 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:17.860220 (+   458us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:17.860515 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:11:17.860582 (+    67us) write_op.cc:312] APPLY: finished
0709 12:11:17.957514 (+ 96932us) log.cc:844] Serialized 41 byte log entry
0709 12:11:17.957728 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:17.957843 (+   115us) write_op.cc:454] Released schema lock
0709 12:11:17.957890 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:18.021485 (+ 63595us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:18.051257 (+ 29772us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":864059,"reported_tablets":47,"spinlock_wait_cycles":584940416,"child_traces":[["op",{"apply.queue_time_us":48501,"apply.run_cpu_time_us":3465,"apply.run_wall_time_us":149976,"num_ops":4,"prepare.queue_time_us":250808,"prepare.run_cpu_time_us":34178,"prepare.run_wall_time_us":471705,"raft.queue_time_us":153231,"raft.run_cpu_time_us":8230,"raft.run_wall_time_us":29626,"replication_time_us":301113,"thread_start_us":423360,"threads_started":4,"wal-append.queue_time_us":109505,"wal-append.run_cpu_time_us":68140,"wal-append.run_wall_time_us":1413788}]]}
I20260709 12:11:23.454619 26168 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.456933 26238 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.457659 26012 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.414636 25787 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.459843 22577 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:23.460187 26292 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:23.435128 26252 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:23.464200 22022 debug-util.cc:398] Leaking SignalData structure 0x7b0800101bc0 after lost signal to thread 21876
W20260709 12:11:23.472627 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 157117us
W20260709 12:11:23.472831 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.470968 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:23.476963 21818 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:23.450580 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.488432 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 94872.7us
I20260709 12:11:23.476910 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:23.484561 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:23.488837 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.491524 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:23.492281 21920 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:23.501276 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:23.502482 21924 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
W20260709 12:11:23.502743 22022 debug-util.cc:398] Leaking SignalData structure 0x7b0800212860 after lost signal to thread 21951
I20260709 12:11:23.502061 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:23.502861 21924 pending_rounds.cc:85] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 5
W20260709 12:11:23.506934 22022 debug-util.cc:398] Leaking SignalData structure 0x7b08001ce000 after lost signal to thread 22026
I20260709 12:11:23.507293 21924 pending_rounds.cc:107] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:23.507617 21924 raft_consensus.cc:2889] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:23.507653 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 68461.3us
I20260709 12:11:23.505412 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:23.485538 25891 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:11:23.511152 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 126449us
I20260709 12:11:23.513191 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:23.515743 22022 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae440 after lost signal to thread 22608
I20260709 12:11:23.518267 22001 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.504217 26252 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.521318 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:23.504951 21748 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 8 to 9, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:23.508632 26189 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:23.528942 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:23.528995 21921 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:23.538918 22577 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:11:23.552732 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 52904.4us
W20260709 12:11:23.554731 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 119286us
I20260709 12:11:23.508276 26238 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:23.550817 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 82877.5us
I20260709 12:11:23.554054 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:23.530558 26103 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.539532 26261 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:23.557305 21748 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 7 to 8, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 8 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:23.532114 26189 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:23.564740 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:23.541839 26168 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.541240 26235 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.590437 21994 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:23.522363 26087 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 12:11:23.617551 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 74808us
I20260709 12:11:23.560518 26024 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:23.573784 26280 consensus_meta.cc:287] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.003s
I20260709 12:11:23.573458 26103 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.616300 26189 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.632661 22580 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:23.538779 25891 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.635164 22001 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
W20260709 12:11:23.631956 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62924us
I20260709 12:11:23.559614 26283 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:11:23.625074 26274 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.627218 26025 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:23.576673 26173 consensus_queue.cc:1059] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:11:23.638768 26103 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.647768 21748 catalog_manager.cc:5697] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:23.639546 26261 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:23.642601 26333 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:23.658794 21748 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 6 to 10, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 10 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:23.633466 26150 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.652590 26168 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:23.654450 26154 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.680668 21992 raft_consensus.cc:2410] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:23.684376 26345 raft_consensus.cc:3055] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:23.685508 26345 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:23.687397 26206 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.687292 26345 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.688005 26206 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.689261 26345 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.690219 26206 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:23.681614 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:23.694337 22580 raft_consensus.cc:2410] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:23.694993 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:23.705603 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 151634us
I20260709 12:11:23.706804 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:23.695555 22584 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:23.709647 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:23.709965 22577 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:23.716867 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:23.720067 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:23.659930 26292 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:23.721670 21964 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:23.652812 26274 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.723716 21893 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:23.717362 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:23.668413 26025 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.724010 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:23.729578 21919 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
W20260709 12:11:23.764290 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.765918 26344 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:23.726619 21748 catalog_manager.cc:5697] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 6 to 9, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:23.764226 22576 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:23.715368 26024 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:23.775278 26275 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:23.708482 26168 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.776712 21893 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:23.779776 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 72985.5us
I20260709 12:11:23.663096 26333 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.786165 21966 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:23.786993 21748 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 4 to 5, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:23.731316 26087 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:23.775794 26307 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.779949 26275 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.781576 26154 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:23.726069 26258 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.809352 26024 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:23.810681 26334 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:11:23.811079 26254 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:23.811569 26338 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:11:23.812266 26328 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:11:23.840353 21748 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:23.819836 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 98246.9us
I20260709 12:11:23.801339 26188 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:23.844993 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 283160us
I20260709 12:11:23.792753 26238 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:23.790750 26344 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:11:23.820701 26275 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:23.856694 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 69498.9us
I20260709 12:11:23.838927 26025 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:23.805408 26307 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.806701 26087 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.870884 21919 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:23.776603 26261 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:23.878616 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.855301 26188 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:23.882601 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.900377 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.862756 26077 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.866289 21748 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 8 to 9, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:23.907589 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 181877us
I20260709 12:11:23.913442 22578 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:11:23.916585 26336 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:11:23.916813 26087 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:23.917382 26346 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:23.917964 26346 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:23.918710 26355 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:23.919296 26355 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.920189 26346 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:23.921103 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:23.921391 26355 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:23.904472 26077 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:23.922139 26077 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.858870 26154 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:23.905340 26188 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.904430 26238 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:23.950292 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 104347us
I20260709 12:11:23.944437 21748 catalog_manager.cc:5697] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 4 to 9, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:23.957691 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:23.958459 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 101082us
I20260709 12:11:23.914527 25891 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:23.945060 26150 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:23.960955 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:23.907967 26206 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 12:11:23.967128 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 190488us
I20260709 12:11:23.948621 26020 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.955348 26329 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:23.975529 21748 catalog_manager.cc:5697] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 2 to 7, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 7 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
W20260709 12:11:23.996488 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.034029 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 70829.4us
I20260709 12:11:23.960263 26346 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.972762 26343 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:24.043576 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:24.051393 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.051921 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.045532 21748 catalog_manager.cc:5697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:24.056406 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:23.981079 26329 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.978658 26344 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.065287 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.065846 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.042683 26255 consensus_meta.cc:287] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.588s	user 0.002s	sys 0.009s
I20260709 12:11:24.063133 26366 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:24.064293 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 107949us
W20260709 12:11:24.055007 26318 consensus_meta.cc:287] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.647s	user 0.014s	sys 0.008s
I20260709 12:11:23.973433 25891 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:11:24.083452 21918 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:24.055370 26087 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.100526 21920 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:24.064769 26329 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:24.101486 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.040001 26020 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.080907 26036 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.105736 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:24.109659 25787 consensus_meta.cc:287] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 12:11:24.042151 26343 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:24.111970 26350 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:24.112429 26351 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.112838 26341 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.047920 26342 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.253s
I20260709 12:11:24.077144 26298 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:24.111341 26353 log.cc:927] Time spent T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:24.124922 21748 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 8 to 9, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:24.097002 26168 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.101402 26258 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.081084 26255 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.162154 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.089674 26346 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.144447 26036 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.160418 21918 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:24.143520 26333 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:24.167593 21922 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:24.159596 26298 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:24.171980 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 249598us
W20260709 12:11:24.176291 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.177390 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:24.174490 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 68846.6us
I20260709 12:11:24.168057 26036 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.168249 26168 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.100795 26344 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.183147 21918 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:24.165185 26307 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.188710 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.189649 26258 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.190044 26258 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:24.157397 25787 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.184968 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:24.191051 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:24.196044 25787 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.197686 26255 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.187482 26343 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.199407 26343 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.201126 21966 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.156212 26351 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:24.205514 26235 consensus_meta.cc:287] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.001s
I20260709 12:11:24.205914 26351 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:24.209661 26110 consensus_meta.cc:287] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.775s	user 0.007s	sys 0.003s
I20260709 12:11:24.209913 26150 consensus_queue.cc:1059] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:24.214929 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.214208 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 178550us
I20260709 12:11:24.190434 26258 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.216348 26298 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.218688 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.147243 26087 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.156267 26350 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.191522 21748 catalog_manager.cc:5697] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:24.191350 22583 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:24.181264 26154 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:24.226377 26345 consensus_meta.cc:287] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.004s
I20260709 12:11:24.241602 22576 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 13: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:24.240245 21966 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:24.219401 26252 consensus_meta.cc:287] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.003s
I20260709 12:11:24.245379 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:24.252610 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 188703us
W20260709 12:11:24.260192 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 71546.6us
I20260709 12:11:24.293216 21967 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.294905 21817 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.296406 26340 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:11:24.296697 26103 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.003s
I20260709 12:11:24.238809 26110 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.297176 26368 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.297087 26340 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.297857 26348 raft_consensus.cc:3055] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.275416 26179 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.299023 26349 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.299544 26340 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.299093 26179 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.299896 26349 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:24.301806 26179 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.302919 26344 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.303205 26258 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.304451 26238 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:24.304862 26238 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:24.306833 26188 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.309587 21964 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:24.298373 26348 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:24.311041 26348 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.311967 26150 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.312345 26348 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.312531 26150 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:24.313596 26371 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:24.315063 26154 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.315486 26346 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.278867 26374 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.315595 26154 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.316745 25892 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:24.274343 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.279043 26211 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:24.282838 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.283564 26378 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.284134 26350 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.284049 26235 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:24.284825 21748 catalog_manager.cc:5697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 6 to 8, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 8 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:24.297127 26103 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.286134 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:24.286675 26298 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.287110 26020 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.287719 26365 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:24.290535 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49297.9us
I20260709 12:11:24.292402 26087 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.296452 21817 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:24.293538 26077 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.279738 26292 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:24.308965 26188 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:24.317425 26150 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.324594 26349 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.353117 26349 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.353493 26349 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.305292 26258 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.333406 26255 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:11:24.366489 25951 consensus_meta.cc:287] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.989s	user 0.013s	sys 0.001s
W20260709 12:11:24.367604 26189 consensus_meta.cc:287] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 12:11:24.328708 26378 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.368040 26189 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.368538 26378 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.329438 26235 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.332713 26103 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.370913 26235 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:24.322763 26211 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:24.371376 26235 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.371991 26211 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.373210 26211 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.329223 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.325505 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.375988 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.327700 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.376492 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.377135 21992 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:24.377735 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.377944 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.378451 21998 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:24.331875 22583 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:24.328452 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:24.382460 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.338181 26350 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:24.327832 22001 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.383273 26350 raft_consensus.cc:697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:24.336423 26077 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.327201 26154 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.384235 26350 consensus_queue.cc:237] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.333885 26365 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:24.328504 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:24.317150 25892 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:24.340497 21996 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:24.344501 21926 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:24.347584 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.387688 25892 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.344798 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:24.388760 25892 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:24.388942 21999 raft_consensus.cc:2410] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:24.328295 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.389596 21997 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:24.349545 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:24.352116 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.390844 21920 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:24.351523 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.325804 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:24.337028 21817 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.342521 22580 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:24.347221 21994 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:24.351855 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.392540 21921 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:24.326098 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:24.326372 26274 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.338460 26087 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:11:24.351177 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.403872 21919 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:11:24.348831 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.331524 21748 catalog_manager.cc:5697] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 6 to 7, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 7 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:24.328267 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 45524us
I20260709 12:11:24.393711 22577 raft_consensus.cc:2410] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:24.395169 21992 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:24.339464 26292 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:24.393011 21923 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
W20260709 12:11:24.399777 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.416574 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 79618.7us
I20260709 12:11:24.417424 21817 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:24.418898 21817 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.419160 26103 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:24.419602 26318 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:24.419793 26103 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:24.420127 26318 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:24.420164 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:24.421172 21817 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:24.421469 26346 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.420792 26103 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.422207 26346 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.422622 26346 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:24.423009 26346 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.423357 26343 consensus_queue.cc:1059] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:24.423641 26345 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:24.424389 26343 raft_consensus.cc:3055] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.424805 26343 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:24.426743 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:24.431731 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 209724us
I20260709 12:11:24.431885 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:24.433818 21817 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:24.436968 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.439405 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:24.440001 21920 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.422633 26368 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:24.445195 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:24.446823 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.447669 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.451771 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.451936 22579 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:24.452710 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:24.447664 21925 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 15.
I20260709 12:11:24.451984 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.457659 21966 leader_election.cc:400] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:24.457983 21966 leader_election.cc:403] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.462774 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:24.466745 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.467458 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.400101 26378 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:24.469820 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:24.411067 26087 consensus_queue.cc:1243] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:24.471153 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.458588 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:24.471805 21923 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:24.472234 22576 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:24.475030 21748 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:24.442760 26344 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.479460 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:24.451395 25787 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.444078 26368 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:24.481498 21847 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:24.482908 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:24.447824 26366 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.486239 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.486760 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:24.469416 26110 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.491572 22581 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:24.496861 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:24.497788 21848 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:24.491922 22581 pending_rounds.cc:85] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 9
I20260709 12:11:24.499346 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:24.499882 22581 pending_rounds.cc:107] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 10.10
W20260709 12:11:24.499421 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.500241 22581 raft_consensus.cc:2889] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:24.498746 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:24.501291 22583 raft_consensus.cc:2410] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:24.498804 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:24.502709 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.503412 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:24.504118 21921 raft_consensus.cc:2393] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:24.498746 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:24.500104 21849 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:24.421209 26318 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.491008 26025 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:24.506951 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:24.513103 22579 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.484895 26150 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12.
I20260709 12:11:24.509030 26354 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.523851 26354 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.484678 25787 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:24.386202 26365 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.490942 26173 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:24.514721 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:24.517378 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.522795 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:24.522568 26364 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:11:24.511920 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.489781 26368 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:24.523801 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 66276.8us
W20260709 12:11:24.531121 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.540266 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.544204 21992 raft_consensus.cc:2376] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11. Re-sending same reply.
I20260709 12:11:24.507365 26355 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.503991 26258 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:24.607244 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.526255 26354 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.608809 21920 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:24.610574 21845 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:24.546119 21967 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:24.611457 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 65407.8us
I20260709 12:11:24.613541 21849 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:24.614218 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.614643 21845 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 12:11:24.615033 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.616106 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.617219 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:24.624990 22584 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:24.617144 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:24.627902 21920 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.622813 21921 raft_consensus.cc:2393] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:24.628964 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.629424 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:24.630182 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.485299 26343 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.634397 21994 raft_consensus.cc:606] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.635494 21994 raft_consensus.cc:614] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:24.540649 25787 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.532191 26261 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.636976 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.634837 21925 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:24.659286 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.660626 21923 raft_consensus.cc:2410] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:24.616871 26150 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:24.666224 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.666884 21921 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:24.667549 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:24.668629 21849 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:24.663635 21920 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:24.675205 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:24.675952 21847 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 7.
I20260709 12:11:24.676863 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:24.677628 21919 raft_consensus.cc:2393] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:24.681115 26342 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.543283 26110 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.681743 26342 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.684267 26110 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.544939 26025 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.705749 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:24.697366 22576 raft_consensus.cc:2410] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:24.706637 21999 raft_consensus.cc:2410] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:24.545552 26036 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.709462 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.709545 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.705363 25892 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.710665 22582 raft_consensus.cc:2368] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11.
I20260709 12:11:24.706750 21844 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:24.710999 25892 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.711401 21852 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:24.712095 26036 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.713085 25892 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.710683 21992 raft_consensus.cc:2410] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:24.663371 26235 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.725657 26235 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:24.726044 21995 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:24.728106 26025 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:24.729647 26275 consensus_meta.cc:287] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.001s
I20260709 12:11:24.679850 26150 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.733502 26150 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.739754 26168 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.740399 26168 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.613583 26173 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.739475 26349 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.662155 26189 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:24.699910 26380 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
I20260709 12:11:24.768285 21817 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:24.540154 26366 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.792208 26025 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.792601 26168 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:24.792833 26025 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.707762 26333 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.794704 26333 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.795198 21849 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:24.796826 26333 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:24.781787 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.798516 21998 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 11. Ops: []
W20260709 12:11:24.800741 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.798363 21922 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:24.801470 21993 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:24.804456 26348 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.730121 26275 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.662209 26261 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.811188 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.806872 21817 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.608376 26292 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.817289 21843 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:24.734153 26238 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.797335 26354 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.831974 21993 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 12. Current term is 13. Ops: [11.10-12.11]
I20260709 12:11:24.829427 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:24.833408 21849 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.834916 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet d50c36e857cb4e33997aee7e5dd39447 with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:32960
I20260709 12:11:24.836678 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:24.836997 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:24.841984 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.847435 21924 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:24.817170 26348 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:24.849234 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.844092 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:24.853216 22575 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:24.861893 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:24.862742 21993 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 11: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:24.856436 21922 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:24.835723 26364 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.865485 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:24.866995 21893 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:24.874280 21893 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:24.876793 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.852459 25892 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.883033 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.884159 21922 raft_consensus.cc:2410] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 10 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:24.886062 21919 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:24.888134 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 44150.7us
I20260709 12:11:24.888844 21817 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:24.866056 26292 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.873170 26025 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.900923 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.873504 26340 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.882681 26351 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.899631 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:24.847658 26354 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.901579 21999 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:24.898288 21815 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.900179 21964 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.866549 26036 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:24.896829 26364 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:24.908020 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.883618 25892 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:24.882429 26012 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:24.925930 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.929374 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:24.932142 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.940387 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:24.942369 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.935992 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.944049 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:24.923902 26298 consensus_meta.cc:287] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.001s
I20260709 12:11:24.940997 21922 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:24.944275 22578 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
W20260709 12:11:24.948921 26394 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:24.950093 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.967504 21998 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:24.945613 25891 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.955068 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.941427 25892 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.957113 26024 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.957437 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.958384 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.934100 26364 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.917068 26340 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.981325 26168 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.981419 26364 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.983716 26355 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:24.984426 26355 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:24.984915 26355 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:24.986691 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.960214 26211 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.987988 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.988305 26211 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.989569 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:24.914515 26351 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:24.933923 26341 consensus_meta.cc:287] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.000s
I20260709 12:11:24.970299 21927 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:24.972806 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:24.904300 26189 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:11:24.977623 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:24.959169 26283 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:24.959123 26275 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:24.990634 21921 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:24.991782 22001 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:24.962471 26346 consensus_meta.cc:287] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 12:11:24.962440 25787 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:24.993706 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:25.039743 22584 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.990721 26351 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.999343 21925 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:24.943502 26012 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.975538 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:25.047509 21918 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:25.007719 21993 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:25.007933 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:25.013473 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 338879us
I20260709 12:11:25.019968 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:25.022177 21849 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
W20260709 12:11:25.024802 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.049949 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.025192 26173 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:24.979699 26298 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:25.070770 26298 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:25.073359 26298 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.023598 26378 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.000373 26349 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:25.038268 26346 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:25.078035 26329 consensus_meta.cc:287] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.923s	user 0.007s	sys 0.002s
I20260709 12:11:25.054495 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:25.097635 22580 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:11:25.102090 22580 pending_rounds.cc:85] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 11
I20260709 12:11:25.102372 22580 pending_rounds.cc:107] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:11:25.102735 21852 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:25.102641 21737 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1238ec38c933498cadf6153a5554f6e0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac07267c8cab47d4b59dc27d6fe9a386 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:25.024679 26211 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:25.102656 22580 raft_consensus.cc:2889] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:25.055789 22579 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.001s
I20260709 12:11:25.059875 21998 raft_consensus.cc:2393] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 11: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:11:25.060102 26383 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:25.006781 26341 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.060418 26366 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.065428 26355 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.066694 26368 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:25.080312 25787 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.038295 26283 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:25.084403 21738 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.262s	user 0.015s	sys 0.015s
I20260709 12:11:25.135030 21850 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 12:11:25.135865 26283 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.136169 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.087767 26354 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.136855 21850 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
W20260709 12:11:25.088948 26390 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:11:24.962739 26348 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.095212 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.141296 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.141963 21849 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:25.095892 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.096004 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.142863 21845 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:25.142992 21844 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:25.143617 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.143824 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.097532 26261 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.144162 21845 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:25.096091 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:25.145000 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.145533 22581 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:25.105140 22579 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
W20260709 12:11:25.106141 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.118170 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5937d593814d4b568742fc86c954922d"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
W20260709 12:11:25.120782 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.146813 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.146888 21847 raft_consensus.cc:606] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:25.147378 21847 raft_consensus.cc:614] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:25.118254 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:25.127084 21851 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.149406 21844 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 12: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:25.133145 26368 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.137776 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.051049 26012 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.154083 22584 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:25.103843 26329 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:25.157346 21996 raft_consensus.cc:1240] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.104668 26378 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:25.157439 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:25.162488 21993 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.166766 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.167608 21849 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
W20260709 12:11:25.169320 22547 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.011s	sys 0.015s
I20260709 12:11:25.169672 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:25.169678 22547 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.011s	sys 0.015s
W20260709 12:11:25.171036 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 517386us
I20260709 12:11:25.170322 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:25.189924 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.192180 21851 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:25.192533 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:25.176988 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.173600 21845 raft_consensus.cc:2368] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11.
I20260709 12:11:25.194770 21997 raft_consensus.cc:2393] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:25.194024 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:25.200515 21851 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:25.168984 21892 connection.cc:256] RPC call timeout handler was delayed by -1.5376617469999019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 12:11:25.201043 21892 connection.cc:256] RPC call timeout handler was delayed by -1.5331617469998946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 12:11:25.201599 21892 connection.cc:256] RPC call timeout handler was delayed by -1.4350617469999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 12:11:25.203652 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:25.202042 21892 connection.cc:256] RPC call timeout handler was delayed by -1.412561746999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 12:11:25.205111 21892 connection.cc:256] RPC call timeout handler was delayed by -1.3576617469998382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:11:25.205482 21892 connection.cc:256] RPC call timeout handler was delayed by -1.3153617469997698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 12:11:25.205848 21892 connection.cc:256] RPC call timeout handler was delayed by -1.2229211689998465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
I20260709 12:11:25.203979 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:25.207424 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:25.208513 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 230225us
I20260709 12:11:25.208666 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.209415 21850 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
W20260709 12:11:25.208359 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 233923us
I20260709 12:11:25.211534 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.211901 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:25.212448 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.213191 21851 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:25.190096 26318 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:25.214777 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.192829 26258 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.212250 21848 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:25.217222 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:25.217236 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.218729 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:25.219807 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.224298 21893 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:25.245404 21815 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:25.246469 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:25.259501 21845 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.172818 26036 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:25.171439 26150 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.214602 26261 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.281404 21850 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:11:25.274930 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.210357 26292 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.212810 26355 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:25.215003 26366 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:25.214435 26345 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.256685 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:25.254930 26368 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:25.246731 26409 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.255128 26283 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:25.286507 21851 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:25.287231 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:25.259410 26024 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.288384 22000 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:25.289970 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:25.263047 26404 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.299484 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:25.301250 26020 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:25.301808 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:25.303247 26020 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.303699 26020 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.304085 26020 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.304442 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:25.214866 26361 consensus_queue.cc:1059] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:11:25.306591 26407 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.307328 26407 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.307688 26407 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.306524 26361 raft_consensus.cc:3055] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:25.255376 26392 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:25.316336 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 61666.9us
I20260709 12:11:25.261085 26258 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.322744 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:25.330006 21850 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.288338 26366 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.296120 26341 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.295796 26344 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.293411 26024 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.297474 26368 raft_consensus.cc:697] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:25.298372 26355 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.331908 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:25.298046 26283 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:25.337919 26401 tablet_replica.cc:333] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:11:25.370477 21998 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:25.290354 26403 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:25.338536 26366 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:25.277570 26378 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.324831 26361 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:25.347028 26344 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.379061 21998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:25.389560 21998 raft_consensus.cc:606] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:25.390024 21998 raft_consensus.cc:614] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:25.374536 26355 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:25.388082 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 86398.6us
I20260709 12:11:25.296689 26409 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.317546 26404 raft_consensus.cc:697] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:25.346752 26346 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:25.388278 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.379509 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:25.377274 26342 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.393515 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:25.340569 26341 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.372442 26024 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.409929 21926 pending_rounds.cc:85] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 4
W20260709 12:11:25.413134 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.392832 26329 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:25.393850 26344 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.418876 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 899) took 1099 ms. Trace:
I20260709 12:11:25.420944 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 644) took 1073 ms. Trace:
I20260709 12:11:25.421314 21924 rpcz_store.cc:276] 0709 12:11:24.347498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.351275 (+  3777us) service_pool.cc:224] Handling call
0709 12:11:25.420773 (+1069498us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54002e6654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:25.420890 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021986048}
I20260709 12:11:25.423430 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:25.424078 21922 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:25.414397 21926 pending_rounds.cc:107] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 6.5
W20260709 12:11:25.424460 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 176201us
I20260709 12:11:25.418483 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:25.424855 21926 raft_consensus.cc:2889] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.419302 22582 rpcz_store.cc:276] 0709 12:11:24.319334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.319453 (+   119us) service_pool.cc:224] Handling call
0709 12:11:25.418696 (+1099243us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54005c0154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:25.418820 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732384128}
I20260709 12:11:25.428468 21920 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.428393 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:25.429227 21998 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:25.430003 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:25.306123 21738 maintenance_manager.cc:643] P 18e701898a2848c494bb06576eb2cdd4: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.213s	user 0.209s	sys 0.063s Metrics: {"bytes_written":29812,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":142219,"dirs.run_cpu_time_us":485,"dirs.run_wall_time_us":22615,"drs_written":1,"lbm_read_time_us":476,"lbm_reads_lt_1ms":4,"lbm_write_time_us":85990,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":3,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":199562,"threads_started":2,"update_count":4,"wal-append.queue_time_us":218806}
I20260709 12:11:25.431126 21998 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:25.406836 26348 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:25.434157 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:25.435684 21921 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:25.436110 21921 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:25.438582 26404 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:25.440416 26402 log.cc:927] Time spent T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:11:25.441279 26405 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:11:25.446509 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.447184 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:25.448474 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:25.449446 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:25.422369 26408 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.450031 21994 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:25.450275 26408 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:25.433082 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.449535 26409 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:25.461118 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:25.461769 21993 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:25.437845 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:25.427743 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.459434 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.464097 21920 raft_consensus.cc:3060] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.414391 26341 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.460430 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:25.466539 21739 maintenance_manager.cc:419] P 18e701898a2848c494bb06576eb2cdd4: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10218 bytes on disk
I20260709 12:11:25.467443 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:25.468446 21921 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:25.470734 26283 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.473317 26407 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:25.474691 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 134784us
I20260709 12:11:25.475431 21967 leader_election.cc:400] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11.
I20260709 12:11:25.475672 26258 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.451332 26408 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.452804 26150 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.505738 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:25.507637 21921 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.508181 21923 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.487293 26419 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:25.511456 21920 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:25.484967 26024 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.488349 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:25.489920 21846 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:25.491420 21998 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:25.491904 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:25.434258 26348 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:25.503006 21967 leader_election.cc:403] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.483649 21850 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:25.512979 21993 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.516026 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:25.516618 21994 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.522989 21738 maintenance_manager.cc:643] P 18e701898a2848c494bb06576eb2cdd4: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.014s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":393,"lbm_reads_lt_1ms":4}
I20260709 12:11:25.524369 26012 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.524675 26020 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:25.525831 25892 consensus_meta.cc:287] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.001s
I20260709 12:11:25.428686 26368 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.526223 25892 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.526643 26020 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.528235 25892 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.529084 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:25.493928 26417 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:25.537169 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:25.538684 21924 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.538595 21815 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:25.539268 21920 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:25.509519 26329 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.509194 26349 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.546761 26407 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.529748 26419 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:25.548082 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:25.548873 26020 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:25.551692 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.537988 26364 consensus_meta.cc:287] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.002s
I20260709 12:11:25.530550 26348 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.434990 26361 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.533830 26275 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:25.570240 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.529583 26258 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11.
W20260709 12:11:25.583513 22547 leader_election.cc:336] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.757s (SENT)
I20260709 12:11:25.580741 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:25.591118 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:25.560231 26012 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.562865 26020 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:25.602460 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:25.543450 26345 consensus_queue.cc:1059] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:11:25.606201 21994 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:25.609531 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:25.608477 21993 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:25.610054 21817 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:25.610234 21920 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.613461 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:25.614323 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:25.615033 22584 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:25.554826 26329 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:25.611519 26020 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:25.544423 26417 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.576107 26364 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:25.637046 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 53569.6us
I20260709 12:11:25.616962 26407 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.631261 21817 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:25.586557 26349 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:25.639001 21992 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:25.613274 26420 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.623965 26378 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.633762 26351 consensus_meta.cc:287] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.003s
I20260709 12:11:25.653913 21849 raft_consensus.cc:2368] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10.
I20260709 12:11:25.642830 21817 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:25.649329 26346 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.644387 26366 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:25.674551 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.640903 21920 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
W20260709 12:11:25.672240 26350 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.018s	sys 0.025s
I20260709 12:11:25.689402 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:25.653694 26351 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.709699 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:25.710227 21924 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:25.651703 26378 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:25.682742 26346 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.683108 26087 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:25.705487 26381 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 1.036s	user 0.000s	sys 0.004s
W20260709 12:11:25.705370 26421 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:11:25.700132 26350 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.018s	sys 0.025s
I20260709 12:11:25.722340 26012 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:25.661798 26355 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.705127 26420 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:25.687453 26407 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:11:25.719277 26346 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.718313 26087 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:25.730331 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 113851us
I20260709 12:11:25.712848 26387 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.732925 26420 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:25.928851 26435 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:11:25.816968 26351 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.924847 21999 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:25.958501 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.770078 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.926069 26340 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.811585 26348 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.805603 26364 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.816126 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:25.886584 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 140900us
I20260709 12:11:25.812261 26343 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.954630 26387 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:25.814317 26392 raft_consensus.cc:3055] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:25.804751 26349 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:25.823037 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35508 (request call id 2528) took 1277 ms. Trace:
I20260709 12:11:25.814764 26344 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:25.816267 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.969905 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.970254 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.807170 21923 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:25.811169 26012 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:25.889802 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:25.894241 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:25.971163 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:25.811676 26417 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.835922 21964 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:25.971781 22583 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.970299 21843 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
W20260709 12:11:25.972396 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 136570us
I20260709 12:11:25.903985 26409 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:25.813694 26378 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:25.810951 26329 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:25.790447 26087 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.816416 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:25.907051 26389 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 1.233s	user 0.007s	sys 0.000s
I20260709 12:11:25.891727 21921 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:25.981493 21921 pending_rounds.cc:85] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 7
W20260709 12:11:25.827812 26428 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:11:25.806967 26366 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:25.727967 26386 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.003s	sys 0.017s
W20260709 12:11:25.991101 26386 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.003s	sys 0.017s
I20260709 12:11:25.943658 26292 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:25.992105 26292 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:25.993206 26292 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.951117 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:25.995090 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 44125.9us
I20260709 12:11:25.996073 26110 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:25.923887 26400 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 12:11:25.932735 26355 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.886061 26368 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.994313 26292 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.000366 26368 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.001267 26420 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:25.884972 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.002647 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:25.881328 26404 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:26.003116 26261 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:26.003742 26261 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:25.882361 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:26.004462 22579 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.004616 26261 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.007587 26348 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:25.952827 26036 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.008522 26036 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.964110 21924 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:25.963451 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:26.012003 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:26.012954 22581 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:25.964367 21967 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:26.015250 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 50988.2us
I20260709 12:11:26.016203 22576 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.017573 26429 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.815796 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:25.967307 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:26.018827 22578 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:25.966466 26392 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:25.967391 21997 rpcz_store.cc:276] 0709 12:11:24.545837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.545955 (+   118us) service_pool.cc:224] Handling call
0709 12:11:25.822817 (+1276862us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400220e54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:25.822978 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320627456}
I20260709 12:11:26.026003 22580 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:25.971647 22582 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.981753 21921 pending_rounds.cc:107] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:26.027144 21921 raft_consensus.cc:2889] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.966809 26387 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.981746 21964 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:25.985021 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.988049 26012 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:25.967638 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:26.041986 22575 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:26.018832 21920 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:26.021937 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:26.043798 21994 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:26.023274 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.968469 26024 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:26.035048 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 350861us
I20260709 12:11:26.035518 22581 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:26.046111 22581 pending_rounds.cc:85] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 9
W20260709 12:11:26.046720 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 65104.2us
I20260709 12:11:26.047036 22581 pending_rounds.cc:107] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:11:26.047793 22581 raft_consensus.cc:2889] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:26.049234 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 164307us
I20260709 12:11:26.050239 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.041040 22583 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:26.051424 22579 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:25.978850 26349 raft_consensus.cc:2804] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:26.055371 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.053030 21893 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:26.045063 26341 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.000s
I20260709 12:11:26.060905 21992 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:26.063613 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 47443.1us
I20260709 12:11:26.059806 22583 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:11:26.061800 21927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46426 (request call id 648) took 1712 ms (client timeout 2178 ms). Trace:
I20260709 12:11:26.060545 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:26.064522 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:26.066172 21997 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:26.064672 21927 rpcz_store.cc:269] 0709 12:11:24.349177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.349295 (+   118us) service_pool.cc:224] Handling call
0709 12:11:26.061583 (+1712288us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54003e71d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:26.061733 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332240768}
I20260709 12:11:26.067247 21817 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:25.979887 26346 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.068324 22578 raft_consensus.cc:2410] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:26.060366 26025 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:26.059556 26235 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:26.059418 25787 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:26.076555 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 182425us
I20260709 12:11:26.062992 26349 raft_consensus.cc:697] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:26.081651 21849 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:26.067934 26413 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:26.088171 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.083233 21993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:26.085198 21994 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:26.074059 26384 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.088757 21846 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:26.089146 21993 raft_consensus.cc:606] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:26.089280 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:26.100934 26024 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:26.101979 26024 consensus_queue.cc:1243] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:26.080072 26366 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:26.106804 26366 raft_consensus.cc:697] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:26.107702 26366 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.108204 26349 consensus_queue.cc:237] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.067564 26341 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.073295 26340 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:26.131328 22578 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:26.086551 26235 raft_consensus.cc:697] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:26.139079 22576 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:26.142541 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.150867 21998 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 13: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:26.095000 26413 raft_consensus.cc:697] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:26.158913 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.159793 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:26.094154 26403 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:11:26.160619 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.165189 21846 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:26.130095 26439 consensus_queue.cc:1059] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:26.171353 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2165) took 1042 ms. Trace:
W20260709 12:11:26.171329 22547 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.178s (SENT)
I20260709 12:11:26.092468 26392 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.173055 21847 rpcz_store.cc:276] 0709 12:11:25.129344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.201112 (+ 71768us) service_pool.cc:224] Handling call
0709 12:11:25.212066 (+ 10954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.330147 (+118081us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:25.374871 (+ 44724us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.504148 (+129277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.504204 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:25.504249 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.171104 (+666855us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400216454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:26.171149 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.171299 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9410,"prepare.queue_time_us":43332,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":9509,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4294,"spinlock_wait_cycles":241369856,"thread_start_us":104402,"threads_started":1,"wal-append.queue_time_us":163529}
I20260709 12:11:26.149152 26351 consensus_queue.cc:1059] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:11:26.182246 21892 leader_election.cc:400] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:26.170733 26436 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.157431 26384 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:26.174662 26368 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:26.176769 26020 consensus_meta.cc:287] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.537s	user 0.015s	sys 0.000s
I20260709 12:11:26.192005 21993 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:11:26.187065 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 95549.5us
I20260709 12:11:26.222079 26365 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:26.225483 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.227322 26238 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.228282 26440 raft_consensus.cc:3055] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:26.228744 26440 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:26.229535 26440 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.231068 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 749) took 1238 ms. Trace:
I20260709 12:11:26.204468 26235 consensus_queue.cc:237] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.231499 22001 rpcz_store.cc:276] 0709 12:11:24.993153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.019639 (+ 26486us) service_pool.cc:224] Handling call
0709 12:11:26.230858 (+1211219us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54002d0fd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:26.231006 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296736512}
I20260709 12:11:26.204030 26392 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.240912 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.235034 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.269732 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.297286 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:26.299187 22584 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:26.275913 21992 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.278584 26429 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.302228 26429 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.273739 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:26.239655 25787 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:26.215899 26036 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:26.306617 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.215163 26020 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.313210 21852 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:26.314211 21993 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:26.317500 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:26.302795 26429 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.321346 21967 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:26.208081 26087 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.354916 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.346443 22577 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.346876 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.357870 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.358464 21994 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:26.359385 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.360458 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:26.364429 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.364429 22577 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:26.349399 22582 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:26.367874 21997 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:26.368753 22578 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:26.297708 26258 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.372008 21994 raft_consensus.cc:2393] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:26.303395 26346 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.376163 21818 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:26.380295 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:26.380867 21997 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.385175 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.345841 26440 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:26.386376 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.385212 22000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 741) took 1435 ms. Trace:
I20260709 12:11:26.350274 25891 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.305733 26368 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:11:26.395830 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 736) took 1466 ms. Trace:
I20260709 12:11:26.396245 21999 rpcz_store.cc:276] 0709 12:11:24.923443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.933475 (+ 10032us) service_pool.cc:224] Handling call
0709 12:11:24.948779 (+ 15304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.958915 (+1010136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.389617 (+430702us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54000d3254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:26.389848 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244327168}
W20260709 12:11:26.397560 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.397871 21893 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.394131 22000 rpcz_store.cc:276] 0709 12:11:24.950184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.958063 (+  7879us) service_pool.cc:224] Handling call
0709 12:11:26.385037 (+1426974us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54002dfad4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:26.385161 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689707392}
I20260709 12:11:26.345012 26025 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:26.403206 21921 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:26.407696 21993 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:26.403220 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:26.409615 21999 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:26.415553 21997 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:26.379272 26258 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.403466 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:26.423532 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 47484.1us
I20260709 12:11:26.427094 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:26.428375 26443 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:26.429975 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.430591 22000 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
W20260709 12:11:26.431015 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.431629 22000 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.363440 26387 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.397459 26261 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.440768 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.398317 26036 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.266803 26413 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.444746 21997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:26.445583 21997 raft_consensus.cc:606] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:26.446062 21997 raft_consensus.cc:614] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:26.382560 26340 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:26.447896 26036 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.436123 26403 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:26.450369 26447 log.cc:927] Time spent T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:11:26.450786 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.378693 26384 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.426592 26258 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.472190 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:26.472700 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.474355 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.474445 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.475095 21850 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:26.475965 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:26.476683 21848 raft_consensus.cc:2393] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:26.477675 21847 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:26.473474 22000 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:26.478909 21997 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.479513 22000 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:26.482841 21818 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:26.482947 26025 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.483486 26020 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:26.483875 21818 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:26.484205 26020 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:26.486780 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.487457 21849 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:26.488320 21966 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:26.489728 21999 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:26.496718 21999 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.499475 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:26.500696 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.503403 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:26.505401 21997 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:26.520617 25892 consensus_queue.cc:1059] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:26.500936 26461 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.517604 26403 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:26.495846 26378 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.522735 21996 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:26.547446 21996 pending_rounds.cc:85] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 10
I20260709 12:11:26.505709 26445 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.504362 25891 raft_consensus.cc:2764] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:26.527233 26345 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:26.437178 25787 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.528074 26386 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.528681 26387 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:26.531752 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.533820 21966 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:26.534602 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 153328us
I20260709 12:11:26.560143 21966 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:26.505376 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:26.536195 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.522522 26036 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:26.509068 22000 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:26.547816 21996 pending_rounds.cc:107] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:26.562678 21996 raft_consensus.cc:2889] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.523589 26087 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:26.505579 26446 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.505750 26439 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:26.563704 26439 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:26.454200 26261 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:26.563120 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.582468 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 229444us
I20260709 12:11:26.537397 26238 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.588053 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:26.591116 21997 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.589371 21817 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:26.591393 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 81545.3us
W20260709 12:11:26.590004 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 283704us
I20260709 12:11:26.595363 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.549923 26445 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.563755 26446 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:26.564147 26439 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:26.602903 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:26.625310 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:26.583406 26235 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.582722 26154 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.636088 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.637233 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.642681 26465 raft_consensus.cc:2764] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:26.649641 21997 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:26.601928 26368 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.551578 26378 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.634255 26445 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.640442 26087 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.585454 26386 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.623833 26458 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:26.676595 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 116569us
I20260709 12:11:26.602099 26436 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:11:26.650602 26154 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.661666 26403 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.686947 26446 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.662335 26451 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:26.680493 22000 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:26.678364 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:26.689770 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 128094us
I20260709 12:11:26.667054 26368 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:26.697729 21966 leader_election.cc:400] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11.
I20260709 12:11:26.704030 21817 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:26.708784 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 71654.3us
I20260709 12:11:26.692193 26451 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:26.694725 26458 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:26.712858 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:26.680857 26087 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.697999 26457 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:26.709863 26025 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.722967 21892 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:26.732504 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:26.709367 26345 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:11:26.733673 26467 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:26.733969 26275 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:26.734589 26462 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:11:26.735277 26464 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:11:26.736033 26463 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:26.737483 26470 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.738938 26087 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.739964 26261 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:26.728901 21818 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:26.785934 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 57127.6us
W20260709 12:11:26.790934 26365 consensus_meta.cc:287] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.004s
I20260709 12:11:26.792456 26345 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:26.792542 26441 log.cc:927] Time spent T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.635s	user 0.001s	sys 0.005s
I20260709 12:11:26.795806 25892 consensus_queue.cc:1059] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:26.799384 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.800482 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.800702 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:26.717680 26451 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:26.720955 25891 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.722236 26457 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.801285 21846 raft_consensus.cc:2393] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:26.801209 26473 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:11:26.776604 26436 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:26.803165 26468 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:26.832973 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:26.805800 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 97886.1us
I20260709 12:11:26.806653 22576 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:26.761775 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:26.764914 26025 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:26.770740 26467 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:26.802019 26416 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.831564 21845 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:26.832790 21852 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.835704 21850 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.841871 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:26.825161 26457 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.834389 21849 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:26.812604 26343 consensus_meta.cc:287] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.847s	user 0.010s	sys 0.002s
I20260709 12:11:26.842489 21845 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
I20260709 12:11:26.769589 26439 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.848733 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:26.851246 21844 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:26.810783 26429 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.853456 21852 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:26.853968 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.852185 21998 pending_rounds.cc:85] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 7
I20260709 12:11:26.839187 26436 raft_consensus.cc:697] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:26.859335 22582 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:26.824636 25891 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.857120 21998 pending_rounds.cc:107] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.8
I20260709 12:11:26.843595 26467 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.812430 26368 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.868233 22001 raft_consensus.cc:2368] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
W20260709 12:11:26.876322 26478 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:11:26.878528 21998 raft_consensus.cc:2917] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Aborting config change with OpId 8.8: Aborted: Op aborted by new leader
I20260709 12:11:26.916790 21998 raft_consensus.cc:2889] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:26.882965 26471 log.cc:927] Time spent T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:11:26.883361 26378 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.839983 26258 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.884840 26343 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.927271 26343 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.927845 26343 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.928260 26419 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:26.931317 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:26.892601 26386 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.934546 26473 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:26.935096 26473 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.939798 26476 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.940363 26476 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.854841 26364 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.943307 26364 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.945201 26361 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.895737 25891 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:26.896962 26485 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:11:26.897075 26436 consensus_queue.cc:237] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.898048 26103 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.899773 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:26.898264 26439 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:26.874955 26474 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.847431 26416 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.904068 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:26.904300 26429 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:26.840983 26458 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.872051 26025 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.906874 22000 raft_consensus.cc:606] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:26.957368 22000 raft_consensus.cc:614] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:26.915681 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.958575 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.918794 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:26.960291 22577 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:26.947772 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:26.948000 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:26.952522 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 119197us
I20260709 12:11:26.938009 26154 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.961730 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:26.964469 21992 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:26.966739 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:26.977272 21851 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:11:26.954983 26474 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.977734 26283 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:26.978269 26283 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.979383 26474 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.968546 26261 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:26.980329 26283 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:26.980504 26261 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:26.980983 26364 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.981563 26261 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:26.982072 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 747) took 2030 ms. Trace:
I20260709 12:11:26.982491 21996 rpcz_store.cc:276] 0709 12:11:24.951937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.340809 (+388872us) service_pool.cc:224] Handling call
0709 12:11:25.374062 (+ 33253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.563143 (+1189081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.981723 (+418580us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002c5454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:26.982002 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2640959872}
W20260709 12:11:26.983163 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.984308 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:26.963233 26473 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.985049 22580 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:26.987869 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:26.989468 21995 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
W20260709 12:11:26.990751 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.968365 26439 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:26.955216 26420 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:11:26.926333 26457 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:26.970912 26476 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.954046 26103 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.004626 26103 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:26.986923 26283 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.006790 26283 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.008901 26283 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:26.995836 26439 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:27.018994 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 52323.7us
I20260709 12:11:27.000054 26473 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.009405 26283 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.000026 26445 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:27.035988 21892 connection.cc:256] RPC call timeout handler was delayed by -1.0446741549999388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:11:27.037716 21892 connection.cc:256] RPC call timeout handler was delayed by -1.03927415499993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 12:11:27.042892 22547 leader_election.cc:336] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.620s (SENT)
I20260709 12:11:27.020715 26439 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.043533 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.022401 26344 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.042738 25892 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:11:27.053874 26457 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.050101 26403 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:27.055442 26403 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.063568 26012 raft_consensus.cc:3055] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:27.064113 26012 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:27.065033 26012 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.066133 26012 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:27.068116 26392 consensus_meta.cc:287] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.000s
I20260709 12:11:27.072196 26292 raft_consensus.cc:3055] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:27.073309 26420 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:27.010048 26467 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.027436 26495 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:27.103749 26401 raft_consensus.cc:2243] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:11:27.112321 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 69640.9us
I20260709 12:11:27.113238 26465 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:27.113953 26413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.006s	sys 0.006s
W20260709 12:11:27.114444 26413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.006s	sys 0.006s
I20260709 12:11:27.114337 26465 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.070921 26343 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.112473 26470 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:27.093065 26292 raft_consensus.cc:740] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:27.123510 26401 pending_rounds.cc:70] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Trying to abort 1 pending ops.
W20260709 12:11:27.125572 26496 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:11:27.117789 26440 consensus_meta.cc:287] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.001s
I20260709 12:11:27.100564 26495 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.047197 26473 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.047070 26283 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:27.139588 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 377894us
I20260709 12:11:27.141930 21966 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.144776 26150 raft_consensus.cc:2764] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:27.144618 26470 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.138000 26495 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:27.147432 26470 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.118100 26467 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.143859 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:27.137710 26401 pending_rounds.cc:77] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Aborting op as it isn't in flight: id { term: 5 index: 6 } timestamp: 7305621660851404800 op_type: NO_OP noop_request { }
I20260709 12:11:27.176185 21966 leader_election.cc:400] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10.
I20260709 12:11:27.176759 21966 leader_election.cc:403] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:27.179574 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:27.170621 26351 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.183044 21966 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.187724 26154 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:27.188653 26503 log.cc:927] Time spent T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:11:27.178529 26483 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.194610 26467 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:27.194963 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 695) took 1681 ms. Trace:
I20260709 12:11:27.184813 26468 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10.
I20260709 12:11:27.195393 26467 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.195416 21843 rpcz_store.cc:276] 0709 12:11:25.513312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.513500 (+   188us) service_pool.cc:224] Handling call
0709 12:11:27.194765 (+1681265us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b5400206f54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:27.194899 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999128448}
I20260709 12:11:27.196969 26461 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.197419 26461 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.200661 22578 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.203400 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.204613 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.205340 22579 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 8: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.206146 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.208249 26439 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.212327 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 701) took 1070 ms. Trace:
I20260709 12:11:27.241539 21844 rpcz_store.cc:276] 0709 12:11:26.142012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.142194 (+   182us) service_pool.cc:224] Handling call
0709 12:11:27.212043 (+1069849us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b5400115b54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:27.212252 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626936064}
I20260709 12:11:27.241881 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:27.186919 21966 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:27.216382 22547 leader_election.cc:336] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.752s (SENT)
I20260709 12:11:27.218730 26392 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.242836 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.218808 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.166365 26458 consensus_queue.cc:1059] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:27.219842 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.221210 26408 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.244750 21924 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:27.240134 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.244743 21918 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:27.222549 26465 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.223047 22584 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:27.224335 26343 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.224618 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.268483 26439 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:27.267059 22578 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:27.228384 21817 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:27.234308 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.173308 26401 raft_consensus.cc:2889] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:11:27.235323 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.237190 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.237723 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.276367 21920 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.239459 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 700) took 1119 ms. Trace:
I20260709 12:11:27.278609 21851 rpcz_store.cc:276] 0709 12:11:26.120023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.120207 (+   184us) service_pool.cc:224] Handling call
0709 12:11:26.120702 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.977751 (+857049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.239269 (+261518us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54004015d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:27.239417 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1969224576}
I20260709 12:11:27.242403 22580 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.247406 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.245865 21996 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:27.247959 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.281076 21923 raft_consensus.cc:2393] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:27.247915 26469 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.248118 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.248062 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.248806 26392 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.240161 26474 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.250141 26458 consensus_queue.cc:1243] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:27.299305 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.251780 26292 consensus_queue.cc:260] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.186630 26456 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:27.255659 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 68786.7us
I20260709 12:11:27.256142 26475 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:27.257000 26329 raft_consensus.cc:993] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:11:27.257225 26473 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.331502 26329 raft_consensus.cc:1081] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
W20260709 12:11:27.259137 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 79628.4us
I20260709 12:11:27.283701 21999 raft_consensus.cc:2410] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:27.286698 22576 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:27.281942 21927 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:27.299422 26087 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.335784 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.174345 26451 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:27.287576 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 59281.4us
I20260709 12:11:27.288268 21924 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.288784 21925 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:27.291339 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.325685 26467 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.299347 26461 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.344071 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.303105 21967 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:27.258602 26472 consensus_queue.cc:1059] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:11:27.329305 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.329921 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:27.334533 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.290759 26401 raft_consensus.cc:2272] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:27.337216 21927 raft_consensus.cc:2393] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.341338 21919 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:27.342768 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.348549 21924 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.336620 25892 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.351078 21921 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:27.253192 26408 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.343319 21918 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:27.345227 21993 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 12:11:27.337342 26087 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.353904 21920 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:27.364393 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.357014 21924 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:27.365731 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.366495 21924 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.368149 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.369637 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:27.328523 26474 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.373214 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.380187 22583 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:27.380815 21967 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:27.353842 26468 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.382488 26468 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.382685 26235 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:27.383359 26235 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:27.383846 26235 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.377147 22581 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:27.350250 26392 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.378388 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.386044 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.373660 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.386700 21994 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 8.
I20260709 12:11:27.386984 21918 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:27.379287 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:27.381983 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:27.387670 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.388430 21927 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.345575 26341 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:27.380348 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.392395 21923 raft_consensus.cc:2368] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 7. Current term is 8.
I20260709 12:11:27.382860 26468 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.352101 26292 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:27.390839 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.391366 21999 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:27.391312 21964 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:27.393695 21966 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.402009 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.402601 21920 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:27.337774 26410 consensus_queue.cc:1059] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:11:27.397964 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.398655 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.399813 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.405982 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.406563 21918 raft_consensus.cc:2410] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:27.407627 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.408408 21918 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:27.409430 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.406577 21996 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.403071 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.403402 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.414958 21999 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:27.415495 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.415781 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.370111 26087 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.404045 21817 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:27.404229 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.384546 26419 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.417496 21994 raft_consensus.cc:2368] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12.
I20260709 12:11:27.426366 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.428843 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.410326 21918 raft_consensus.cc:2393] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 11: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:27.419039 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.420469 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.431192 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.431849 21920 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:27.432124 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.432628 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.433310 21920 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.433383 21994 raft_consensus.cc:2393] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:27.433312 21918 raft_consensus.cc:3055] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:27.434667 21918 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:27.436045 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:27.436187 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.436784 21846 raft_consensus.cc:2393] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.398404 26472 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:27.429450 21995 raft_consensus.cc:2376] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11. Re-sending same reply.
I20260709 12:11:27.448572 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:27.449414 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.449621 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.439711 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.440019 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:27.451376 21843 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.440325 21851 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:27.441391 26283 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:27.444504 21737 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1238ec38c933498cadf6153a5554f6e0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac07267c8cab47d4b59dc27d6fe9a386 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:27.388787 26483 consensus_queue.cc:1059] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:27.368585 25892 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.398602 26504 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:27.437384 22549 leader_election.cc:336] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.540s (SENT)
I20260709 12:11:27.479408 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:27.439455 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:27.481884 21844 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:27.482605 26361 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.482916 26439 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:27.486563 26472 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:11:27.487783 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 232826us
I20260709 12:11:27.490267 26386 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:27.491272 26386 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:27.491537 22547 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.507s (SENT)
I20260709 12:11:27.492071 22547 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.492734 26445 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.493149 26469 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.419672 26355 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:11:27.495573 26283 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:27.496209 26283 consensus_queue.cc:1243] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:27.492758 26351 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.497633 21925 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:27.429960 26419 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:27.498776 26419 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.428298 26344 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:11:27.502771 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.503682 21923 raft_consensus.cc:2410] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:11:27.504518 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.504693 26416 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.505925 21923 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:27.506834 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.507923 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.508073 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.509075 21995 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.416720 26392 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.511217 26258 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:27.511068 26392 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.513630 26436 raft_consensus.cc:3055] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:27.513798 26392 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.428594 26364 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:27.514761 26364 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.515205 26364 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.516902 26403 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.518481 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.519220 21997 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:27.519949 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.521099 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.521888 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.390669 26458 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:27.509992 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.418160 26475 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:27.565933 21919 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 7.
I20260709 12:11:27.447218 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.522701 21992 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:27.407445 26374 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.465471 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:27.466063 26461 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.470309 26486 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:27.571655 21919 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:27.458209 26341 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.514091 26436 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:27.456943 21920 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:27.522361 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.614704 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.527418 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 1848) took 1294 ms. Trace:
I20260709 12:11:27.538719 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.615621 21925 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:27.616328 22578 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:27.540709 22549 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:27.541998 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.618369 22000 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:27.619037 21893 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:27.565088 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.435792 21918 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.565536 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:27.543996 21926 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.555802 22581 pending_rounds.cc:85] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 10
I20260709 12:11:27.615525 22001 rpcz_store.cc:276] 0709 12:11:26.233010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.236946 (+  3936us) service_pool.cc:224] Handling call
0709 12:11:27.527194 (+1290248us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54003f4654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:27.527354 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296294784}
I20260709 12:11:27.539472 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.621470 21994 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:27.621649 26341 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.571834 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.622196 26341 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.573541 21919 pending_rounds.cc:85] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 9
I20260709 12:11:27.623435 21919 pending_rounds.cc:107] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:27.623808 21919 raft_consensus.cc:2889] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.548337 21843 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
W20260709 12:11:27.627017 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 60237us
I20260709 12:11:27.533385 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:27.628358 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 87739.8us
I20260709 12:11:27.628679 21924 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:27.532665 22547 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 2.050s (SENT)
I20260709 12:11:27.630043 22547 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.568804 21927 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:27.533507 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:27.573375 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 126239us
I20260709 12:11:27.465179 26408 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.541170 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:11:27.613757 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.620720 22581 pending_rounds.cc:107] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:27.648860 22581 raft_consensus.cc:2889] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.523945 22580 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:27.649914 22582 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:27.636875 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.565294 26333 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:11:27.640353 26497 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:27.532629 26401 ts_tablet_manager.cc:1916] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:11:27.643522 26012 consensus_meta.cc:287] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 12:11:27.644222 26436 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.670740 26469 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:27.670833 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 138195us
I20260709 12:11:27.671284 26436 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.672788 22547 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.673667 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.645373 26486 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.534802 26451 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.674121 26493 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.537436 26318 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:27.675891 26318 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.678040 26318 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.534070 26474 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.678689 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.681690 25892 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.685734 21924 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:27.651103 21918 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.695402 26461 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:27.629065 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:27.698809 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 69819.8us
I20260709 12:11:27.698953 26440 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:27.699347 26440 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:27.699699 26440 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.702971 22547 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.703224 26497 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.651796 21998 raft_consensus.cc:2368] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:27.703863 26497 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.704720 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.705308 21998 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.706969 25892 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:27.708158 25892 consensus_queue.cc:1243] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:27.708582 26361 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:27.708931 26361 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:27.709657 26361 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.702054 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:27.711001 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.655586 21926 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:27.712172 22547 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:27.712479 21926 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:27.665475 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:27.713932 21925 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.532387 25787 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:27.565389 26355 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:11:27.654346 26439 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.666955 26235 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.667882 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.668622 21923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:11:27.737180 21923 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:27.714654 21926 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.737519 21923 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.668838 26087 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.669570 21921 raft_consensus.cc:2410] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:27.670372 22576 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:27.577559 26329 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.527398 26458 consensus_queue.cc:1243] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:27.565572 26445 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 12:11:27.474108 26495 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.529737 26238 raft_consensus.cc:3055] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:27.745932 26238 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:27.746942 26469 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.747004 26238 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.747716 26469 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.748533 26238 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:27.566118 26475 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.750058 26475 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:27.750319 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.735787 26292 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:27.735940 25892 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.528726 26154 raft_consensus.cc:3055] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:27.754503 26235 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.754561 26154 raft_consensus.cc:740] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:27.487784 26472 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.681790 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.755702 21993 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:27.756372 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:27.756510 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.688475 21996 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:27.757639 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.758111 21996 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.735731 26361 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.642140 26468 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.762014 26419 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.742515 26493 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:27.762857 26493 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.763270 26493 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.764309 26468 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.764519 26419 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.689682 26416 consensus_queue.cc:1059] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:27.765074 21999 raft_consensus.cc:2368] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12.
I20260709 12:11:27.765419 26416 raft_consensus.cc:3055] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:27.765794 26416 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:27.766291 21847 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.740931 25787 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.766559 26416 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.742941 26012 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:27.767727 26012 consensus_queue.cc:1243] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:27.767834 26416 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.768097 25787 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.768931 22577 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 15. Current term is 17. Ops: []
I20260709 12:11:27.770046 26495 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:27.491595 26386 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:27.694502 26401 ts_tablet_manager.cc:1929] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:11:27.773656 21998 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:27.694562 26408 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:27.703372 26036 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:27.654836 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.785228 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:27.734748 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 70345.3us
I20260709 12:11:27.740748 21992 raft_consensus.cc:2368] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:27.741518 21918 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:27.786202 21997 raft_consensus.cc:2393] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.785989 22580 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:27.736440 26467 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:27.761780 26440 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.647181 26344 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.817207 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:27.820593 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:27.817965 21844 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:27.827607 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:27.828547 21851 raft_consensus.cc:2393] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.830355 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:27.824551 21923 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.772118 21925 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:27.772289 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:27.772559 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.831354 21924 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.780308 21998 raft_consensus.cc:1217] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Deduplicated request from leader. Original: 10.9->[11.10-12.11]   Dedup: 12.11->[]
I20260709 12:11:27.776096 21996 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:27.832373 21998 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 12. Current term is 13. Ops: [11.10-12.11]
I20260709 12:11:27.787271 21918 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:27.745262 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.834025 21998 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:27.803960 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:27.804399 21997 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:27.830958 21849 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:27.834529 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 89328.7us
I20260709 12:11:27.854074 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.855499 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.787387 21967 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:27.836426 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:27.858837 21848 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:27.836683 21992 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:27.837634 22580 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:27.835032 21964 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:27.839898 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:27.869287 21851 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.773221 26461 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:11:27.790221 26467 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:27.817965 26401 log.cc:1199] T d50c36e857cb4e33997aee7e5dd39447 P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/d50c36e857cb4e33997aee7e5dd39447
I20260709 12:11:27.871948 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:27.844993 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:27.873994 22001 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:27.875924 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.888569 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:27.889549 21923 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.787171 26283 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 12:11:27.889230 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 101924us
I20260709 12:11:27.896341 22549 leader_election.cc:400] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12.
I20260709 12:11:27.840167 26036 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:27.896822 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 92973.3us
W20260709 12:11:27.897150 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:27.896387 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 61456.8us
I20260709 12:11:27.896387 21996 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.817674 26458 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:11:27.869863 26495 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.870033 25892 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.826948 26329 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:11:27.829082 26344 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.840345 26436 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:11:27.840534 26408 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:11:27.914530 21849 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:27.897033 26439 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.896077 26374 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:27.927238 26374 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:27.927647 26401 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:32960 (request call id 0) took 3101 ms. Trace:
I20260709 12:11:27.928205 26401 rpcz_store.cc:276] 0709 12:11:24.834396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.834636 (+   240us) service_pool.cc:224] Handling call
0709 12:11:25.278582 (+443946us) ts_tablet_manager.cc:1151] Deleting tablet d50c36e857cb4e33997aee7e5dd39447
0709 12:11:25.292794 (+ 14212us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:11:27.676235 (+2383441us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:27.694336 (+ 18101us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:27.927519 (+233183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1734303,"tablet-delete.queue_time_us":398315,"thread_start_us":231702,"threads_started":1}
I20260709 12:11:27.929394 26355 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Committing config change with OpId 9.9: config changed from index 2 to 9, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:27.930984 26467 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.932340 26467 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.915833 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:27.846675 26386 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.908070 26410 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:27.934914 26410 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:27.935144 26386 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:27.935570 26483 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.936044 26483 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.935825 26410 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:27.913578 26504 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:27.940426 26497 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.920650 26439 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:27.946017 26439 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.950577 26258 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:27.950693 21926 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.951283 26258 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.952349 26486 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.953388 26258 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.954192 26012 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:27.954507 21843 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:27.954602 26012 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:27.956935 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:27.957314 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:27.958482 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:27.959498 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.960012 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:27.960330 25787 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:27.960865 25787 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.961898 21926 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:27.906183 26351 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:11:27.969252 26154 consensus_queue.cc:260] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.925110 26493 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.972987 26493 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:27.919705 26436 consensus_queue.cc:1243] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:11:27.976050 26440 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:27.976619 26497 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:27.978186 26473 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:27.978580 26473 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:27.912976 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 421236us
I20260709 12:11:27.908738 26456 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:27.993185 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:27.993270 26341 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.996088 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.979450 26473 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.928206 26374 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.997864 26473 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.998730 26349 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:27.989933 26455 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:28.002574 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:27.991048 26378 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.991449 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:27.978049 26439 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:27.991855 26154 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.936381 26483 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.996181 21993 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 12: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:27.988498 21851 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:27.987404 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:27.997118 26341 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:28.033064 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:28.028148 21966 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:28.029368 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:28.033860 22578 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:28.034257 22580 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.037709 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:28.038533 22577 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
W20260709 12:11:28.052248 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.056396 22580 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:28.063213 26341 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.063848 26341 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:28.064738 26341 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.068333 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:28.070883 22578 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:28.008810 26087 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:28.086001 22583 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:28.006703 26475 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.092240 26475 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:28.092849 21995 raft_consensus.cc:2368] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
I20260709 12:11:28.008253 26392 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:28.096916 26483 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.088277 26025 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.999450 26349 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:28.119990 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:28.120932 22579 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.078586 26419 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:28.149844 26392 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:28.089985 26514 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:11:28.103405 26292 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:28.151381 26513 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.157716 26513 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:28.156243 26419 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:28.159504 26439 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:28.123097 25787 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:28.160307 26238 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.159943 26392 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.160791 26238 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:28.162933 26238 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:28.139933 26025 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.099072 26154 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:11:28.165339 22582 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:11:28.169862 22579 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:28.177750 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:28.181102 22582 pending_rounds.cc:85] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 11
I20260709 12:11:28.181324 21851 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.181427 22582 pending_rounds.cc:107] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:11:28.181977 22582 raft_consensus.cc:2889] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.191385 21851 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:28.195554 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:28.200284 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 328428us
I20260709 12:11:28.207856 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.208693 21843 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
W20260709 12:11:28.181860 26403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.054s	sys 0.054s
I20260709 12:11:28.175081 26483 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:28.206966 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 335191us
I20260709 12:11:28.218972 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:28.204172 26238 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:28.211369 26403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.054s	sys 0.054s
I20260709 12:11:28.231333 22000 raft_consensus.cc:1240] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 8. Ops: []
I20260709 12:11:28.236100 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:28.236498 26344 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:28.236994 22580 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:28.236133 21967 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:28.241070 22579 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.248760 26012 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.250448 26012 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:28.159536 26419 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.260404 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:28.262326 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:28.262434 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:28.212000 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 313801us
I20260709 12:11:28.263847 21892 leader_election.cc:400] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:28.264144 21892 leader_election.cc:403] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:11:28.254367 26364 consensus_meta.cc:287] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.001s
I20260709 12:11:28.282604 26364 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:28.284819 26364 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:28.285377 26473 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:28.286823 26469 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:28.265159 26468 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.298491 26470 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.298385 26469 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:28.299188 26483 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:28.300398 26349 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:28.226655 26238 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:28.301304 26469 consensus_queue.cc:1059] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:28.301764 26238 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.302290 26036 raft_consensus.cc:3055] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:28.302721 26036 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:28.303512 26036 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.308643 22582 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 15. Current term is 17. Ops: [15.13-15.13]
W20260709 12:11:28.316777 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 53056.1us
I20260709 12:11:28.317602 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:28.323462 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 233782us
W20260709 12:11:28.326653 21815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.011s	sys 0.018s
W20260709 12:11:28.327090 21815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.011s	sys 0.018s
W20260709 12:11:28.327397 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 761388us
I20260709 12:11:28.325371 22579 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:28.332952 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:28.333084 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:28.333701 22000 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:28.334383 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:28.334950 21995 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.335001 21849 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:28.335542 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:28.335764 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.336503 21844 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:28.338160 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:28.338801 21844 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.332345 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:28.344650 21851 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:28.346778 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:28.349291 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:28.349731 21919 raft_consensus.cc:1240] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:28.350066 22000 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:28.351676 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.353034 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.355799 21815 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:28.345822 26364 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.357393 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:28.357673 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:28.357955 21918 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.321728 26470 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:28.361334 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:28.362010 21994 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.364399 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:28.364601 21892 leader_election.cc:400] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:28.364918 21892 leader_election.cc:403] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:28.338783 26473 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.360167 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:28.382791 22577 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:28.383100 21849 raft_consensus.cc:2368] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:28.363127 26515 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:28.363014 26350 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:28.370882 26445 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:28.371397 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:28.372884 26520 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.375438 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:28.402105 21923 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.403753 21892 leader_election.cc:400] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
I20260709 12:11:28.404151 21892 leader_election.cc:403] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:28.376140 26497 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:28.376259 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:28.377046 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.377741 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.367646 26386 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.367412 26364 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.379904 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:28.406947 21924 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:28.407115 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:28.380144 26517 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:11:28.320911 26012 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:28.418147 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.418838 21848 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:28.419961 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:28.420006 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.389271 22577 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:28.400633 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:28.400779 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:28.423552 21919 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:28.388692 21918 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:28.358440 26173 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:28.358184 26344 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:28.381721 22578 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 2 to 9, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:28.425622 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:28.429711 26036 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.405334 21815 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:28.413750 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:28.440171 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 107907us
I20260709 12:11:28.440342 21924 raft_consensus.cc:2376] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9. Re-sending same reply.
I20260709 12:11:28.440506 26504 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:28.414669 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:28.440933 26504 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.441327 26504 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.442749 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:28.444237 21818 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:28.446648 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.447157 22000 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:28.447502 22000 pending_rounds.cc:85] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 8
I20260709 12:11:28.447719 22000 pending_rounds.cc:107] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:28.447927 22000 raft_consensus.cc:2889] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.415961 21994 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:28.451628 21964 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:28.451982 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:28.452715 21996 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:28.454144 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:28.454538 26504 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:28.456530 21996 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:28.456712 26504 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:28.457368 26344 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:28.457497 26173 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.457967 26344 raft_consensus.cc:697] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:28.459532 26344 consensus_queue.cc:237] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:28.460039 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:28.458031 26173 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:28.462855 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 57608.1us
I20260709 12:11:28.465816 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:28.424623 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:28.464259 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:28.321067 26468 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:11:28.412313 21844 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:28.466784 21927 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
W20260709 12:11:28.468189 26518 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:11:28.465504 26521 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8.
I20260709 12:11:28.469147 21996 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:28.470677 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:28.394814 26515 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:28.471247 21921 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:28.471309 26515 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.472350 21998 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:28.473565 21998 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:28.473743 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:28.418314 26456 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.475317 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:28.417851 26436 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:11:28.475931 26513 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:28.475975 21994 raft_consensus.cc:2376] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8. Re-sending same reply.
I20260709 12:11:28.476868 26445 raft_consensus.cc:697] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:11:28.477077 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 58074.6us
I20260709 12:11:28.478191 22547 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:28.480494 26364 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:28.477799 26445 consensus_queue.cc:237] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.481309 26378 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:28.482250 26025 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:28.484619 22001 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 2 to 9, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:28.484946 26470 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.411381 26455 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.487318 26467 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:28.488180 26467 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:28.457690 21818 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:28.491020 21919 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:28.491269 21995 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:28.492288 21996 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:28.382078 26473 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:28.494623 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:28.495434 21927 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:28.498271 21921 raft_consensus.cc:2410] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:11:28.488493 26467 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:28.488945 26173 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:28.529719 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 64265.9us
I20260709 12:11:28.498185 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:28.531622 21995 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:28.493579 26103 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.536283 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:28.537007 21995 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.536746 26467 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.538518 26467 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.515400 21923 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:28.499383 21818 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:28.552287 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 52997.2us
I20260709 12:11:28.554682 26364 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.555347 26364 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:28.556376 26364 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:28.500567 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49006us
W20260709 12:11:28.503041 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.558629 26516 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:28.560210 21964 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:28.560920 26516 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:28.566778 26374 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:28.567358 26374 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.569379 26374 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:28.573478 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:28.573874 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:28.574824 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:28.599689 22577 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:28.578187 21995 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
W20260709 12:11:28.579146 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.591503 21844 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:28.571203 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:28.498728 26473 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:28.605021 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44906.9us
I20260709 12:11:28.527573 26495 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:28.605892 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:28.621054 21923 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.606508 26374 raft_consensus.cc:2804] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:28.608743 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.605685 26523 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:28.531312 26483 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.494149 25892 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 12:11:28.533281 26456 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:28.634794 26386 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.635026 21847 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:11:28.683421 21923 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:28.637934 26374 raft_consensus.cc:697] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:28.641089 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2588) took 1026 ms. Trace:
W20260709 12:11:28.643114 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.649928 22000 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:28.528049 26025 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:11:28.656910 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:28.667430 21844 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:11:28.630326 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 132242us
I20260709 12:11:28.679567 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:28.710562 22577 raft_consensus.cc:3060] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.684458 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:28.685333 22581 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:28.705737 21992 rpcz_store.cc:276] 0709 12:11:27.626402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.859766 (+233364us) service_pool.cc:224] Handling call
0709 12:11:27.860177 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:27.890758 (+ 30581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.890786 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:27.892728 (+  1942us) log.cc:844] Serialized 52 byte log entry
0709 12:11:28.307884 (+415156us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:28.329719 (+ 21835us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.439675 (+109956us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b1800408160. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be4d93060 00007f3be4da5716 00007f3be4db6287 00007f3be4db6208
0709 12:11:28.439865 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.439939 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.640824 (+200885us) raft_consensus.cc:1685] finished
0709 12:11:28.640904 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.641034 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62586,"prepare.queue_time_us":23965,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":145731,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":4431,"spinlock_wait_cycles":21475584,"thread_start_us":344449,"threads_started":1,"wal-append.queue_time_us":721218}
I20260709 12:11:28.636915 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2587) took 1093 ms. Trace:
I20260709 12:11:28.714875 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.673877 21893 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:28.693444 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:28.716284 21847 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:28.706095 22000 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:28.716914 21845 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.615669 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:28.678894 26355 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.028s	sys 0.035s
I20260709 12:11:28.790452 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:28.714087 21999 rpcz_store.cc:276] 0709 12:11:27.544275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.838720 (+294445us) service_pool.cc:224] Handling call
0709 12:11:27.839100 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.868651 (+ 29551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.868687 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.885476 (+ 16789us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.967253 (+ 81777us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b18002e7620. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:11:28.312150 (+344897us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:28.312200 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.312263 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.636531 (+324268us) raft_consensus.cc:1685] finished
0709 12:11:28.636564 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.636842 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6436,"raft.queue_time_us":34747,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3522,"spinlock_wait_cycles":3545984,"thread_start_us":344723,"threads_started":1,"wal-append.queue_time_us":730710}
I20260709 12:11:28.529570 26350 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:11:28.737201 21850 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:28.799921 26374 consensus_queue.cc:237] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.804008 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:28.805172 21746 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 7 to 8, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 8 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:27.930680 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet d50c36e857cb4e33997aee7e5dd39447 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:11:28.671446 26483 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:28.811656 21851 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:28.670831 26495 raft_consensus.cc:697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:11:28.752417 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.834779 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:28.651597 26515 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:28.735157 26341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.000s	sys 0.026s
W20260709 12:11:28.735484 22583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.011s
I20260709 12:11:28.847234 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:28.847926 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 174150us
I20260709 12:11:28.901881 21964 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:28.790586 22000 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:28.862967 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 247387us
I20260709 12:11:28.885548 22581 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:11:28.835368 22584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.003s	sys 0.017s
W20260709 12:11:28.903695 22584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.003s	sys 0.017s
W20260709 12:11:28.886348 21922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.009s	sys 0.009s
W20260709 12:11:28.904268 21922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.009s	sys 0.009s
I20260709 12:11:28.904526 21918 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:11:28.823768 26472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.019s	sys 0.052s
W20260709 12:11:28.905179 26258 consensus_queue.cc:1175] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" responder_term: 11 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:28.863478 26436 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.899811 26012 consensus_queue.cc:1059] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 12:11:28.906399 26341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.000s	sys 0.027s
W20260709 12:11:28.841006 26392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.021s	sys 0.009s
W20260709 12:11:28.897805 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 66051.8us
I20260709 12:11:28.885358 21746 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:28.927999 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:28.927665 21746 catalog_manager.cc:5697] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:28.928931 21746 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 9 to 11, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 11 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:28.899896 21736 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 969278us
I20260709 12:11:28.903331 22579 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:28.884801 26483 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.681804 26523 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:28.905857 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 58749.6us
I20260709 12:11:28.903786 22000 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.884801 26457 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:28.899993 26520 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.905725 26103 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.834921 26365 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.921075 26497 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:28.868916 26238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.021s	sys 0.064s
W20260709 12:11:28.862581 26355 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.029s	sys 0.044s
I20260709 12:11:28.894062 26361 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.884444 26521 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.976569 21748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58722 (request call id 273) took 21339 ms (client timeout 15000 ms). Trace:
I20260709 12:11:28.976464 26521 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.978550 26521 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:28.925836 21849 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:28.979535 26361 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:28.927842 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:28.930392 21746 catalog_manager.cc:5697] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 6 to 13, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 13 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:28.981043 21992 raft_consensus.cc:2393] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 12: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:28.980939 26361 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.865923 22577 raft_consensus.cc:2468] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
W20260709 12:11:28.907306 22583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.015s	sys 0.016s
I20260709 12:11:28.967543 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:28.981563 21746 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:28.988477 21746 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 8 to 10, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 10 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:28.864789 26154 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:28.935920 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:28.991392 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 55571.7us
I20260709 12:11:28.992399 21892 leader_election.cc:400] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:28.993373 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:28.911633 26472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.020s	sys 0.057s
W20260709 12:11:28.863495 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 145669us
I20260709 12:11:28.948052 22579 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:28.918016 26012 consensus_queue.cc:1243] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer cffb5c192e144f7caa7b94271976ed42 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:28.918449 25891 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.909940 26448 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.959520 21845 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:28.894883 26403 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 12:11:28.931562 26392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.022s	sys 0.009s
I20260709 12:11:29.028028 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:28.966572 26526 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
I20260709 12:11:28.959213 26497 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.967479 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:29.033869 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 66522.3us
I20260709 12:11:28.917395 26436 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:28.980753 26515 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:28.959632 26238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.026s	sys 0.064s
I20260709 12:11:28.945323 26456 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:29.014292 21926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.008s	sys 0.022s
I20260709 12:11:29.017423 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:29.017215 21746 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 7 to 10, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 10 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:29.040164 21926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.009s	sys 0.023s
I20260709 12:11:28.969002 26523 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:29.016271 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 60353.3us
I20260709 12:11:29.019932 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:29.030234 26517 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:29.023432 26012 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.964025 26365 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:29.021994 26451 raft_consensus.cc:3055] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:28.946000 26103 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.965756 26495 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:29.028833 21845 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:29.026969 26154 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.046041 26355 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:11:29.030023 26235 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:11:29.035403 21817 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:28.949476 26457 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.016772 26521 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.040042 21850 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 12:11:29.040741 21746 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 6, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 6 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:29.018971 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:29.123894 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 105030us
I20260709 12:11:29.124841 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:29.019383 21844 raft_consensus.cc:1240] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.040087 21847 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:29.126633 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.034586 26448 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:29.025097 26419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.016s	sys 0.011s
W20260709 12:11:29.029290 26470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.023s	sys 0.011s
I20260709 12:11:29.046062 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:29.020367 26344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.024s
I20260709 12:11:29.025331 26469 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.051411 21993 raft_consensus.cc:1240] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:11:28.977088 21748 rpcz_store.cc:269] 0709 12:11:07.637708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.641528 (+  3820us) service_pool.cc:224] Handling call
0709 12:11:28.976479 (+21334951us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:25.307208 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:25.307803 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:25.307860 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:11:25.307880 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:25.413665 (+105785us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:25.425464 (+ 11799us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:25.430160 (+  4696us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:11:25.722110 (+291950us) tablet.cc:701] Row locks acquired
0709 12:11:25.722164 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:11:25.722356 (+   192us) write_op.cc:270] Start()
0709 12:11:25.722524 (+   168us) write_op.cc:276] Timestamp: P: 1783599085722288 usec, L: 0
0709 12:11:25.722543 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:11:25.829357 (+106814us) log.cc:844] Serialized 7472 byte log entry
0709 12:11:26.182661 (+353304us) op_driver.cc:464] REPLICATION: finished
0709 12:11:26.300642 (+117981us) write_op.cc:301] APPLY: starting
0709 12:11:26.300759 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:26.452078 (+151319us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:26.452190 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:26.917642 (+465452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:26.918025 (+   383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:11:26.918069 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:26.918560 (+   491us) log.cc:844] Serialized 172 byte log entry
0709 12:11:26.918760 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:26.918959 (+   199us) write_op.cc:454] Released schema lock
0709 12:11:26.919031 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:26.962951 (+ 43920us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:26.963752 (+   801us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":211110,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":117683,"apply.run_cpu_time_us":32136,"apply.run_wall_time_us":648419,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77293,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":1403,"lbm_reads_lt_1ms":12,"num_ops":19,"prepare.queue_time_us":295305,"prepare.run_cpu_time_us":9332,"prepare.run_wall_time_us":522617,"replication_time_us":453924,"spinlock_wait_cycles":54656,"thread_start_us":339926,"threads_started":2}]]}
W20260709 12:11:29.052845 21997 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.012s	sys 0.021s
W20260709 12:11:29.163213 21997 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.013s	sys 0.022s
I20260709 12:11:29.062633 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:29.036048 26497 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.037169 26472 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.968487 26173 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:29.035509 25891 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:29.043855 26318 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:29.021034 22582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.023s	sys 0.005s
W20260709 12:11:29.153216 26344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.008s	sys 0.024s
I20260709 12:11:29.029217 21851 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:29.045006 26386 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:11:29.118670 22549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.843s (SENT) [suppressed 31 similar messages]
I20260709 12:11:29.045219 26530 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:11:29.076766 26103 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.136415 21845 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 17.
W20260709 12:11:29.144781 22547 leader_election.cc:336] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.651s (SENT)
I20260709 12:11:29.227458 22547 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:29.228106 22577 raft_consensus.cc:3055] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:29.228370 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 83672.1us
I20260709 12:11:29.228554 22577 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:29.151675 21746 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 6 to 10, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 10 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:29.076876 26475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.010s	sys 0.014s
I20260709 12:11:29.079681 26012 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.167210 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 131879us
I20260709 12:11:29.243598 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:29.161865 26419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.016s	sys 0.012s
W20260709 12:11:29.162590 26470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.023s	sys 0.011s
W20260709 12:11:29.170755 22582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.023s	sys 0.005s
W20260709 12:11:29.021318 26445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.012s	sys 0.016s
W20260709 12:11:29.171447 22575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.015s	sys 0.015s
W20260709 12:11:29.250376 22575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.016s	sys 0.016s
W20260709 12:11:29.185835 26539 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.220s	user 0.001s	sys 0.001s
I20260709 12:11:29.188177 26238 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.197075 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:29.168607 26517 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:11:29.229063 22547 leader_election.cc:336] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.682s (SENT)
I20260709 12:11:29.068634 26451 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:29.229322 21997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 770) took 1683 ms. Trace:
I20260709 12:11:29.171380 26364 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:29.234628 21746 catalog_manager.cc:5697] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 12, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 12 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.236471 26333 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.230432 26523 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:29.236192 26475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.010s	sys 0.015s
I20260709 12:11:29.173251 26472 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.231658 22577 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:29.175041 26521 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.166272 26469 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:29.237253 22576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.040s	sys 0.028s
I20260709 12:11:29.258150 21997 rpcz_store.cc:276] 0709 12:11:27.546337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.853053 (+306716us) service_pool.cc:224] Handling call
0709 12:11:27.853342 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.888409 (+ 35067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.888447 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.888886 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.319026 (+430140us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:29.163632 (+844606us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.229020 (+ 65388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.229101 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.229140 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:29.229151 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.229271 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104862,"prepare.queue_time_us":81599,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":102605,"raft.run_cpu_time_us":2617,"raft.run_wall_time_us":24119,"thread_start_us":1168702,"threads_started":2,"wal-append.queue_time_us":725642}
W20260709 12:11:29.255964 26445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.013s	sys 0.016s
I20260709 12:11:29.260907 21746 catalog_manager.cc:5697] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.275544 21746 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 10 to 11, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 11 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:29.273983 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 338789us
I20260709 12:11:29.284788 21746 catalog_manager.cc:5697] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:29.266758 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 364929us
I20260709 12:11:29.269456 22577 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:29.273231 21998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.020s	sys 0.035s
W20260709 12:11:29.246861 22001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.009s	sys 0.019s
I20260709 12:11:29.273185 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:29.273854 22576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.040s	sys 0.028s
I20260709 12:11:29.298511 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1025) took 1268 ms. Trace:
W20260709 12:11:29.300083 22001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.009s	sys 0.019s
I20260709 12:11:29.303444 22000 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
W20260709 12:11:29.258682 21920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.011s	sys 0.010s
I20260709 12:11:29.288515 21746 catalog_manager.cc:5697] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 7, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 7 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:29.304872 21920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.012s	sys 0.010s
W20260709 12:11:29.296434 21998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.020s	sys 0.035s
I20260709 12:11:29.309062 22577 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:29.305763 21746 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 7 to 8, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 8 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:29.309487 22577 pending_rounds.cc:85] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 10
I20260709 12:11:29.312613 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:29.248917 26012 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.310180 21746 catalog_manager.cc:5697] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 6 to 9, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 9 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:29.310945 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.268208 26364 raft_consensus.cc:697] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:29.315666 22577 pending_rounds.cc:107] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:29.322297 22577 raft_consensus.cc:2889] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.260983 26238 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:29.332438 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.323244 22578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.006s	sys 0.032s
I20260709 12:11:29.423686 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:29.437150 21746 catalog_manager.cc:5697] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 7, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 7 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:29.425014 22547 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.905s (SENT)
W20260709 12:11:29.314947 26468 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:29.310602 21966 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:29.439327 22578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.007s	sys 0.033s
I20260709 12:11:29.440507 21847 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:29.316359 26436 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:29.442622 21924 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 12:11:29.447440 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:29.442922 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:29.443931 21919 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:29.489204 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.531876 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:29.275287 26521 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:29.451936 21746 catalog_manager.cc:5697] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 6, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 6 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.538287 21924 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:29.574396 21924 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:29.350831 26520 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:29.564620 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 439855us
I20260709 12:11:29.589478 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:29.563702 22584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.022s	sys 0.012s
I20260709 12:11:29.579988 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:29.582880 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:29.595160 22584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.022s	sys 0.013s
W20260709 12:11:29.578785 21849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.029s
W20260709 12:11:29.595891 21849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.007s	sys 0.029s
W20260709 12:11:29.596414 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 477761us
I20260709 12:11:29.577534 21746 catalog_manager.cc:5697] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 3 to 6, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 6 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.601796 21746 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:29.322968 26504 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.248s
W20260709 12:11:29.580950 26536 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.502s	user 0.006s	sys 0.004s
I20260709 12:11:29.608739 26486 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:29.582872 26546 log.cc:927] Time spent T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.503s	user 0.000s	sys 0.001s
I20260709 12:11:29.536708 26436 raft_consensus.cc:2764] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:11:29.600122 26547 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.451s	user 0.001s	sys 0.001s
I20260709 12:11:29.309331 25891 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:29.632284 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 193231us
W20260709 12:11:29.636700 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 326160us
W20260709 12:11:29.611123 26545 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.490s	user 0.001s	sys 0.001s
I20260709 12:11:29.585347 26475 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:29.652072 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2599) took 1243 ms. Trace:
I20260709 12:11:29.658324 22001 rpcz_store.cc:276] 0709 12:11:28.408673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.466534 (+ 57861us) service_pool.cc:224] Handling call
0709 12:11:28.484323 (+ 17789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.484513 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:28.654361 (+169848us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.617245 (+962884us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.651660 (+ 34415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.651729 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.651786 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.651861 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.651996 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71062,"prepare.queue_time_us":3220,"raft.queue_time_us":269306,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":23189,"thread_start_us":928399,"threads_started":2}
I20260709 12:11:29.618778 26154 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:29.613415 26344 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:29.615521 26365 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:29.442143 26451 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:29.648929 26534 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.429s	user 0.001s	sys 0.000s
I20260709 12:11:29.704054 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 1034) took 1473 ms. Trace:
I20260709 12:11:29.673427 26457 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:29.675271 26378 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:29.685571 26343 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.672037 26562 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:29.698886 26543 log.cc:927] Time spent T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.467s	user 0.001s	sys 0.001s
I20260709 12:11:29.710772 22583 rpcz_store.cc:276] 0709 12:11:28.230548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.230728 (+   180us) service_pool.cc:224] Handling call
0709 12:11:28.231077 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.231481 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.231512 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.232046 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.983579 (+751533us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:28.983634 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.983726 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.703782 (+720056us) raft_consensus.cc:1685] finished
0709 12:11:29.703807 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.703983 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1121,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":751096,"threads_started":1,"wal-append.queue_time_us":803900}
I20260709 12:11:29.674476 26470 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:11:29.634747 26486 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.748309 21847 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:29.686715 26173 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:29.719483 26548 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
I20260709 12:11:29.756238 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:29.735121 26538 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.491s	user 0.000s	sys 0.001s
I20260709 12:11:29.768484 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:29.683986 26475 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:29.747138 26542 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.486s	user 0.001s	sys 0.001s
I20260709 12:11:29.723935 26368 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:29.772089 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.723954 26351 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.780889 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2262) took 1430 ms. Trace:
I20260709 12:11:29.782035 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1034) took 1403 ms. Trace:
I20260709 12:11:29.724471 26378 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:29.784317 26556 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:11:29.784957 26554 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
I20260709 12:11:29.626081 26364 consensus_queue.cc:237] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.764820 26451 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.795079 22582 rpcz_store.cc:276] 0709 12:11:28.378939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.379972 (+  1033us) service_pool.cc:224] Handling call
0709 12:11:28.380274 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.380614 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.380642 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.381095 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.249830 (+868735us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:29.266158 (+ 16328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.266220 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.781813 (+515593us) raft_consensus.cc:1685] finished
0709 12:11:29.781831 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.781977 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70598,"raft.queue_time_us":1574,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":16581,"thread_start_us":839384,"threads_started":1,"wal-append.queue_time_us":643404}
I20260709 12:11:29.709728 26344 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:29.776773 26552 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.499s	user 0.001s	sys 0.000s
I20260709 12:11:29.846181 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1041) took 1272 ms. Trace:
I20260709 12:11:29.846433 26344 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:29.846699 22580 rpcz_store.cc:276] 0709 12:11:28.573515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.576633 (+  3118us) service_pool.cc:224] Handling call
0709 12:11:28.576891 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.577229 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.577256 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.577861 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.037137 (+459276us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:29.037192 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.037262 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.845923 (+808661us) raft_consensus.cc:1685] finished
0709 12:11:29.845951 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.846108 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21652,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":16759,"thread_start_us":458956,"threads_started":1,"wal-append.queue_time_us":677247}
I20260709 12:11:29.802455 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:29.731920 26365 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 12:11:29.781921 26540 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.520s	user 0.000s	sys 0.001s
I20260709 12:11:29.849591 22583 raft_consensus.cc:2410] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:11:29.785737 26555 log.cc:927] Time spent T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:11:29.851153 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 1038) took 1470 ms. Trace:
I20260709 12:11:29.851508 22575 rpcz_store.cc:276] 0709 12:11:28.380912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.381128 (+   216us) service_pool.cc:224] Handling call
0709 12:11:28.381415 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.381730 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.381762 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.410644 (+ 28882us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.644597 (+233953us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b1800466720. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:11:29.256107 (+611510us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.256164 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.256236 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.850875 (+594639us) raft_consensus.cc:1685] finished
0709 12:11:29.850893 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.851096 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28117,"raft.queue_time_us":12658,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":9389,"spinlock_wait_cycles":4426112,"thread_start_us":606040,"threads_started":1,"wal-append.queue_time_us":1141289}
I20260709 12:11:29.827239 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:29.828375 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.794934 21922 rpcz_store.cc:276] 0709 12:11:28.350432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.351739 (+  1307us) service_pool.cc:224] Handling call
0709 12:11:28.351979 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.376640 (+ 24661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.376670 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.377092 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.904683 (+527591us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:28.904721 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.904780 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.780637 (+875857us) raft_consensus.cc:1685] finished
0709 12:11:29.780664 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.780833 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24238,"raft.queue_time_us":25273,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":527250,"threads_started":1,"wal-append.queue_time_us":740082}
I20260709 12:11:29.782689 26436 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:29.855293 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:29.753736 26343 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:29.786262 26577 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.859278 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:29.864109 21922 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.714392 26520 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:29.835894 26575 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:11:29.861383 26515 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:29.861430 26365 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:29.862608 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:29.806833 26378 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:29.840909 26012 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:29.801249 26374 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.874459 26238 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:29.856652 26341 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:29.859760 26469 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:29.878222 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:29.800966 26368 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.879328 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:29.875950 26553 log.cc:927] Time spent T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 12:11:29.857573 26472 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:29.887646 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:29.841179 26448 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:29.875566 26365 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:29.901389 21993 raft_consensus.cc:2393] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:29.893285 21999 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:29.819275 26351 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:29.872015 26361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.014s	sys 0.014s
I20260709 12:11:29.907774 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2261) took 1559 ms. Trace:
I20260709 12:11:29.884075 26515 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:29.962637 26473 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.303s	user 0.012s	sys 0.000s
I20260709 12:11:29.963156 26473 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.958838 21815 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:29.908391 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2274) took 1264 ms. Trace:
I20260709 12:11:29.967609 21920 rpcz_store.cc:276] 0709 12:11:28.643902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.644075 (+   173us) service_pool.cc:224] Handling call
0709 12:11:28.644471 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.644711 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.644749 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.645252 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.305314 (+660062us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:29.305365 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.305430 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.908126 (+602696us) raft_consensus.cc:1685] finished
0709 12:11:29.908155 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.908322 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":659635,"threads_started":1,"wal-append.queue_time_us":779680}
I20260709 12:11:29.871640 26344 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:11:29.960294 21926 rpcz_store.cc:276] 0709 12:11:28.348548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.348701 (+   153us) service_pool.cc:224] Handling call
0709 12:11:28.348971 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.373392 (+ 24421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.373422 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.373885 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.040655 (+666770us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:29.040693 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.040776 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.907501 (+866725us) raft_consensus.cc:1685] finished
0709 12:11:29.907531 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.907704 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24039,"raft.queue_time_us":25106,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":666443,"threads_started":1,"wal-append.queue_time_us":873154}
W20260709 12:11:29.964704 26361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.015s	sys 0.014s
W20260709 12:11:29.906157 26551 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 12:11:29.954756 26173 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.892154 26012 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:29.984980 26586 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:11:29.870340 26577 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:29.892758 26341 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.975190 26584 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:11:29.888087 26374 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.974941 26516 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:11:29.990067 26515 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:30.026901 26564 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:11:29.971935 26419 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
W20260709 12:11:30.086038 26103 consensus_meta.cc:287] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.000s
I20260709 12:11:30.088169 26351 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:30.090595 26568 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:11:30.091902 26561 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
W20260709 12:11:30.105091 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 133062us
I20260709 12:11:30.108033 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:30.126547 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.034934 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.185495 21920 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:30.076442 26365 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:30.181828 21892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.040s	sys 0.053s
W20260709 12:11:30.186071 21892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.040s	sys 0.053s
W20260709 12:11:30.186820 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 597417us
I20260709 12:11:30.184744 22575 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:30.194171 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:30.196705 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.198256 21892 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:30.139016 26445 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.079365 26012 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:30.202749 26585 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:30.204016 26597 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:11:30.208639 21920 raft_consensus.cc:2393] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 8: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:30.184197 26475 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.182669 26173 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:11:30.193197 26551 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:30.189291 26486 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:30.244917 26567 log.cc:927] Time spent T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:30.211541 26351 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:30.246908 21920 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:30.248173 26521 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.194301 26436 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.187176 26103 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:30.257650 26343 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.309036 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 708) took 1293 ms. Trace:
I20260709 12:11:30.309584 21849 rpcz_store.cc:276] 0709 12:11:29.016060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.016198 (+   138us) service_pool.cc:224] Handling call
0709 12:11:29.035664 (+ 19466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:29.036106 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.036150 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:29.036876 (+   726us) log.cc:844] Serialized 52 byte log entry
0709 12:11:29.596364 (+559488us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.596401 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.596473 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.308828 (+712355us) raft_consensus.cc:1685] finished
0709 12:11:30.308846 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.308979 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1016,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8002,"thread_start_us":527781,"threads_started":1,"wal-append.queue_time_us":814165}
I20260709 12:11:30.312219 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2603) took 1784 ms. Trace:
I20260709 12:11:30.214355 26445 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:30.312599 21998 rpcz_store.cc:276] 0709 12:11:28.527824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.527962 (+   138us) service_pool.cc:224] Handling call
0709 12:11:28.543247 (+ 15285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.604426 (+ 61179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.604470 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.605973 (+  1503us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.725864 (+119891us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b1800143d40. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:11:29.305815 (+579951us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:29.305851 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.305909 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.305763 (+999854us) raft_consensus.cc:1685] finished
0709 12:11:30.305782 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.312159 (+  6377us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60705,"raft.queue_time_us":61347,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":12512000,"thread_start_us":579768,"threads_started":1,"wal-append.queue_time_us":1066001}
I20260709 12:11:30.313859 21922 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:30.314010 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:30.321758 26587 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:11:30.270097 26448 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:30.322345 26448 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:30.323437 26333 consensus_meta.cc:287] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.056s	user 0.010s	sys 0.000s
I20260709 12:11:30.323849 26333 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.324386 26448 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:30.303422 26436 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:30.325985 26558 log.cc:927] Time spent T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.558s	user 0.001s	sys 0.000s
I20260709 12:11:30.316262 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:30.327781 21999 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:30.257810 26173 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:30.316893 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:30.328807 26012 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:30.321164 26368 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:30.326867 26436 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:30.330070 26173 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.322003 21994 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
W20260709 12:11:30.320597 26523 consensus_meta.cc:287] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 1.053s	user 0.006s	sys 0.003s
I20260709 12:11:30.331890 26523 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.308195 26473 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:30.321892 26378 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:30.335599 26483 consensus_meta.cc:287] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.385s	user 0.013s	sys 0.000s
W20260709 12:11:30.352809 21892 connection.cc:256] RPC call timeout handler was delayed by -1.1367792920000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 12:11:30.354491 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.358103 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:30.362979 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:30.380172 26571 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:30.356369 26473 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:30.382786 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:30.378858 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2205) took 1724 ms. Trace:
I20260709 12:11:30.386473 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:30.361485 26436 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.387943 21999 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:30.351632 26483 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:30.360320 26351 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 12:11:30.396610 26541 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 1.222s	user 0.003s	sys 0.003s
I20260709 12:11:30.399204 26445 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.401388 25891 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.403512 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2523) took 1088 ms. Trace:
I20260709 12:11:30.403601 26486 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:30.362644 26604 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:11:30.383713 21848 rpcz_store.cc:276] 0709 12:11:28.654812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.663424 (+  8612us) service_pool.cc:224] Handling call
0709 12:11:28.712680 (+ 49256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.864010 (+151330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.864057 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.894986 (+ 30929us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.964943 (+ 69957us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b180010b760. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:11:29.449046 (+484103us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:29.449099 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.449189 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.364674 (+915485us) raft_consensus.cc:1685] finished
0709 12:11:30.364693 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.378791 (+ 14098us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161888,"raft.queue_time_us":182323,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8818,"spinlock_wait_cycles":14395648,"thread_start_us":483898,"threads_started":1,"wal-append.queue_time_us":1436298}
I20260709 12:11:30.411044 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:30.364306 26103 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.384481 26012 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:30.389092 26577 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.423035 21918 rpcz_store.cc:276] 0709 12:11:29.315547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.315964 (+   417us) service_pool.cc:224] Handling call
0709 12:11:29.429048 (+113084us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:29.676805 (+247757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.676853 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:29.721558 (+ 44705us) log.cc:844] Serialized 582 byte log entry
0709 12:11:29.818926 (+ 97368us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.819016 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.819113 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.403292 (+584179us) raft_consensus.cc:1685] finished
0709 12:11:30.403318 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.403454 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":302586,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":8299,"thread_start_us":274518,"threads_started":2,"wal-append.queue_time_us":591914}
I20260709 12:11:30.430984 26576 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.431525 26576 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:29.299013 22576 rpcz_store.cc:276] 0709 12:11:28.029863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.030011 (+   148us) service_pool.cc:224] Handling call
0709 12:11:28.030281 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.030518 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:28.500166 (+469648us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.298042 (+797876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.298116 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.298177 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.298274 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.298433 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":601495,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":102,"thread_start_us":1235687,"threads_started":2}
I20260709 12:11:30.433631 26576 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:30.439136 26012 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:30.440145 26012 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:30.440831 26483 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:30.417274 26374 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:30.424345 26451 consensus_meta.cc:287] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.001s
I20260709 12:11:30.450321 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.452507 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.462375 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.462662 21923 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
I20260709 12:11:30.462662 21922 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:30.388723 26473 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:30.463841 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.466969 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.467494 21919 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:11:30.434154 26576 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.463846 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.467989 21919 pending_rounds.cc:85] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 5
I20260709 12:11:30.470966 21919 pending_rounds.cc:107] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:30.471024 21923 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:30.471231 21919 raft_consensus.cc:2889] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.476065 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.425302 25891 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:30.499682 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.502089 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:30.506342 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.520555 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:30.521539 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 99473.2us
I20260709 12:11:30.478348 26576 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:30.529866 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:30.529145 26497 consensus_meta.cc:287] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.354s	user 0.013s	sys 0.000s
I20260709 12:11:30.524832 26410 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.535876 21923 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:30.530036 26378 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.537317 21964 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:30.538955 26468 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.536847 26497 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:30.539398 26612 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:30.539444 26468 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.540071 26468 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:30.540369 26610 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:30.541406 26497 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:30.542460 26535 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 1.534s	user 0.017s	sys 0.015s
I20260709 12:11:30.546809 21921 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 13: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:30.538645 26410 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:30.548933 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.549665 26410 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:30.551407 21964 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:30.551753 26576 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.552035 26620 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.552397 26576 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.552778 26576 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:30.553174 26576 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.532004 26619 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:30.554926 21964 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:30.536491 25891 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:30.556066 26235 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:30.555066 26619 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.561061 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.562526 21927 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:30.565187 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:30.563720 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.567847 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:30.571373 21849 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:30.571305 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.572865 21927 raft_consensus.cc:2410] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:11:30.573297 21848 raft_consensus.cc:1240] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:30.556576 26235 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:30.586292 26473 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:30.593585 26606 log.cc:927] Time spent T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.346s	user 0.002s	sys 0.001s
I20260709 12:11:30.575527 26467 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.596084 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 2536) took 1150 ms. Trace:
I20260709 12:11:30.596218 21926 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:30.596537 21921 rpcz_store.cc:276] 0709 12:11:29.445210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.530489 (+ 85279us) service_pool.cc:224] Handling call
0709 12:11:30.595857 (+1065368us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54003e71d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:30.596012 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2188645120}
I20260709 12:11:30.599082 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:30.569921 26619 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.578677 26497 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:11:30.612856 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2530) took 1169 ms. Trace:
I20260709 12:11:30.615391 26341 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:30.618964 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.622969 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:30.623155 21921 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:30.613152 21919 rpcz_store.cc:276] 0709 12:11:29.443524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.535086 (+ 91562us) service_pool.cc:224] Handling call
0709 12:11:29.535360 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.471809 (+936449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.612682 (+140873us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54001a3e54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:30.612810 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142696832}
I20260709 12:11:30.624626 26468 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:30.626713 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:30.627328 21995 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:30.622309 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:30.628826 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:30.602573 26467 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.631652 26467 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.632378 26386 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.633090 21992 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:30.635015 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:30.634016 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:30.636483 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.609539 26475 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:30.638753 21815 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:30.609277 26235 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:30.643103 26025 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:30.638731 26575 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.644287 26575 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:30.643851 26475 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:30.645530 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:30.645473 21817 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:30.651885 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2537) took 1182 ms. Trace:
I20260709 12:11:30.656188 21924 rpcz_store.cc:276] 0709 12:11:29.469369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.575351 (+105982us) service_pool.cc:224] Handling call
0709 12:11:29.575743 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.894301 (+318558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.894349 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.900431 (+  6082us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.215115 (+314684us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.270030 (+ 54915us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.307071 (+ 37041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.307143 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.593129 (+285986us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b24001a6438. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1b349c4 00007f3be1b32acb 00007f3be1ceddc9 00007f3be1ceda55 00007f3be1ced09d 00007f3be491f10e 00007f3be493688c 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221
0709 12:11:30.649647 (+ 56518us) raft_consensus.cc:1685] finished
0709 12:11:30.651682 (+  2035us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.651827 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":237675,"prepare.queue_time_us":95369,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":231590,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":8501,"spinlock_wait_cycles":25106688,"thread_start_us":609457,"threads_started":2,"wal-append.queue_time_us":341476}
I20260709 12:11:30.651767 26344 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:30.658385 26344 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:30.665774 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.644672 26575 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.666333 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:30.667635 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:30.670810 21849 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:30.632865 26386 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:30.659070 26364 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:30.662771 26468 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:30.677894 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.680420 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:30.681661 21927 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:11:30.682981 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.679396 26364 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:30.684722 26580 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:30.685092 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.660772 25892 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:30.685272 21893 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:30.697283 26012 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.665983 26292 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:30.680413 26351 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.691619 21927 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.696080 22547 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:30.686771 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:30.686532 26173 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.678225 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1036) took 2298 ms. Trace:
I20260709 12:11:30.672159 26495 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:30.680147 26361 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:30.690914 26523 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:30.703806 25892 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:30.773073 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.711205 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:30.846863 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 150430us
I20260709 12:11:30.934150 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:30.941804 22576 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 17.
I20260709 12:11:30.942044 21817 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:30.932272 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:30.941947 22582 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:30.943253 22578 rpcz_store.cc:276] 0709 12:11:28.379492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.381233 (+  1741us) service_pool.cc:224] Handling call
0709 12:11:28.381444 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.381614 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:28.503458 (+121844us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.566400 (+1062942us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.658872 (+1092472us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b18004739e0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be4d93060 00007f3be4da5716 00007f3be4db6287 00007f3be4db6208
0709 12:11:30.677820 (+ 18948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.677891 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:30.677951 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.678035 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.678152 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1088487,"prepare.queue_time_us":125592,"raft.queue_time_us":1102719,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":129276,"spinlock_wait_cycles":36915200,"thread_start_us":955796,"threads_started":2,"wal-append.queue_time_us":1371671}
I20260709 12:11:30.848158 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:30.711179 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:30.945421 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 234283us
I20260709 12:11:30.746275 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:30.946270 21846 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 7.
W20260709 12:11:30.847340 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 160637us
I20260709 12:11:30.947947 21927 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:30.959877 21849 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:30.959923 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:30.665287 26344 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:30.845194 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:30.976824 21852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 1983) took 2586 ms (client timeout 1841 ms). Trace:
W20260709 12:11:30.978099 21852 rpcz_store.cc:269] 0709 12:11:28.376202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.376799 (+   597us) service_pool.cc:224] Handling call
0709 12:11:30.962304 (+2585505us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b5400206f54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:30.962458 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078134528}
I20260709 12:11:30.964114 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2215) took 1213 ms. Trace:
I20260709 12:11:31.007228 21850 rpcz_store.cc:276] 0709 12:11:29.751003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.751753 (+   750us) service_pool.cc:224] Handling call
0709 12:11:29.777699 (+ 25946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.883581 (+105882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.883626 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.883683 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.883727 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.963893 (+1080166us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000a82d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:30.963935 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.964060 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10211,"raft.queue_time_us":13439,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":62303,"spinlock_wait_cycles":242673536}
W20260709 12:11:30.791270 26606 log.cc:927] Time spent T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:11:30.702991 26012 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.021615 22000 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:30.963068 26036 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:31.031695 26036 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.027077 26577 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.032375 26036 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.032759 26577 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.034111 26386 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:30.963261 26504 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.034996 26504 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.038100 26577 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:31.038542 26627 log.cc:927] Time spent T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:30.789479 26620 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:31.037516 26504 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:31.055389 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 113436us
I20260709 12:11:30.931656 26392 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.710467 26469 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.041812 21999 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:31.044394 25891 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.047086 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 98796.1us
I20260709 12:11:31.048256 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:31.052433 26613 log.cc:927] Time spent T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:31.052795 26581 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:31.053239 26567 log.cc:927] Time spent T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:31.053174 21994 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:31.053800 26620 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.054040 26350 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:31.053905 26467 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:30.710426 26292 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.089888 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:30.746269 26580 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.027346 26012 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.038880 26631 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:31.148241 21927 raft_consensus.cc:2410] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:11:30.942924 26341 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:30.843461 26576 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:30.748615 26351 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.039408 26451 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.017525 26495 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:30.976358 26361 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.092994 26581 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.158512 26590 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.158638 26419 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:31.161391 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:31.066130 26318 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.020165 26523 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:31.115374 26625 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
W20260709 12:11:31.179282 21918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.061s	sys 0.103s
I20260709 12:11:31.182310 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:31.128724 25892 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:31.127678 26569 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.090342 26469 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.181136 26103 consensus_queue.cc:1059] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.504s
I20260709 12:11:31.181710 26341 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.685066 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:31.685142 26350 raft_consensus.cc:3055] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.685876 26350 raft_consensus.cc:740] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:31.226893 21922 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 13: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:31.476620 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.263506 21844 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
W20260709 12:11:31.687546 21918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.072s	sys 0.121s
W20260709 12:11:31.192462 22548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.011s	sys 0.011s
W20260709 12:11:31.688493 22548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.020s	sys 0.020s
I20260709 12:11:31.305091 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1042) took 2400 ms. Trace:
I20260709 12:11:31.688905 21927 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
W20260709 12:11:31.415232 22549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.007s	sys 0.015s
W20260709 12:11:31.691797 22549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.010s	sys 0.018s
W20260709 12:11:31.309850 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.689157 22584 rpcz_store.cc:276] 0709 12:11:28.904690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.939931 (+ 35241us) service_pool.cc:224] Handling call
0709 12:11:28.943941 (+  4010us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.950549 (+  6608us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:29.014879 (+ 64330us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.844299 (+1829420us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.931646 (+ 87347us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.931824 (+   178us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:30.931861 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.931932 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.304801 (+372869us) raft_consensus.cc:1685] finished
0709 12:11:31.304831 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.305010 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1069641,"prepare.queue_time_us":65353,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":39,"raft.queue_time_us":1085852,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":31734,"thread_start_us":731774,"threads_started":2,"wal-append.queue_time_us":1042650}
I20260709 12:11:31.708870 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:31.719291 21845 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:31.313409 26577 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.178920 26475 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:31.313948 26619 consensus_meta.cc:287] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.692s	user 0.006s	sys 0.004s
W20260709 12:11:31.767678 22583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.024s	sys 0.015s
W20260709 12:11:31.769101 22583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.024s	sys 0.015s
I20260709 12:11:31.771271 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 1047) took 1067 ms. Trace:
I20260709 12:11:31.163686 25891 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.775727 22583 rpcz_store.cc:276] 0709 12:11:30.704030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.704370 (+   340us) service_pool.cc:224] Handling call
0709 12:11:30.844400 (+140030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.844662 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:30.938276 (+ 93614us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.770805 (+832529us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.770878 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:31.770947 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.771037 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.771202 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25236,"prepare.queue_time_us":93615,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"thread_start_us":806859,"threads_started":1}
I20260709 12:11:31.797941 26604 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:31.790863 26576 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:31.802660 26576 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.803123 26576 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.805400 26576 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:31.806929 26578 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.774569 26350 consensus_queue.cc:260] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.411369 26378 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.270797 26386 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:11:31.801743 26629 log.cc:927] Time spent T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:11:31.708108 26571 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:31.812172 21921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.017s	sys 0.031s
I20260709 12:11:31.812934 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:31.738732 25892 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:11:31.816658 21921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.018s	sys 0.031s
I20260709 12:11:31.198868 26173 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.753103 26292 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:31.200999 26451 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.831707 26451 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:31.832538 26292 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.833108 26292 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.835363 26292 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:31.835906 26292 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.836369 26292 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.753360 26580 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:31.839382 26580 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.839834 26580 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.841712 26580 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:31.842036 26575 consensus_meta.cc:287] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 1.150s	user 0.006s	sys 0.002s
I20260709 12:11:31.842720 26451 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.843323 26451 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.845371 26451 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:31.694310 26581 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.420255 26633 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.399s
I20260709 12:11:31.847321 26633 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.847672 26633 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:11:31.828881 26392 consensus_meta.cc:287] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.763s	user 0.005s	sys 0.002s
I20260709 12:11:31.775650 26619 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.850965 26619 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:31.759479 26577 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.853163 21992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2625) took 1232 ms. Trace:
I20260709 12:11:31.853683 21992 rpcz_store.cc:276] 0709 12:11:30.620576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.621588 (+  1012us) service_pool.cc:224] Handling call
0709 12:11:30.621901 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.633617 (+ 11716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.852840 (+1219223us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b54002d14d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:31.853087 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13849856}
I20260709 12:11:31.853148 26577 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:31.768953 26475 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.812780 26625 log.cc:927] Time spent T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:31.808346 26350 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.855578 26392 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.861168 26292 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:31.861614 26620 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:31.866035 26467 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:31.891538 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2222) took 1315 ms. Trace:
I20260709 12:11:31.891932 21847 rpcz_store.cc:276] 0709 12:11:30.576394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.576595 (+   201us) service_pool.cc:224] Handling call
0709 12:11:30.577007 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.577424 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.577465 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.580340 (+  2875us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.874618 (+294278us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.874680 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.874783 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.891335 (+1016552us) raft_consensus.cc:1685] finished
0709 12:11:31.891356 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.891485 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":635,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":891,"thread_start_us":266566,"threads_started":1,"wal-append.queue_time_us":813450}
I20260709 12:11:31.821295 26378 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.867671 26351 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:31.866707 26036 consensus_meta.cc:287] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.834s	user 0.006s	sys 0.006s
I20260709 12:11:31.865343 26475 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.890820 26577 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.866513 26386 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.863722 26173 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.929927 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2301) took 1295 ms. Trace:
W20260709 12:11:31.931231 21890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.010s	sys 0.013s
W20260709 12:11:31.927748 21893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.014s	sys 0.035s
W20260709 12:11:31.933274 21893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.015s	sys 0.035s
I20260709 12:11:31.933003 21919 rpcz_store.cc:276] 0709 12:11:30.634524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.634679 (+   155us) service_pool.cc:224] Handling call
0709 12:11:30.635001 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.635229 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.635290 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.638537 (+  3247us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.638678 (+   141us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.638725 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.638793 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.929612 (+1290819us) raft_consensus.cc:1685] finished
0709 12:11:31.929645 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.929842 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:31.933861 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 996921us
W20260709 12:11:31.936240 21890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.010s	sys 0.013s
I20260709 12:11:31.869057 26575 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:31.942489 21964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.029s	sys 0.021s
W20260709 12:11:31.942932 21964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.029s	sys 0.021s
I20260709 12:11:31.917245 26495 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:31.960529 21926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.269s	user 0.016s	sys 0.038s
W20260709 12:11:31.931573 26344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.011s	sys 0.011s
W20260709 12:11:31.962633 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.965371 21926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.016s	sys 0.038s
I20260709 12:11:31.904784 26036 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:31.974866 21850 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.007s	sys 0.021s
W20260709 12:11:31.975237 21850 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.007s	sys 0.021s
W20260709 12:11:31.967408 26344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.011s	sys 0.012s
I20260709 12:11:31.951193 26258 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:31.170073 26631 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.798600 26604 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.807579 26578 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.753777 26569 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.829869 26571 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:31.961633 26318 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.992547 21927 raft_consensus.cc:3055] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:32.007714 21817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.008s	sys 0.023s
W20260709 12:11:32.008078 21817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.008s	sys 0.023s
W20260709 12:11:32.008339 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 951956us
I20260709 12:11:31.757958 26590 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:32.006794 21927 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:31.973250 26361 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:31.991492 26341 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:32.012778 21927 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:32.020097 21927 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.999922 26469 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:31.948148 26577 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:31.990721 26351 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:31.848445 26633 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.001523 26258 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.051474 26475 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.051386 26631 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.053256 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2296) took 1495 ms. Trace:
I20260709 12:11:32.079421 21918 rpcz_store.cc:276] 0709 12:11:30.557670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.557818 (+   148us) service_pool.cc:224] Handling call
0709 12:11:30.561174 (+  3356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.561505 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:30.561548 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.562132 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 12:11:31.688206 (+1126074us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:31.688257 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.688347 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.053029 (+364682us) raft_consensus.cc:1685] finished
0709 12:11:32.053051 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.053192 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304,"thread_start_us":1125758,"threads_started":1,"wal-append.queue_time_us":1404606}
I20260709 12:11:32.024730 26520 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:32.026011 26341 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:32.053388 26630 log.cc:927] Time spent T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 12:11:32.070906 26550 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 2.385s	user 0.012s	sys 0.045s
I20260709 12:11:32.081269 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:32.090255 21918 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:32.066510 26590 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.083783 26475 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.088587 26173 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.070959 26575 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:32.048832 25891 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.071851 26467 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:32.041368 26351 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:32.084510 26633 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:32.113051 22547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.021s	sys 0.025s
W20260709 12:11:32.113430 22547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.021s	sys 0.025s
W20260709 12:11:32.115320 21966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.008s	sys 0.025s
W20260709 12:11:32.115514 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.115717 21966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.008s	sys 0.025s
W20260709 12:11:32.115886 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.116303 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.117157 22547 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:32.100174 26378 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:32.075924 26235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.404s	user 0.015s	sys 0.074s
I20260709 12:11:32.095917 26341 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:32.095507 26520 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:32.130837 21893 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:32.135999 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:32.138587 21965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.143393 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:32.144676 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:32.146087 21893 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
W20260709 12:11:32.127815 26235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.483s	user 0.016s	sys 0.074s
I20260709 12:11:32.125342 26631 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.120747 25891 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:32.176000 22578 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:32.196971 26036 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:32.197393 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:32.102547 26475 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.190308 26631 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:32.199751 26631 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.200177 26475 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.120568 26575 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:32.200977 26575 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:32.202888 26638 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:32.203111 26575 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.163641 26451 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:32.120436 26585 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:32.204089 26451 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.204396 26585 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:32.148833 22547 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:32.207054 26292 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:32.207176 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 58417.1us
I20260709 12:11:32.120222 26590 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:32.208436 26590 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.150857 26495 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.210583 26344 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:32.211119 26344 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:32.213449 26344 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.132555 26386 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.112807 26467 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.215503 26467 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.215974 26467 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:32.216421 26467 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.217995 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:32.135095 26469 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:32.218653 21919 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:32.218767 26469 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.219554 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:32.220395 26636 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.694s	user 0.000s	sys 0.001s
I20260709 12:11:32.135618 26361 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.180143 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:32.221063 26361 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.221444 22582 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:32.222307 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:32.180445 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:32.223749 22577 raft_consensus.cc:2410] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:32.181586 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:32.224577 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:32.225260 22577 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:32.225469 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:32.225963 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:32.186975 26632 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.226051 22581 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:32.226804 25891 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:32.227213 26632 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.227918 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:32.228449 22581 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.229307 26632 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.194393 21918 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:32.223142 26361 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.152112 26378 consensus_queue.cc:1059] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.129s
I20260709 12:11:32.146553 26642 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.207s
I20260709 12:11:32.202232 21927 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 12:11:32.765818 21850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.019s	sys 0.052s
I20260709 12:11:32.991377 21927 pending_rounds.cc:85] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 4
I20260709 12:11:32.991958 21927 pending_rounds.cc:107] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:32.992384 21927 raft_consensus.cc:2889] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:32.449721 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.993403 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2558) took 1002 ms. Trace:
I20260709 12:11:32.231880 22582 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
W20260709 12:11:32.840116 21924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.004s	sys 0.012s
W20260709 12:11:32.931800 21892 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.000s	sys 0.014s
W20260709 12:11:32.994802 21924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.006s	sys 0.012s
W20260709 12:11:32.995366 21892 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.000s	sys 0.016s
W20260709 12:11:32.969726 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.625450 21921 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.039s	sys 0.048s
I20260709 12:11:32.220777 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:32.997607 21921 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.047s	sys 0.048s
I20260709 12:11:32.424168 22581 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
W20260709 12:11:32.358105 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.182089 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:32.179236 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 2302) took 1504 ms. Trace:
W20260709 12:11:32.991621 21850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.019s	sys 0.059s
I20260709 12:11:32.234753 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:32.247299 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 75466.3us
W20260709 12:11:33.016086 21893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.007s	sys 0.010s
I20260709 12:11:32.999099 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:33.019506 21922 rpcz_store.cc:276] 0709 12:11:30.674368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.680103 (+  5735us) service_pool.cc:224] Handling call
0709 12:11:32.178967 (+1498864us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540013b0d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:32.179160 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230391168}
W20260709 12:11:32.980384 26012 consensus_meta.cc:287] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.799s	user 0.007s	sys 0.007s
I20260709 12:11:32.173629 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:32.488823 26643 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:11:32.234498 22584 pending_rounds.cc:85] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 10
I20260709 12:11:33.034052 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:32.996265 21966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.012s	sys 0.004s
I20260709 12:11:33.027989 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:33.034768 21966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.013s	sys 0.005s
I20260709 12:11:32.164868 26645 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:11:32.629021 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.993791 21927 rpcz_store.cc:276] 0709 12:11:31.991369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.992043 (+   674us) service_pool.cc:224] Handling call
0709 12:11:31.992408 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.993122 (+1000714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.993349 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:32.280277 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2551) took 1630 ms. Trace:
W20260709 12:11:32.853004 22576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.002s	sys 0.010s
W20260709 12:11:33.015094 26456 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:33.046303 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:32.995875 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 839669us
I20260709 12:11:33.046833 22549 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:32.218341 26467 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.164810 26639 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:32.206271 26451 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.021605 26341 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:32.877214 26641 log.cc:927] Time spent T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.459s	user 0.000s	sys 0.001s
W20260709 12:11:32.527410 26640 log.cc:927] Time spent T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 12:11:33.034729 22584 pending_rounds.cc:107] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 11.11
W20260709 12:11:33.035682 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 892293us
I20260709 12:11:33.036074 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:32.172570 26504 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.069507 22584 raft_consensus.cc:2889] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:33.046006 22576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.003s	sys 0.011s
I20260709 12:11:32.224596 26569 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.847993 26520 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.346258 26495 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.220820 26469 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.505589 26351 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.474574 26103 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.877986 26652 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.514987 26577 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.477011 26644 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.365809 26292 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:11:32.526835 26649 log.cc:927] Time spent T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 12:11:32.406524 26631 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:32.424324 26258 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.990979 26571 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.375173 26585 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.367316 26578 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:32.252358 25891 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:32.296247 26583 log.cc:927] Time spent T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 2.103s	user 0.011s	sys 0.023s
I20260709 12:11:33.021842 26653 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.033480 26581 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 1.185s	user 0.010s	sys 0.003s
I20260709 12:11:33.016126 26590 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:32.279619 26632 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.774s
I20260709 12:11:32.193266 26637 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.027468 26368 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:32.252552 26604 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.055610 26365 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.042364 26523 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:33.045548 26645 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.069949 26504 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.070007 26648 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.063886 26639 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.078814 26520 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:33.083083 26652 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:33.087265 26644 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.103848 26632 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:33.096486 26581 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.026319 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2234) took 1861 ms. Trace:
W20260709 12:11:32.625734 21818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.040s	sys 0.037s
W20260709 12:11:33.000511 21817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.026s	sys 0.020s
W20260709 12:11:33.243950 21817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.027s	sys 0.021s
W20260709 12:11:33.026729 21893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.008s	sys 0.010s
W20260709 12:11:33.244480 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 1.23548e+06us
I20260709 12:11:33.034827 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.247315 21922 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:33.248092 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 2313) took 1133 ms. Trace:
I20260709 12:11:33.248541 21922 rpcz_store.cc:276] 0709 12:11:32.114247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.034572 (+920325us) service_pool.cc:224] Handling call
0709 12:11:33.247950 (+213378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.036306 21925 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
W20260709 12:11:33.250749 21818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.044s	sys 0.043s
I20260709 12:11:33.251050 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 2309) took 1149 ms. Trace:
I20260709 12:11:33.251595 21925 rpcz_store.cc:276] 0709 12:11:32.101323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.033780 (+932457us) service_pool.cc:224] Handling call
0709 12:11:33.250837 (+217057us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:33.252020 21818 connection.cc:256] RPC call timeout handler was delayed by -1.3490090440002405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 12:11:33.252087 26655 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.252887 21818 connection.cc:256] RPC call timeout handler was delayed by -1.2941090440001517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 12:11:33.253410 21818 connection.cc:256] RPC call timeout handler was delayed by -1.1321090440001171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
I20260709 12:11:33.253278 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.047700 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:33.172430 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2552) took 2517 ms. Trace:
W20260709 12:11:33.172770 21967 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.013s	sys 0.017s
I20260709 12:11:33.058621 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 1049) took 2268 ms. Trace:
I20260709 12:11:33.032097 22578 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:33.033303 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.069084 22581 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:33.173904 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2550) took 2526 ms. Trace:
I20260709 12:11:33.074091 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.112519 26648 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.104580 26368 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.261955 21926 rpcz_store.cc:276] 0709 12:11:30.647731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.647910 (+   179us) service_pool.cc:224] Handling call
0709 12:11:30.648313 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.648643 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.648675 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.653326 (+  4651us) log.cc:844] Serialized 26 byte log entry
0709 12:11:31.968843 (+1315517us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:31.968902 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.968997 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.173319 (+1204322us) raft_consensus.cc:1685] finished
0709 12:11:33.173375 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.173737 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2102,"raft.queue_time_us":1050,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":8776,"thread_start_us":1282935,"threads_started":1,"wal-append.queue_time_us":1479972}
I20260709 12:11:33.124336 26644 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.268692 26523 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:33.268920 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 949) took 1098 ms. Trace:
I20260709 12:11:33.111235 26652 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.045873 21920 rpcz_store.cc:276] 0709 12:11:30.650229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.650553 (+   324us) service_pool.cc:224] Handling call
0709 12:11:30.650951 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.659586 (+  8635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.659619 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.664746 (+  5127us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.709788 (+ 45042us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:30.709846 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.709940 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.219725 (+1509785us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:32.230147 (+ 10422us) raft_consensus.cc:1685] finished
0709 12:11:32.230167 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.280208 (+ 50041us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1500,"raft.queue_time_us":975,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"spinlock_wait_cycles":103585536,"thread_start_us":6228,"threads_started":1,"wal-append.queue_time_us":634877}
W20260709 12:11:33.122069 26633 consensus_meta.cc:287] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 1.007s	user 0.000s	sys 0.013s
I20260709 12:11:33.258370 22575 rpcz_store.cc:276] 0709 12:11:30.790000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.790438 (+   438us) service_pool.cc:224] Handling call
0709 12:11:30.790834 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.015639 (+1224805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:32.015674 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:32.015723 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:32.015760 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.058308 (+1042548us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54004e9b54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:33.058368 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.058556 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816315264}
I20260709 12:11:33.108644 26645 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:33.277036 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:33.278070 21920 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.096352 26653 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.080905 26495 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.083298 26469 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.185262 26364 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.047309 26012 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.113149 26632 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:33.297226 26632 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.297837 26495 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.053460 26361 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:33.175093 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1044) took 4128 ms. Trace:
W20260709 12:11:33.172500 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 104098us
I20260709 12:11:33.197347 26631 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:33.197369 26520 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.300771 22579 rpcz_store.cc:276] 0709 12:11:29.046150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.046327 (+   177us) service_pool.cc:224] Handling call
0709 12:11:29.046861 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.315790 (+268929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.315818 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.333661 (+ 17843us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.727719 (+394058us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:29.727855 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.703172 (+1975317us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54007a0154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:31.703228 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.211763 (+508535us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:33.174372 (+962609us) raft_consensus.cc:1685] finished
0709 12:11:33.174438 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.174769 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4785,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":1859,"spinlock_wait_cycles":624145024,"thread_start_us":102356,"threads_started":1,"wal-append.queue_time_us":504181}
I20260709 12:11:33.304442 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.305011 26520 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.109371 26504 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.306537 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:33.311173 25891 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.311291 22577 raft_consensus.cc:2410] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:11:33.311703 25891 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.312274 25891 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.084534 26103 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.235603 26581 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:33.089313 26292 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.300210 26361 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:33.317327 26103 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:33.256258 21967 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.013s	sys 0.017s
W20260709 12:11:33.318567 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 1.03763e+06us
I20260709 12:11:33.319015 26361 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.256569 21927 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.323796 26662 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:33.253506 26655 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.328284 26648 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:33.261557 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.322144 21967 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:33.331178 22580 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:33.331983 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 961) took 1150 ms. Trace:
I20260709 12:11:33.269438 22584 rpcz_store.cc:276] 0709 12:11:32.170228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.170353 (+   125us) service_pool.cc:224] Handling call
0709 12:11:32.234230 (+ 63877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.070614 (+836384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.070676 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.071118 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.217549 (+146431us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:33.217660 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.217825 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.267071 (+ 49246us) raft_consensus.cc:1685] finished
0709 12:11:33.267097 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.268727 (+  1630us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":145094,"threads_started":1,"wal-append.queue_time_us":146191}
I20260709 12:11:33.333578 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:33.333848 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.332779 26648 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.335703 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.336263 26648 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.336807 26648 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.337116 22584 raft_consensus.cc:2410] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:33.337774 22584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33654 (request call id 1052) took 1151 ms. Trace:
I20260709 12:11:33.259181 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 966) took 1075 ms. Trace:
I20260709 12:11:33.338559 22578 rpcz_store.cc:276] 0709 12:11:32.183228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.234425 (+ 51197us) service_pool.cc:224] Handling call
0709 12:11:33.258932 (+1024507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.340967 22578 raft_consensus.cc:1275] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:33.341675 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 957) took 1161 ms. Trace:
I20260709 12:11:33.121358 26639 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.276724 21925 raft_consensus.cc:2410] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:33.343789 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.344820 26012 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.345228 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.317358 26653 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.269668 26523 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.342087 22578 rpcz_store.cc:276] 0709 12:11:32.180664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.339774 (+1159110us) service_pool.cc:224] Handling call
0709 12:11:33.340394 (+   620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.341352 (+   958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.341590 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.346764 26620 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:33.347783 22578 raft_consensus.cc:1240] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:33.348531 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1047) took 1164 ms. Trace:
I20260709 12:11:33.348603 26523 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.282384 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:33.282908 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 1.12774e+06us
I20260709 12:11:33.272811 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.349817 21919 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:33.350425 21967 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:33.274483 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:33.351508 26620 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:33.352142 21922 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:33.278358 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.353503 21815 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:33.256625 26658 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:33.354492 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1050) took 1169 ms. Trace:
I20260709 12:11:33.282783 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:33.080832 22583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.015s	sys 0.018s
W20260709 12:11:33.355681 22583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.016s	sys 0.018s
I20260709 12:11:33.355597 21926 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:33.357079 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 948) took 1192 ms. Trace:
I20260709 12:11:33.357160 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.305269 22579 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:33.317409 26292 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.358013 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2563) took 1335 ms. Trace:
I20260709 12:11:33.328316 26655 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.351576 22581 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:33.254114 21818 connection.cc:256] RPC call timeout handler was delayed by -1.0628090440002325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
I20260709 12:11:33.358336 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 965) took 1175 ms. Trace:
I20260709 12:11:33.382939 22579 rpcz_store.cc:276] 0709 12:11:32.182917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.304023 (+1121106us) service_pool.cc:224] Handling call
0709 12:11:33.358258 (+ 54235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.359949 21964 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:33.361169 21925 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:33.355029 22575 rpcz_store.cc:276] 0709 12:11:32.185463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.353360 (+1167897us) service_pool.cc:224] Handling call
0709 12:11:33.353753 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.354122 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.354152 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.354196 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:33.354268 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.354335 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.354441 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.282776 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.355042 26658 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.360661 26584 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.403692 26584 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.404295 26584 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.348778 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:33.226765 21850 rpcz_store.cc:276] 0709 12:11:31.165273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.165407 (+   134us) service_pool.cc:224] Handling call
0709 12:11:31.199577 (+ 34170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.199882 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:31.975599 (+775717us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.018869 (+1043270us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.026000 (+  7131us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:33.026054 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.026130 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.026263 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":988188,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":15132,"raft.queue_time_us":44562,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":17327360,"thread_start_us":1746346,"threads_started":2,"wal-append.queue_time_us":1130553}
I20260709 12:11:33.255748 21924 rpcz_store.cc:276] 0709 12:11:30.660009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.666060 (+  6051us) service_pool.cc:224] Handling call
0709 12:11:30.666439 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.666988 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.667033 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.672392 (+  5359us) log.cc:844] Serialized 26 byte log entry
0709 12:11:32.015054 (+1342662us) spinlock_profiling.cc:243] Waited 9.99 ms on lock 0x7b18003e93e0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:11:32.995698 (+980644us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:32.995742 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.995823 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.171404 (+175581us) raft_consensus.cc:1685] finished
0709 12:11:33.171468 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.172042 (+   574us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":216,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9281,"spinlock_wait_cycles":22974720,"thread_start_us":980367,"threads_started":1,"wal-append.queue_time_us":2431311}
I20260709 12:11:33.408245 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2304) took 1363 ms. Trace:
I20260709 12:11:33.408664 21924 rpcz_store.cc:276] 0709 12:11:32.045236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.406909 (+1361673us) service_pool.cc:224] Handling call
0709 12:11:33.407463 (+   554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.407739 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.407775 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.407866 (+    91us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:33.407943 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.408035 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.408185 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.363533 21926 rpcz_store.cc:276] 0709 12:11:32.023031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.356660 (+1333629us) service_pool.cc:224] Handling call
0709 12:11:33.357221 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.357612 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.357638 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.357701 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:33.357759 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.357822 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.357939 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792}
I20260709 12:11:33.412258 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2306) took 1327 ms. Trace:
I20260709 12:11:33.412786 21926 rpcz_store.cc:276] 0709 12:11:32.085168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.410854 (+1325686us) service_pool.cc:224] Handling call
0709 12:11:33.411465 (+   611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.411787 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.411828 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.411909 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:33.411952 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.412025 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.412182 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.338186 22584 rpcz_store.cc:276] 0709 12:11:32.186073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.335232 (+1149159us) service_pool.cc:224] Handling call
0709 12:11:33.337672 (+  2440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.349009 22578 rpcz_store.cc:276] 0709 12:11:32.184552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.346977 (+1162425us) service_pool.cc:224] Handling call
0709 12:11:33.347438 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.348255 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.348460 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.332424 22580 rpcz_store.cc:276] 0709 12:11:32.181631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.260914 (+1079283us) service_pool.cc:224] Handling call
0709 12:11:33.331872 (+ 70958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.353586 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:33.416833 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 63410.2us
I20260709 12:11:33.415192 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2303) took 1348 ms. Trace:
I20260709 12:11:33.420161 21925 rpcz_store.cc:276] 0709 12:11:32.036350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.360219 (+1323869us) service_pool.cc:224] Handling call
0709 12:11:33.360675 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.384385 (+ 23710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.384671 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.419584 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1048) took 1218 ms. Trace:
I20260709 12:11:33.424108 21927 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:33.357550 22583 rpcz_store.cc:276] 0709 12:11:32.165016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.192248 (+ 27232us) service_pool.cc:224] Handling call
0709 12:11:32.196900 (+  4652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:32.197282 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:32.197308 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:32.197763 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.356475 (+1158712us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:33.356660 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.356782 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.356832 (+    50us) raft_consensus.cc:1685] finished
0709 12:11:33.356842 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.357030 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":305,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":1158164,"threads_started":1,"wal-append.queue_time_us":924646}
I20260709 12:11:33.422653 22581 rpcz_store.cc:276] 0709 12:11:32.184877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.349935 (+1165058us) service_pool.cc:224] Handling call
0709 12:11:33.350366 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.382203 (+ 31837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.402698 (+ 20495us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:33.418766 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 109642us
W20260709 12:11:33.428042 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 79472us
I20260709 12:11:33.418401 26662 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.438623 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 2318) took 1308 ms. Trace:
I20260709 12:11:33.439159 21927 rpcz_store.cc:276] 0709 12:11:32.130074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.047458 (+917384us) service_pool.cc:224] Handling call
0709 12:11:33.435872 (+388414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.446786 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.447786 22583 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:33.439169 26012 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:33.455387 26012 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.457770 26012 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.450176 22583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1051) took 1264 ms. Trace:
I20260709 12:11:33.465196 22583 rpcz_store.cc:276] 0709 12:11:32.185779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.448879 (+1263100us) service_pool.cc:224] Handling call
0709 12:11:33.449328 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.449771 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.449802 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.449864 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:33.449920 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.449976 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.450101 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.446666 22582 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:33.467350 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.470923 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58892 (request call id 960) took 1289 ms. Trace:
I20260709 12:11:33.471084 26617 raft_consensus.cc:3055] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:33.471709 26617 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:33.471535 22577 rpcz_store.cc:276] 0709 12:11:32.181379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.225761 (+ 44382us) service_pool.cc:224] Handling call
0709 12:11:33.436542 (+1210781us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54002cef54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:33.470817 (+ 34275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695294720}
I20260709 12:11:33.473362 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.474330 22582 raft_consensus.cc:2393] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:33.474555 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.475375 22579 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
W20260709 12:11:33.475935 26656 log.cc:927] Time spent T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.361s	user 0.003s	sys 0.000s
I20260709 12:11:33.476320 22582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1054) took 1080 ms. Trace:
W20260709 12:11:33.477298 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 59270.2us
W20260709 12:11:33.479259 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 119639us
I20260709 12:11:33.435322 26662 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.482647 22001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1899) took 2851 ms. Trace:
I20260709 12:11:33.482947 22579 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:33.483204 26025 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.483800 26025 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.484457 26025 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.486963 26617 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.488591 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55322 (request call id 9) took 1038 ms. Trace:
I20260709 12:11:33.488797 26617 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.489076 22581 rpcz_store.cc:276] 0709 12:11:32.450012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.487064 (+1037052us) service_pool.cc:224] Handling call
0709 12:11:33.488499 (+  1435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.476716 22582 rpcz_store.cc:276] 0709 12:11:32.396132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.475110 (+1078978us) service_pool.cc:224] Handling call
0709 12:11:33.475603 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.475936 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.475973 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.476033 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:33.476067 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.476146 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.476274 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.482123 21922 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:33.439033 26639 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.494771 21920 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:33.476960 26632 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.492143 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 2314) took 1377 ms. Trace:
I20260709 12:11:33.494747 22579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1056) took 1085 ms. Trace:
I20260709 12:11:33.491686 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.496748 21922 rpcz_store.cc:276] 0709 12:11:32.115039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.249914 (+1134875us) service_pool.cc:224] Handling call
0709 12:11:33.492065 (+242151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.497005 22579 rpcz_store.cc:276] 0709 12:11:32.405533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.476086 (+1070553us) service_pool.cc:224] Handling call
0709 12:11:33.476408 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.490708 (+ 14300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.490926 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.498770 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2310) took 1392 ms. Trace:
I20260709 12:11:33.499001 21966 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:33.499181 21925 rpcz_store.cc:276] 0709 12:11:32.103775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.421125 (+1317350us) service_pool.cc:224] Handling call
0709 12:11:33.468313 (+ 47188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.492469 (+ 24156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.492516 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.495990 (+  3474us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:33.496037 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.496093 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.496214 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.500070 26468 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.502182 21966 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:33.481796 26012 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.490510 26662 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.513273 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2562) took 1492 ms. Trace:
W20260709 12:11:33.522672 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 159614us
I20260709 12:11:33.524910 26619 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.525137 26456 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.525547 26619 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.526098 26619 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.525907 26456 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.528543 26456 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.530858 22577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33654 (request call id 1053) took 1344 ms. Trace:
I20260709 12:11:33.531417 22577 rpcz_store.cc:276] 0709 12:11:32.186365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.472835 (+1286470us) service_pool.cc:224] Handling call
0709 12:11:33.481053 (+  8218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.530499 (+ 49446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.530529 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.530593 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:33.530628 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.530692 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.530802 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.530747 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2549) took 2794 ms. Trace:
I20260709 12:11:33.534783 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2560) took 1493 ms. Trace:
I20260709 12:11:33.535177 21918 rpcz_store.cc:276] 0709 12:11:32.001617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.092484 (+ 90867us) service_pool.cc:224] Handling call
0709 12:11:32.194084 (+101600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:32.230210 (+ 36126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.467230 (+1237020us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b540013b0d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:33.495204 (+ 27974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222799744}
I20260709 12:11:33.536037 26674 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.536623 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.519793 21919 rpcz_store.cc:276] 0709 12:11:32.017330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.350632 (+1333302us) service_pool.cc:224] Handling call
0709 12:11:33.351084 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.351574 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:33.457901 (+106327us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.508872 (+ 50971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.508945 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:33.509004 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.509092 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.509255 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63859,"prepare.queue_time_us":106129,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"thread_start_us":34764,"threads_started":1}
I20260709 12:11:33.536686 26674 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.537992 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.538652 22583 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:33.538766 21919 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
W20260709 12:11:33.539551 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 492638us
I20260709 12:11:33.539837 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.540059 26520 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.540829 26520 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.543383 26472 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:33.544062 26472 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:33.544932 21925 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:11:33.545413 26368 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.545264 26472 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.546316 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:33.547072 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 45005.9us
I20260709 12:11:33.547185 26520 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.547385 21925 raft_consensus.cc:2410] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:11:33.547785 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.548192 21966 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:33.548868 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.549232 26616 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.549855 21925 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:33.550987 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.552472 26364 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.533408 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2308) took 1434 ms. Trace:
I20260709 12:11:33.538280 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.558528 21926 rpcz_store.cc:276] 0709 12:11:32.099020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.414080 (+1315060us) service_pool.cc:224] Handling call
0709 12:11:33.435715 (+ 21635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.519410 (+ 83695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.519452 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.533131 (+ 13679us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:33.533177 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.533237 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.533354 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:33.535773 26652 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.560818 21964 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:33.562053 21964 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:33.563314 21925 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:33.510550 21817 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:33.557677 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:33.567571 21920 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:33.563093 26652 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.568912 26577 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.569489 26577 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.569936 26577 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.570147 26012 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.573032 26012 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.574652 26616 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.575232 26616 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.575692 26616 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:33.575722 21892 leader_election.cc:336] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.841s (SENT)
I20260709 12:11:33.578529 26639 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.579396 26235 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.581053 26639 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.483096 22001 rpcz_store.cc:276] 0709 12:11:30.574109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.574217 (+   108us) service_pool.cc:224] Handling call
0709 12:11:30.581591 (+  7374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.582055 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:30.592532 (+ 10477us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.656083 (+ 63551us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b180045a7e0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae3f3 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:11:32.011042 (+1354959us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b180045a7e0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b23a 00007f3be4da5a2a
0709 12:11:33.067667 (+1056625us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.068198 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.068342 (+   144us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:33.241749 (+173407us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.286828 (+ 45079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.292172 (+  5344us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.294324 (+  2152us) raft_consensus.cc:1685] finished
0709 12:11:33.294339 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.425804 (+131465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":578988,"prepare.queue_time_us":67036,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":598126,"raft.run_cpu_time_us":602,"raft.run_wall_time_us":4941,"spinlock_wait_cycles":58368000,"thread_start_us":645606,"threads_started":2,"wal-append.queue_time_us":2516115}
I20260709 12:11:33.577569 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:33.588999 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.594830 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:33.599612 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.599999 22582 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.581748 26639 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:33.608098 21920 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:11:33.606328 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 147827us
I20260709 12:11:33.612532 21925 raft_consensus.cc:2393] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:33.616860 22581 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:33.618044 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.621233 26365 consensus_meta.cc:287] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.003s
I20260709 12:11:33.621861 26374 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.622539 26661 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.499s	user 0.002s	sys 0.002s
I20260709 12:11:33.622437 26374 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.625001 21893 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:33.533396 21921 rpcz_store.cc:276] 0709 12:11:30.639956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.640089 (+   133us) service_pool.cc:224] Handling call
0709 12:11:30.640441 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.640779 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.640806 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.648721 (+  7915us) log.cc:844] Serialized 26 byte log entry
0709 12:11:31.818095 (+1169374us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:32.998099 (+1180004us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.301132 (+303033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.421903 (+120771us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.430915 (+  9012us) raft_consensus.cc:1685] finished
0709 12:11:33.430938 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.434677 (+  3739us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18259,"prepare.queue_time_us":1292500,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":946,"raft.queue_time_us":78834,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":6476,"thread_start_us":2473936,"threads_started":3,"wal-append.queue_time_us":1354758}
I20260709 12:11:33.626559 26504 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:33.627995 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.628989 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.629802 21921 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:33.630801 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.631472 21921 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:33.632714 21921 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:33.633491 22576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 953) took 1456 ms. Trace:
I20260709 12:11:33.635216 22576 rpcz_store.cc:276] 0709 12:11:32.176739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.178541 (+  1802us) service_pool.cc:224] Handling call
0709 12:11:32.178983 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:32.198670 (+ 19687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:32.198699 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:32.199094 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.070623 (+871529us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:33.070681 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.070787 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.548934 (+478147us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:33.633028 (+ 84094us) raft_consensus.cc:1685] finished
0709 12:11:33.633047 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.633314 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18978,"raft.queue_time_us":19163,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":26103040,"thread_start_us":871192,"threads_started":1,"wal-append.queue_time_us":897059}
W20260709 12:11:33.638338 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 146198us
I20260709 12:11:33.639796 26642 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.640184 26642 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.640585 26642 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.646617 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.659003 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:33.642866 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 176901us
I20260709 12:11:33.649991 21967 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:33.662945 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:33.662563 22582 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
W20260709 12:11:33.647132 26675 log.cc:927] Time spent T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 12:11:33.651312 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:33.647028 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:33.676386 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 114439us
I20260709 12:11:33.655630 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.652063 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.679868 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.629032 26504 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:33.610276 26639 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.682685 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.647356 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.649910 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:33.642634 26472 consensus_queue.cc:1048] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:33.664533 26103 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:11:33.687757 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62861.7us
I20260709 12:11:33.687922 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.690569 26365 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.691293 26012 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.645481 21926 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 2 to 9, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:33.693590 21923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2295) took 3136 ms. Trace:
I20260709 12:11:33.697223 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:33.686877 21967 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:33.697929 21924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2305) took 1611 ms. Trace:
I20260709 12:11:33.701527 21924 rpcz_store.cc:276] 0709 12:11:32.073933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.409629 (+1335696us) service_pool.cc:224] Handling call
0709 12:11:33.410161 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.435797 (+ 25636us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:33.511058 (+ 75261us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.684497 (+173439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.684553 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:33.684592 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.684650 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.684756 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16841,"prepare.queue_time_us":32783,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":28342,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":56790,"threads_started":1}
I20260709 12:11:33.699043 21817 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:33.645371 25891 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:33.708036 21737 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1238ec38c933498cadf6153a5554f6e0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ac07267c8cab47d4b59dc27d6fe9a386 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:33.708595 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:33.696905 26577 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.710180 21893 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:33.715791 26644 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.718601 26361 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:33.719208 26361 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.721359 26361 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.723393 26674 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.725152 26648 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.726734 26604 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.727347 26604 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.729553 26604 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.700610 26365 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.699571 21923 rpcz_store.cc:276] 0709 12:11:30.557271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.557483 (+   212us) service_pool.cc:224] Handling call
0709 12:11:32.981328 (+2423845us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76eee 000000000036eb39 00007f3be9cea1e0 00007f3be9db30c4 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:11:32.981567 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.981941 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:33.365388 (+383447us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.684900 (+319512us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.693054 (+  8154us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:33.693132 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.693226 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.693419 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59052,"prepare.queue_time_us":136674,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":64174,"spinlock_wait_cycles":3633408,"thread_start_us":434172,"threads_started":2,"wal-append.queue_time_us":206582}
I20260709 12:11:33.700750 26012 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.736301 21918 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:33.738773 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.739792 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:33.743769 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 60694.7us
W20260709 12:11:33.744865 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 43898.8us
I20260709 12:11:33.749353 26576 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.749820 26576 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.750211 26576 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.751127 25891 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:33.751294 26616 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.752868 21967 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:33.753952 21967 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:33.754576 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46210.3us
I20260709 12:11:33.749840 26648 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.755309 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:33.756676 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:33.757753 26504 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.739846 26012 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.758172 26504 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.758315 26361 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.758703 26504 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.758838 26361 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:33.758960 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 79366.1us
I20260709 12:11:33.759409 26361 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.760040 21924 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:33.756799 26577 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:33.757421 26584 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.711557 26658 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:33.746834 21844 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 6.
I20260709 12:11:33.735880 26365 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.743633 26644 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:33.777459 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 80311.4us
I20260709 12:11:33.780354 26584 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:33.780752 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.782502 26648 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.783815 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.762647 26616 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.767843 26368 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:33.772198 26674 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.792925 26504 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:33.796787 26645 consensus_meta.cc:287] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.005s
I20260709 12:11:33.796947 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:33.789027 26658 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:11:33.800151 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:33.801254 26662 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.802055 26632 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:33.785432 26604 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:33.836977 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62252.4us
I20260709 12:11:33.813174 26674 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:33.869354 26504 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.869484 26025 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.867558 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.871513 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:33.872195 21843 raft_consensus.cc:2376] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9. Re-sending same reply.
I20260709 12:11:33.872874 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:33.874738 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 74683.8us
I20260709 12:11:33.875222 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.875567 21818 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:33.875945 22578 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:33.878230 21927 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:33.878875 21927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2311) took 1773 ms. Trace:
I20260709 12:11:33.879170 21927 rpcz_store.cc:276] 0709 12:11:32.105566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.439897 (+1334331us) service_pool.cc:224] Handling call
0709 12:11:33.637823 (+197926us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c76a22 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:11:33.877901 (+240078us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b5800194798. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76e9c 00007f3be1c76a5b 00007f3beab8f8d9 00007f3be9ce9ee0 00007f3be9db30ab 00007f3be9db3131 00007f3be9d74fc0 00007f3be9d5f929 00007f3be9d5f3d2 00007f3be32d6bd4
0709 12:11:33.878069 (+   168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.878644 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.878826 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100127744}
I20260709 12:11:33.888124 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.889281 21843 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:33.891304 26025 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.858702 26495 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:11:33.861770 26674 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.885257 26644 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.842913 26645 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.908594 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:33.909236 22575 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.912983 21919 raft_consensus.cc:2393] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 18: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:33.913863 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.918853 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.924054 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:33.925246 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.925884 22576 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:33.910852 26639 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.928685 26451 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:33.900769 26619 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:33.941603 26632 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:33.923563 26025 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.949765 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.949865 26578 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:11:33.956120 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:33.957222 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 81763.5us
I20260709 12:11:33.958711 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.963521 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:33.947814 26025 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:33.964488 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:33.941792 26520 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:33.948485 26472 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:33.998588 26616 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.999203 26616 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.999621 21893 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:34.000406 26520 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.000780 26520 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.001093 26520 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.001313 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:34.002252 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:34.002524 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:34.002894 22577 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.003156 22579 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.003371 26645 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:34.004761 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:34.007001 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:34.007565 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.009204 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.009672 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.009913 21994 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:34.010396 21992 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:34.002554 26576 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.011646 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.015779 26361 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:33.975585 26619 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:33.977897 26695 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:11:34.016916 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.017583 21996 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:33.970144 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:34.018033 26616 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.979020 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:33.982867 26693 log.cc:927] Time spent T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:11:33.987325 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:33.987223 26173 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:33.989451 26364 consensus_queue.cc:1059] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:34.022469 26655 raft_consensus.cc:3055] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:34.022883 26655 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:34.023013 26685 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.023505 26103 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.023772 26655 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:34.024137 26103 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.025170 26655 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.026769 26662 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:33.968691 22547 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:34.023548 26685 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:34.027899 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 59277us
I20260709 12:11:34.028810 26698 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.990706 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:34.029217 26685 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:34.029637 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 73404.3us
I20260709 12:11:34.030364 21964 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:33.967123 22580 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:33.966925 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:33.994643 26025 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.014928 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:34.015290 22577 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:34.016105 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:33.972620 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:33.990254 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:34.012802 26576 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:34.026213 26103 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:34.039475 22575 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:34.029229 26698 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.990597 22581 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:34.033224 21893 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:34.065088 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:34.075660 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 43493.2us
I20260709 12:11:34.070300 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:34.070602 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 80438.9us
W20260709 12:11:34.032775 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.073774 22584 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:34.074962 21998 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 13: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:34.070446 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 690) took 1019 ms. Trace:
I20260709 12:11:33.974182 26365 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.079988 21992 raft_consensus.cc:2393] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 9: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:11:34.077775 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 44647us
I20260709 12:11:34.077261 21922 rpcz_store.cc:276] 0709 12:11:33.048000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.522469 (+474469us) service_pool.cc:224] Handling call
0709 12:11:33.540987 (+ 18518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.655179 (+114192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:33.655225 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.655828 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.743548 (+ 87720us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:33.743613 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.063513 (+319900us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b54003e6cd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:34.063564 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:34.063612 (+    48us) raft_consensus.cc:1685] finished
0709 12:11:34.063627 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.067091 (+  3464us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53358,"raft.queue_time_us":54127,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":95590144,"thread_start_us":87312,"threads_started":1,"wal-append.queue_time_us":146506}
I20260709 12:11:34.063905 26604 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:34.085062 21994 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:34.400406 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.403002 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.403926 21993 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:34.405149 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:34.121512 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56490.8us
I20260709 12:11:34.370265 26374 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:34.127677 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 45475us
W20260709 12:11:34.406536 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 275580us
I20260709 12:11:34.400209 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:34.299067 22000 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:34.130127 26576 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.409004 26576 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:34.409425 26576 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.328018 26365 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:34.290503 26642 consensus_meta.cc:287] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.004s
I20260709 12:11:34.077615 26698 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.411715 26642 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.084580 26703 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:34.406234 21964 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:34.122238 26619 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.204164 26361 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:34.197382 26584 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:34.078961 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.151659 22001 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:34.327216 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:34.143258 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:34.294672 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 211391us
I20260709 12:11:34.327822 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:34.411966 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.416273 26688 consensus_queue.cc:1059] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:34.091809 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.151733 22579 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
W20260709 12:11:34.423574 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 271008us
W20260709 12:11:34.407156 21892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.623s (SENT) [suppressed 15 similar messages]
W20260709 12:11:34.427410 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.328660 21844 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.429955 21845 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:34.428673 21996 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:34.152334 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.431325 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.433419 21893 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:34.437875 21998 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:34.437918 21992 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:34.076107 26616 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:34.439371 21997 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:34.152563 26685 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.427667 26604 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.427199 26703 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.432143 26584 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:34.468555 21998 raft_consensus.cc:1240] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:34.467283 21995 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:34.467296 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.473037 26520 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.070375 26632 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.439294 26495 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.479415 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:34.444103 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.482309 21999 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:34.447031 26619 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:34.450891 26365 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.484357 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.464885 26685 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:34.488816 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 82700us
I20260709 12:11:34.464377 26652 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:34.483958 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46403.7us
I20260709 12:11:34.483397 21818 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:34.487293 21992 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
W20260709 12:11:34.475765 26012 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.717s	user 0.002s	sys 0.009s
I20260709 12:11:34.488407 26530 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:11:34.494969 21994 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:34.467417 26703 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.477928 26616 raft_consensus.cc:697] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:34.496676 21993 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:34.490357 26685 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.503139 22000 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 6.
I20260709 12:11:34.511461 26584 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:34.513015 26584 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.515043 26619 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:34.520740 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.522993 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.524749 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:34.524871 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.525484 21850 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.525800 21999 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:34.527369 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.529165 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:34.484975 26495 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.532294 26495 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:34.533480 26674 consensus_meta.cc:287] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260709 12:11:34.534122 26674 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.499647 26652 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:34.562228 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:34.562469 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:34.565403 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.506347 26658 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.497578 26012 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.588354 21964 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:34.536360 26674 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:34.532255 26642 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:34.608597 21850 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:34.593380 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:34.615039 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:34.614797 26616 consensus_queue.cc:237] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:34.624116 26520 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:34.633266 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 82860.4us
I20260709 12:11:34.635236 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.635653 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:34.639952 21918 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:34.649664 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 61384.4us
I20260709 12:11:34.651595 21925 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:34.659300 21964 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:34.652889 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:34.654487 21919 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:34.655189 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:34.665218 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:34.668759 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:34.660159 26025 consensus_meta.cc:287] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.003s
I20260709 12:11:34.653609 26642 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:34.680066 21995 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:34.675298 21926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.015s	sys 0.011s
W20260709 12:11:34.683362 21926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.016s	sys 0.012s
I20260709 12:11:34.677215 21923 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:34.692873 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.693218 22000 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.677136 26365 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:34.700062 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 254756us
I20260709 12:11:34.698887 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:34.686547 26642 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:34.707686 21992 raft_consensus.cc:1240] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:34.696049 26365 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:34.710448 26365 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.711879 21966 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:34.713435 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:34.715898 26504 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.720857 21926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2565) took 1194 ms. Trace:
I20260709 12:11:34.735667 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:34.685215 26025 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.709076 26642 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.754776 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:34.758720 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:34.762341 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:34.766734 26705 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.767263 26705 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.767649 26705 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.695007 26652 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.756903 21966 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:34.805802 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 144912us
I20260709 12:11:34.806501 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:34.805020 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 327944us
W20260709 12:11:34.810647 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 57738.6us
I20260709 12:11:34.741348 26576 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:34.814669 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:34.815653 21850 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:34.762166 26698 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:34.817028 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 60201.7us
W20260709 12:11:34.814779 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 108853us
I20260709 12:11:34.821203 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:34.821877 22584 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.822793 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:34.824545 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 67964.4us
I20260709 12:11:34.780042 26632 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:11:34.813791 26662 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:34.841014 21996 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:34.842252 26632 consensus_queue.cc:1243] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:34.843146 26632 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:34.843504 26632 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:34.844354 26632 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.844949 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2574) took 1316 ms. Trace:
I20260709 12:11:34.845532 26632 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:34.845407 21918 rpcz_store.cc:276] 0709 12:11:33.528763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.736943 (+208180us) service_pool.cc:224] Handling call
0709 12:11:33.762208 (+ 25265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.658367 (+896159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.844677 (+186310us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54003e5dd4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:34.844882 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018001280}
I20260709 12:11:34.854667 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:34.855852 22584 raft_consensus.cc:2468] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:34.838387 26662 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:11:34.875769 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 58317.9us
I20260709 12:11:34.895118 26025 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:34.895226 26662 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:34.879549 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:34.902690 21994 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:34.902858 21998 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.903996 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.721449 21926 rpcz_store.cc:276] 0709 12:11:33.526559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.602109 (+ 75550us) service_pool.cc:224] Handling call
0709 12:11:33.608562 (+  6453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.637916 (+ 29354us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:34.060056 (+422140us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.720216 (+660160us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.720459 (+   243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.720513 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:34.720560 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.720651 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.720787 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25307,"raft.queue_time_us":11055,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"spinlock_wait_cycles":31361408,"thread_start_us":539576,"threads_started":1}
I20260709 12:11:34.905257 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:34.906093 26576 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:34.841295 26012 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:34.883176 26368 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:34.907855 26698 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:34.915855 26025 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.916455 26025 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.917177 26368 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.917793 26368 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:34.918514 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:34.919071 22581 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.922907 26368 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:34.923599 21998 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:34.884250 26726 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.931668 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:34.932483 22575 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:34.931564 21995 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:34.949512 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.836586 26604 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:35.007889 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 113451us
W20260709 12:11:34.880036 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 53418.5us
I20260709 12:11:34.923766 21993 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:11:34.883795 26710 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:34.896109 21893 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:35.013810 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 117800us
I20260709 12:11:35.016968 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.017958 22575 raft_consensus.cc:2393] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 14: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
W20260709 12:11:34.917079 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 48830.1us
W20260709 12:11:35.020114 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 162551us
I20260709 12:11:35.023279 26025 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:35.023448 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.026676 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:35.027623 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.028164 26698 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:35.028687 26698 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.029227 22580 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:35.030380 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.030977 22577 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.031906 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.032503 22582 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.032956 26722 raft_consensus.cc:2804] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.918221 26685 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.034761 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.038298 21847 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:35.037101 26685 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:35.042900 26173 raft_consensus.cc:3055] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:35.043409 26173 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:35.044431 26173 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.046312 26173 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:35.048288 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.049149 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.050110 21843 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:35.050563 21844 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 12: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:35.050954 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.052654 22000 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:35.053664 22577 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:35.059242 21966 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:35.032279 26703 consensus_meta.cc:287] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.005s
I20260709 12:11:35.058085 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.063486 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.065119 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.034736 26705 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.071995 22582 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:35.072970 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.067740 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.074138 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.074245 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:35.075428 21845 raft_consensus.cc:2410] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:35.055385 26504 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:35.059988 26012 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:35.083455 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.086872 21847 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:35.060325 26722 raft_consensus.cc:697] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:35.084398 21850 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 17.
I20260709 12:11:35.087996 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.088802 21817 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.092362 21849 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:35.095340 22581 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:35.098012 26576 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:35.098529 26576 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:35.098768 26698 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:35.098989 26576 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.099443 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:35.100865 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:35.101850 26645 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:35.102444 26645 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:35.102950 26645 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.110507 26655 consensus_queue.cc:1059] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:35.111364 26658 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:35.112322 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.113348 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.115073 26729 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:35.115801 26729 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:35.116322 26729 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:35.122521 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.085352 26468 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:11:35.124536 26705 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:35.090399 26578 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:35.064489 26025 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:35.125363 26578 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:35.125873 26578 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.126974 26729 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.127439 26722 consensus_queue.cc:237] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.067157 26703 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.132879 26703 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:35.133849 26721 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.115051 26645 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.135726 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.136482 22579 raft_consensus.cc:2393] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:35.137395 26645 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:35.138006 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.085927 26012 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:35.138566 22579 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.138778 26012 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.139413 21746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42850 (request call id 208) took 9234 ms. Trace:
I20260709 12:11:35.142642 21852 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.051981 26365 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.147153 26729 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:35.150175 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.148694 26365 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:35.152233 22579 raft_consensus.cc:2468] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:35.156141 26644 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.157248 26655 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:35.157650 26655 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:35.157747 21893 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:35.158753 26703 raft_consensus.cc:2804] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:35.158648 26655 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.159453 26703 raft_consensus.cc:697] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:35.160270 26655 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.160503 26703 consensus_queue.cc:237] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.162796 26658 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:35.163233 26658 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:35.169008 21843 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:35.170825 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:35.176994 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 99976.2us
I20260709 12:11:35.220367 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:35.222592 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 133829us
I20260709 12:11:35.222851 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:35.223976 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 73091.8us
I20260709 12:11:35.220387 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.225883 21850 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:35.228015 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.231429 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.235513 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:35.236439 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.238936 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.240849 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.242439 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.250510 21926 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.252017 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.255219 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:35.256095 21925 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.139824 21746 rpcz_store.cc:276] 0709 12:11:25.905235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.905660 (+   425us) service_pool.cc:224] Handling call
0709 12:11:35.139181 (+9233521us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:29.905666 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:29.969697 (+ 64031us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:29.969733 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:11:29.969758 (+    25us) tablet.cc:662] Decoding operations
0709 12:11:30.089792 (+120034us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:30.089860 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:30.089893 (+    33us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:11:30.091435 (+  1542us) tablet.cc:701] Row locks acquired
0709 12:11:30.091458 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:11:30.091600 (+   142us) write_op.cc:270] Start()
0709 12:11:30.091725 (+   125us) write_op.cc:276] Timestamp: P: 1783599090091555 usec, L: 0
0709 12:11:30.091747 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:11:30.092389 (+   642us) log.cc:844] Serialized 8192 byte log entry
0709 12:11:30.556214 (+463825us) op_driver.cc:464] REPLICATION: finished
0709 12:11:30.604085 (+ 47871us) write_op.cc:301] APPLY: starting
0709 12:11:30.604147 (+    62us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:31.160928 (+556781us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:31.164144 (+  3216us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:33.194472 (+2030328us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:33.195224 (+   752us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 12:11:33.195319 (+    95us) write_op.cc:312] APPLY: finished
0709 12:11:33.196173 (+   854us) log.cc:844] Serialized 188 byte log entry
0709 12:11:33.406732 (+210559us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.407296 (+   564us) write_op.cc:454] Released schema lock
0709 12:11:33.407376 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:33.408137 (+   761us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.408168 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":861005,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":47637,"apply.run_cpu_time_us":51138,"apply.run_wall_time_us":2803908,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91865,"num_ops":21,"prepare.queue_time_us":93758,"prepare.run_cpu_time_us":20308,"prepare.run_wall_time_us":484547,"raft.queue_time_us":96322,"raft.run_cpu_time_us":7399,"raft.run_wall_time_us":74253,"replication_time_us":444229,"thread_start_us":616190,"threads_started":5,"wal-append.queue_time_us":541551,"wal-append.run_cpu_time_us":33566,"wal-append.run_wall_time_us":2096301}]]}
I20260709 12:11:35.260497 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:35.262773 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:35.267695 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:35.268561 21918 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:35.278832 21926 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:35.300236 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.302177 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.303906 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.323884 21852 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:35.325827 21848 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:35.327049 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 78569.7us
W20260709 12:11:35.328245 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 242098us
W20260709 12:11:35.329367 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 198788us
I20260709 12:11:35.164189 26658 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.333027 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.344246 22584 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:35.347621 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:35.334312 26639 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.359093 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.349640 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.352619 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:35.361277 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.348811 26688 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:11:35.363327 26688 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:35.363713 26688 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:35.361335 26729 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:11:35.364611 26688 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.366803 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.367944 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.368963 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:35.369416 26706 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.670s	user 0.005s	sys 0.000s
I20260709 12:11:35.369556 21844 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:35.370846 22578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 972) took 1370 ms. Trace:
I20260709 12:11:35.246598 26644 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:11:35.371233 22578 rpcz_store.cc:276] 0709 12:11:34.000082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.059920 (+ 59838us) service_pool.cc:224] Handling call
0709 12:11:34.068711 (+  8791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.122425 (+ 53714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.122478 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.163532 (+ 41054us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.485496 (+321964us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:34.485557 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.485676 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.368946 (+883270us) spinlock_profiling.cc:243] Waited 9.87 ms on lock 0x7b24002f1038. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1b349c4 00007f3be1b32acb 00007f3be1ceddc9 00007f3be1ceda55 00007f3be1ced09d 00007f3be491f10e 00007f3be493688c 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221
0709 12:11:35.370542 (+  1596us) raft_consensus.cc:1685] finished
0709 12:11:35.370567 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.370787 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43201,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":21303,"spinlock_wait_cycles":22704896,"thread_start_us":253797,"threads_started":1,"wal-append.queue_time_us":456552}
I20260709 12:11:35.372511 26644 raft_consensus.cc:3055] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:35.372985 26644 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:35.375967 21848 raft_consensus.cc:1217] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Deduplicated request from leader. Original: 7.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 12:11:35.376487 21848 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:35.391728 21844 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:35.393472 21849 raft_consensus.cc:2368] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:35.396466 21848 raft_consensus.cc:1240] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:35.401923 26729 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.402289 26012 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.402587 26729 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.404659 26012 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:35.393625 26456 consensus_queue.cc:1059] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:35.405965 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:35.335517 26652 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:35.395570 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:35.406939 22547 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:35.410517 21847 raft_consensus.cc:2393] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 10: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:35.373828 26644 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.335992 26025 consensus_queue.cc:1059] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:11:35.406185 26456 raft_consensus.cc:3055] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:35.419097 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.420110 21850 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:35.425451 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.426604 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:35.427433 21921 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:35.429397 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50065us
I20260709 12:11:35.416401 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.430083 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.350791 26662 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.430632 21844 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.426115 21849 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:35.439762 21918 raft_consensus.cc:1240] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:35.439898 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.395010 26530 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:11:35.386270 26639 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.430635 21847 raft_consensus.cc:2376] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10. Re-sending same reply.
I20260709 12:11:35.458683 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.455118 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:35.445580 21892 leader_election.cc:336] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.522s (SENT)
I20260709 12:11:35.476444 21848 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:35.454497 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:35.454229 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:35.462692 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.480031 21850 raft_consensus.cc:2468] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:35.480185 21919 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.480031 21920 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:35.479408 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:35.484220 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.485055 21925 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:35.485881 21922 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:35.486920 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:35.492880 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 53305.2us
I20260709 12:11:35.493978 21845 raft_consensus.cc:2410] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:11:35.449059 26642 consensus_meta.cc:287] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.003s
I20260709 12:11:35.457864 26604 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:35.498528 26642 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.410104 26729 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:35.429777 26632 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:35.497388 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.456394 26576 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.416661 26456 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:35.499617 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.471151 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.504969 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.457374 26738 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:35.447780 26025 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:35.447077 26644 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.413595 26652 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.455071 26578 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.505424 21849 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:35.502627 26632 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.503788 26658 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.495106 26173 raft_consensus.cc:3055] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:35.513803 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 446104us
I20260709 12:11:35.544447 26173 raft_consensus.cc:740] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:35.545224 21967 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.545456 26173 consensus_queue.cc:260] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.547101 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:35.514461 26740 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:35.547804 26576 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:35.495687 26368 consensus_queue.cc:1059] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:35.548192 26740 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.508738 26025 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:35.549154 26025 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:35.536080 26632 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.550391 26578 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:35.551180 26578 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.551625 26578 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.553675 26578 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:35.516784 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.517063 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.556869 21848 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:35.504168 26604 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:35.517599 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 170059us
I20260709 12:11:35.561275 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.518631 26662 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:35.520077 26642 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:35.554247 26468 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:35.520891 26456 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.528236 26652 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:35.481408 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:35.572546 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 141269us
I20260709 12:11:35.575423 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:35.575858 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.431192 26374 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:11:35.557938 21919 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:35.571745 21927 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:35.571982 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.580375 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.581055 21848 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:35.581910 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.587211 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.590014 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.590545 21967 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:35.591292 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.592415 21848 raft_consensus.cc:3060] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:35.592592 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.516075 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.520165 26639 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:35.571620 26530 raft_consensus.cc:3055] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:35.547153 26173 raft_consensus.cc:3060] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.577288 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.550335 26740 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:35.593716 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 112364us
W20260709 12:11:35.594461 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.578191 26456 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.592773 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.589820 26721 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:35.593796 21850 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 17.
I20260709 12:11:35.597762 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:35.605792 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.606504 21847 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:35.604820 21967 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:35.595000 26530 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:35.611243 26530 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.612390 26530 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.615072 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.616420 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.617497 26707 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:35.617942 26707 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.618311 26707 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:35.574764 26576 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:35.632489 26576 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:35.632959 26576 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.633230 26688 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:35.620527 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 202367us
I20260709 12:11:35.635568 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.636765 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.637766 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.625249 26025 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.628381 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.640268 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.646574 21852 raft_consensus.cc:2410] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:35.646391 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.647238 21844 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:35.647603 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.648105 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.648918 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.653690 21848 raft_consensus.cc:2410] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:35.598754 26642 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:35.656255 21845 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:35.656575 21845 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:35.598237 26721 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:35.660722 21844 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:35.663368 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.665484 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:35.669883 26698 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:35.677763 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 83291.1us
I20260709 12:11:35.678048 21817 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.678496 21964 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:35.659171 26749 consensus_queue.cc:1059] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:35.680156 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.667836 21845 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.683409 21845 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:35.684716 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 79968.9us
I20260709 12:11:35.654623 26504 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:35.686153 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.663736 26662 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:35.684748 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 92054.1us
W20260709 12:11:35.698035 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 81707.7us
I20260709 12:11:35.699160 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.706967 22584 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:11:35.708618 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 73767.2us
I20260709 12:11:35.665910 26674 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.663420 26743 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.718319 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:35.722787 21847 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 18.
W20260709 12:11:35.736891 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.687493 26616 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.738999 22579 raft_consensus.cc:1240] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:35.739535 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.738147 22581 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 12:11:35.732312 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.743327 21924 raft_consensus.cc:2393] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 11: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:35.748554 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.750803 21849 raft_consensus.cc:2368] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:35.745025 21850 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:35.749610 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.752779 21998 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:11:35.747411 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 61349.7us
I20260709 12:11:35.688217 26025 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:35.687297 26642 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:35.760982 21967 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:35.759682 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 94513.4us
W20260709 12:11:35.762341 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 63296.7us
I20260709 12:11:35.763767 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:35.768966 21923 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:35.765537 21992 raft_consensus.cc:1240] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:35.700832 26468 raft_consensus.cc:2764] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:35.665529 26738 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:11:35.776661 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.777364 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.768064 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.778280 22001 raft_consensus.cc:2410] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:35.778880 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.778998 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.776827 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.781777 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:35.782646 22577 raft_consensus.cc:2410] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:35.782981 21997 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:35.782965 21967 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:35.783917 21922 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:35.778431 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.786557 21918 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:35.787587 21996 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:35.742753 26743 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.701028 26655 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:11:35.748229 26530 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.795455 21967 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:35.796599 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 118622us
W20260709 12:11:35.792966 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 114563us
I20260709 12:11:35.775257 26504 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:35.798516 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.804132 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.799327 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.804536 21992 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:35.804797 22000 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:35.775565 26365 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.767858 26698 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:35.808400 21892 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.537s (SENT)
I20260709 12:11:35.808065 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:35.808266 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.811403 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:35.817094 21994 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:35.817644 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.825361 22575 raft_consensus.cc:1240] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:35.824596 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.819615 22001 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:35.825285 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:35.824980 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:35.765254 26703 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:11:35.803146 21964 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:35.829725 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:35.831434 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:35.835727 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:35.837282 22580 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:35.837872 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.743940 26685 consensus_queue.cc:1059] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:11:35.800253 26744 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:35.841010 21817 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.842128 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.843524 21993 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:35.844398 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.853967 21997 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 12: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:35.854766 21848 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:35.809927 26468 raft_consensus.cc:2804] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:35.794836 26743 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.864068 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.794852 26374 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:11:35.867130 21852 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:35.826664 26662 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:35.872778 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.857635 22584 raft_consensus.cc:1240] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.858532 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.880247 22579 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.858398 22000 raft_consensus.cc:2393] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:35.859076 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.861537 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.870425 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:35.882400 21850 raft_consensus.cc:2393] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:35.882400 21848 raft_consensus.cc:2393] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 7: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:35.883895 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 75520.4us
I20260709 12:11:35.855125 26365 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:35.853336 26738 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:35.869197 26735 log.cc:927] Time spent T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.544s	user 0.002s	sys 0.002s
I20260709 12:11:35.902995 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:35.909593 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 68657.9us
I20260709 12:11:35.911010 21996 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.911366 21817 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.901955 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:35.912580 22001 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 13: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:35.908371 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:35.901966 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.915333 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:35.916742 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 146313us
I20260709 12:11:35.851523 21818 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.934264 21922 raft_consensus.cc:2393] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:35.933732 22000 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:35.871425 26764 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:35.932562 21892 leader_election.cc:336] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.783s (SENT)
I20260709 12:11:35.935981 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:35.876139 26744 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:35.944970 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.946449 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:35.950089 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:35.951438 21926 raft_consensus.cc:2393] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:35.953573 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:35.910452 26754 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.954402 21992 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 13: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:35.948344 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:35.915082 26468 raft_consensus.cc:697] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:35.852322 21849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:35.971834 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:35.975342 22579 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:35.976333 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:35.954829 26737 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:35.984684 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:35.975478 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 57952.4us
I20260709 12:11:35.988251 21847 raft_consensus.cc:2468] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:35.983171 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.989132 22581 raft_consensus.cc:2393] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:35.989646 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:35.990439 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.971853 21849 raft_consensus.cc:606] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:35.949851 26764 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:35.910190 26365 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.000245 21926 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:36.001106 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:35.995286 22001 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.998119 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:35.943445 26655 consensus_queue.cc:1059] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:11:35.905076 26642 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:35.943559 26576 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.012836 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:35.983891 26644 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:36.022835 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 128389us
I20260709 12:11:35.992259 26173 consensus_queue.cc:1059] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:35.992499 26737 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
W20260709 12:11:36.028710 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 92811.2us
I20260709 12:11:36.029955 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:36.036762 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 86236.8us
I20260709 12:11:36.024897 26767 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:36.010393 26662 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:35.955341 26632 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.027871 21843 raft_consensus.cc:2410] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:35.982606 26769 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.024292 22579 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 12:11:35.976315 26754 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.040289 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:36.042001 21996 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:36.044112 21995 raft_consensus.cc:2393] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:36.045629 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:36.054445 21892 leader_election.cc:336] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.967s (SENT)
I20260709 12:11:36.055015 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:36.057513 22581 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:36.042536 26738 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:36.059265 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:36.069200 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:36.070268 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:36.070744 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.071269 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:36.066493 26767 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:11:36.073076 22579 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:36.073293 21845 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:36.076876 26768 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:36.048717 26658 raft_consensus.cc:3055] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.060822 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:36.044870 26771 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:36.091562 26768 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:36.095541 26768 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:36.096516 26758 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 12:11:36.096922 26773 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.097456 26773 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.092475 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:36.047426 26749 consensus_queue.cc:1059] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:11:36.084565 26504 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:36.090309 26658 raft_consensus.cc:740] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.059864 26644 consensus_queue.cc:1059] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:11:36.104157 26773 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:36.150488 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.146888 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 295424us
I20260709 12:11:36.139423 26767 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:36.160706 26688 consensus_meta.cc:287] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.001s
I20260709 12:11:36.081931 26468 consensus_queue.cc:237] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.053598 26744 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.181178 26632 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:36.181664 26754 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:36.156634 26777 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:11:36.183331 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.183005 26658 consensus_queue.cc:260] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.184170 21845 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:36.184478 26658 raft_consensus.cc:3060] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.184962 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.185633 21845 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:36.186441 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:36.187455 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.188220 21845 raft_consensus.cc:2410] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:36.188962 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.189904 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.190748 21845 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:36.191524 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:36.192083 26765 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:11:36.192729 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.193529 21845 raft_consensus.cc:2410] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:11:36.194691 26707 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.003s
I20260709 12:11:36.194581 26504 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.194785 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.166213 26769 raft_consensus.cc:3055] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:36.196452 26769 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.195380 26707 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.197376 26365 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:36.172211 26685 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:36.198222 22583 raft_consensus.cc:2393] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 16: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:36.198686 26685 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.199347 26707 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:36.199644 26685 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.200630 21850 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:11:36.201035 21850 pending_rounds.cc:85] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 7
I20260709 12:11:36.201251 21850 pending_rounds.cc:107] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:36.201520 21850 raft_consensus.cc:2889] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.089493 26764 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.180727 26749 raft_consensus.cc:3055] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:36.204851 22575 raft_consensus.cc:1275] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:36.205168 26749 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:11:36.205852 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.206382 26749 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.207839 26749 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.208221 26576 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:36.208865 26743 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.210091 22000 raft_consensus.cc:2368] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:36.197417 26769 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.171072 26738 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:36.219280 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.219807 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.221932 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.222261 26688 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:36.222920 26688 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.223539 21818 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.224100 26368 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:36.224527 26368 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.225801 26688 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:36.225399 26368 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.226675 21818 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:36.226907 26173 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.229686 21850 raft_consensus.cc:1240] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:36.231007 26368 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.235121 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:36.236054 22575 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:36.238840 26451 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:36.240275 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 265007us
W20260709 12:11:36.241712 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 196044us
W20260709 12:11:36.242830 21892 leader_election.cc:336] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 1.990s (SENT)
I20260709 12:11:36.242725 26737 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.245626 26456 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.246313 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39640 (request call id 732) took 1093 ms. Trace:
I20260709 12:11:36.246711 21843 rpcz_store.cc:276] 0709 12:11:35.153202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.236107 (+ 82905us) service_pool.cc:224] Handling call
0709 12:11:36.246121 (+1010014us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400215f54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:36.246259 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817932672}
I20260709 12:11:36.248999 26743 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:36.254456 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:36.264317 26752 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.264736 26752 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:36.264932 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:36.265146 26752 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.266163 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:36.266717 22000 raft_consensus.cc:2376] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14. Re-sending same reply.
I20260709 12:11:36.267422 26707 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:36.269213 26674 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:36.270826 26632 consensus_queue.cc:1059] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:36.271976 26632 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.272404 26632 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:36.256548 26721 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.273489 26632 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.274137 26721 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.275938 26766 raft_consensus.cc:3055] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:36.276408 26766 raft_consensus.cc:740] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.277204 26766 consensus_queue.cc:260] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.281716 21964 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.262948 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:36.282685 26619 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:36.282755 26698 raft_consensus.cc:3055] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:36.283336 26698 raft_consensus.cc:740] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:36.284196 26698 consensus_queue.cc:260] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.285459 26698 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:36.286808 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.287524 21851 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:36.291512 21845 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:36.291883 21845 pending_rounds.cc:85] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 4
I20260709 12:11:36.292078 21845 pending_rounds.cc:107] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:36.292289 21845 raft_consensus.cc:2889] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.294130 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:36.295456 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:36.296693 21926 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:36.301824 21993 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:36.302012 26740 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:36.227064 26748 consensus_queue.cc:1059] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:11:36.304909 21966 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.305043 26748 raft_consensus.cc:3055] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:36.305528 26748 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.305661 26740 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.283356 26707 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.307544 26707 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.282991 21995 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 12: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:36.310496 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:36.320559 22001 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
W20260709 12:11:36.321377 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.255620 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:36.322827 21892 leader_election.cc:336] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 2.143s (SENT)
I20260709 12:11:36.323338 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:36.260854 22549 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.257243 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:36.328801 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:36.329530 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:36.330648 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.336007 21967 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:36.327931 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:36.350078 21924 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 12: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:36.350629 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 124063us
I20260709 12:11:36.293591 21750 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:36.177083 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 84688.6us
I20260709 12:11:36.352628 21993 raft_consensus.cc:2393] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 7: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:11:36.355412 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 45019.7us
I20260709 12:11:36.356617 21818 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.359870 21926 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:11:36.355850 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 95097.5us
I20260709 12:11:36.370653 22549 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.365375 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.375201 22000 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:36.378911 26368 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.381304 21847 raft_consensus.cc:1240] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:36.379624 21818 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.382609 26368 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.383212 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.384271 21847 raft_consensus.cc:2393] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:36.386307 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.353472 26740 consensus_queue.cc:1059] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:11:36.387530 21847 raft_consensus.cc:2410] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:11:36.388962 26784 consensus_queue.cc:1059] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:36.389744 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.390110 26368 raft_consensus.cc:3055] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.390648 26368 raft_consensus.cc:740] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.394963 21925 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:36.398489 21918 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:36.404897 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:36.407471 21924 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:36.408119 22584 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:36.341634 26771 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.412253 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.374888 26768 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.373863 26766 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.375114 26743 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.402276 26451 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.405930 26756 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:36.467483 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 56689.1us
I20260709 12:11:36.355005 26722 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 12:11:36.456564 26736 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.005s	sys 0.019s
I20260709 12:11:36.450330 26768 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.479802 21992 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:36.457990 26365 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.460472 26025 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:36.486063 26763 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:11:36.493250 26025 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.456949 26783 consensus_queue.cc:1059] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:11:36.476579 26707 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:36.494226 26025 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.495332 26707 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.495587 26025 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.496037 26707 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.477841 26769 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.456641 26782 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:36.486814 26771 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:36.482120 26736 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.006s	sys 0.020s
I20260709 12:11:36.353555 26748 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.433028 26619 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:11:36.492517 26768 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.500249 26374 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:36.409471 26368 consensus_queue.cc:260] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.521937 26780 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:36.525447 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 53040.2us
I20260709 12:11:36.526125 26530 raft_consensus.cc:3055] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.526640 26530 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.526904 26783 raft_consensus.cc:3055] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.527335 26783 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:36.527534 26530 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.528707 26530 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.528252 26783 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.529672 26783 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.529598 26748 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.542924 22579 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:36.576614 21997 raft_consensus.cc:1240] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.583264 26632 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:36.589744 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 324634us
I20260709 12:11:36.593475 26736 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.593784 26674 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:36.594123 26736 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:36.595468 26736 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.597359 26736 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:36.624476 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.633327 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.659899 26737 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.662130 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.666934 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:36.667578 21849 raft_consensus.cc:2376] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14. Re-sending same reply.
I20260709 12:11:36.668871 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.669509 21849 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:36.669585 26768 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.503934 21750 catalog_manager.cc:5697] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:36.675609 26773 consensus_meta.cc:287] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.004s
W20260709 12:11:36.675994 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 310737us
W20260709 12:11:36.677466 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 265301us
W20260709 12:11:36.690899 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.691896 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.692123 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.692909 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:36.693236 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.695003 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:36.677582 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 354751us
I20260709 12:11:36.683188 26504 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.683409 22583 raft_consensus.cc:1240] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.694105 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:36.702939 21892 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Timed out: RequestConsensusVote RPC to 127.20.56.65:42093 timed out after 2.203s (SENT)
I20260709 12:11:36.693552 21845 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:36.676473 26368 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.705229 21850 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:11:36.706624 21845 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:36.715178 21850 pending_rounds.cc:85] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 11
I20260709 12:11:36.715582 21850 pending_rounds.cc:107] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:11:36.715886 21850 raft_consensus.cc:2889] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.706751 21750 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:36.712688 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:36.721673 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.723579 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.721357 26655 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:36.727933 26752 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.729089 26781 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.729627 26781 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:36.732278 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.717442 26504 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.737605 21851 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:36.730213 26752 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:36.731406 26756 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.740715 26756 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:36.746240 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 58835.3us
I20260709 12:11:36.748396 26776 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:36.748967 26796 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:11:36.706233 26773 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.757308 26773 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:36.769205 21967 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.766747 21750 catalog_manager.cc:5697] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 9, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 9 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:36.781435 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:36.792326 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 89412.3us
I20260709 12:11:36.795027 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:36.795822 21923 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:36.803102 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 432484us
I20260709 12:11:36.804157 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.809904 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:36.810403 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:36.812980 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:36.814236 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:36.811046 21918 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 18.
W20260709 12:11:36.807156 26658 consensus_meta.cc:287] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.622s	user 0.020s	sys 0.013s
I20260709 12:11:36.823176 21892 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:36.801127 26655 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:36.824668 21750 catalog_manager.cc:5697] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:36.806098 26576 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.824249 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:36.808455 26468 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.832836 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:36.832089 21918 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:36.833451 21924 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:36.818886 26737 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:11:36.835543 26779 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:36.835791 21892 leader_election.cc:400] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:36.836170 21892 leader_election.cc:403] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:36.832779 26578 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.804275 26530 consensus_queue.cc:1059] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:36.841676 22549 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.821403 26698 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.824401 26456 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.844920 21750 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 6 to 9, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 9 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:36.847898 26645 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:36.819646 26451 consensus_queue.cc:1059] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:11:36.818745 26784 consensus_queue.cc:1059] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:11:36.850963 21750 catalog_manager.cc:5697] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 7 to 10, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 10 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.856498 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.868289 26451 raft_consensus.cc:3055] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:36.868913 26451 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:36.869099 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.848196 26578 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:36.879293 26578 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.880312 26752 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.883767 21750 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 10 to 11, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 11 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.888823 21923 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:36.888381 21750 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 10 to 11, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:36.890820 22549 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:36.850534 26674 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:36.898121 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:36.899183 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 78546.6us
W20260709 12:11:36.888978 26749 consensus_meta.cc:287] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.008s
I20260709 12:11:36.900272 21847 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:36.914727 21852 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:36.869954 26451 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:36.915064 21750 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 6 to 9, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 9 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:36.904906 26804 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.919013 26804 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.919559 26451 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.921352 26804 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:36.905627 26721 consensus_meta.cc:287] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.008s
I20260709 12:11:36.919443 21750 catalog_manager.cc:5697] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 9 to 12, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:36.908922 26632 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.910365 26773 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.923084 26773 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.923947 26773 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:36.925310 26773 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.910825 21846 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:36.922533 21999 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:36.928506 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 794) took 1140 ms. Trace:
I20260709 12:11:36.928762 21996 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:36.928860 21999 rpcz_store.cc:276] 0709 12:11:35.788065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.794660 (+  6595us) service_pool.cc:224] Handling call
0709 12:11:36.928307 (+1133647us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003f3254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:36.928428 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2539024768}
I20260709 12:11:36.891979 26688 consensus_queue.cc:1059] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:11:36.930573 26688 consensus_queue.cc:1243] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:36.930753 21996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1937) took 1027 ms. Trace:
I20260709 12:11:36.931138 21996 rpcz_store.cc:276] 0709 12:11:35.903163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.129229 (+226066us) service_pool.cc:224] Handling call
0709 12:11:36.928428 (+799199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.929192 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.930566 (+  1374us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54003f3250. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:36.930698 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837136768}
I20260709 12:11:36.933382 26655 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.933876 26655 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:36.934844 26655 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:36.944962 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46933.9us
I20260709 12:11:36.953450 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:36.936643 26655 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.956833 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:36.956605 21750 catalog_manager.cc:5697] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 8 to 9, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 9 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.959404 26799 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.950235 26804 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:36.983529 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.984297 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:36.984405 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 139590us
I20260709 12:11:36.988969 21750 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 7 to 10, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 10 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.950886 26674 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:36.993804 26748 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.995055 21750 catalog_manager.cc:5697] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.995777 21815 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:36.996948 21750 catalog_manager.cc:5697] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 10, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 10 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:36.998329 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:37.000010 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:36.985024 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.000631 21849 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 18.
I20260709 12:11:37.004019 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:37.005033 21849 raft_consensus.cc:2410] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:36.955753 26632 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:37.007485 21850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:37.018826 21850 raft_consensus.cc:606] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:37.019201 21850 raft_consensus.cc:614] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:36.988999 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:37.022600 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:37.022861 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:37.023126 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:37.023387 21852 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:36.968072 26752 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.983018 26781 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:37.025439 26799 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.020324 26749 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:37.015714 26698 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.026525 21922 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:11:37.027240 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.032162 22583 raft_consensus.cc:1275] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:37.033350 22575 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: [15.13-15.13]
W20260709 12:11:37.079237 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 90389.5us
I20260709 12:11:37.034773 26798 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.036226 21996 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.037108 26768 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:37.038085 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:37.089787 22581 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.030607 21750 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 9 to 10, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 10 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:37.043603 22582 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:37.088768 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.095252 21996 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:37.023787 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:37.045878 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:37.075165 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.085350 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.016815 26025 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.087743 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:37.099159 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.023669 26766 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.100485 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.102885 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:37.103524 22575 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:37.097782 21846 raft_consensus.cc:2410] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:37.080752 26749 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.107088 26749 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.107420 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.108642 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.110049 21998 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 12. Current term is 13. Ops: [11.10-12.11]
I20260709 12:11:37.077333 26799 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.111697 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.100850 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:37.128988 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.271261 21995 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:11:37.271507 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.091905 21750 catalog_manager.cc:5697] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
W20260709 12:11:37.272951 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 188032us
W20260709 12:11:37.274960 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 142796us
W20260709 12:11:37.106312 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 82601.4us
I20260709 12:11:36.994369 26748 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.080740 26782 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:11:37.113166 26780 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:11:37.246372 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.329545 22000 raft_consensus.cc:2368] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:11:37.254594 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:37.248292 21997 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:37.085789 26761 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:37.288653 26766 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.291589 22583 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.341405 21847 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:37.294746 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.295646 22581 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:37.321275 22576 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:37.342042 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:37.342835 21850 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:37.344170 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 256526us
I20260709 12:11:37.346735 21846 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:37.353878 21845 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:11:37.354300 21845 pending_rounds.cc:85] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 10
I20260709 12:11:37.354573 21845 pending_rounds.cc:107] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:11:37.354818 21845 raft_consensus.cc:2889] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.297119 26645 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:37.297482 26752 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:37.296916 26685 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.345484 26368 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.321841 26799 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:37.297188 26722 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:11:37.388798 26748 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:37.352973 26817 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:37.392830 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:37.393579 22576 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 15.
I20260709 12:11:37.395581 21966 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:37.402756 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.377521 26752 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.419605 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:37.420452 22000 raft_consensus.cc:606] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:37.383306 26645 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:37.435122 26674 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.435791 26674 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.438514 26674 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:37.444118 26820 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 12:11:37.392876 26817 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:37.451750 26817 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.390720 26456 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:11:37.425776 26743 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:11:37.390903 26368 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:37.462529 26504 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:37.464744 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:37.479713 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.322269 26768 consensus_queue.cc:1048] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:11:37.418344 26721 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:37.519266 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 54629.1us
I20260709 12:11:37.422444 26752 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:37.383824 26685 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.520612 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.498596 26619 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.517418 26748 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.572190 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 286018us
I20260709 12:11:37.550931 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.575924 21892 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.517304 26721 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.579808 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.522955 26771 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.580565 21996 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:37.586277 21817 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:37.581269 22576 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:37.573647 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:37.583932 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:37.589260 21922 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:37.530314 26639 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.519788 26456 consensus_queue.cc:1059] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:11:37.549703 26451 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.600157 21850 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:37.583953 26754 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.535137 26779 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:11:37.584806 26721 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.579873 26368 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:37.627599 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 54063.3us
I20260709 12:11:37.639878 22549 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:37.582037 26619 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.627036 26674 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:37.660328 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.584976 26748 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:37.627532 26749 consensus_meta.cc:287] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.001s
W20260709 12:11:37.631824 26773 consensus_meta.cc:287] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.706s	user 0.017s	sys 0.008s
W20260709 12:11:37.665462 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.594105 26771 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:37.650465 26368 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.659088 26799 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.676743 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:37.665657 26831 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.638968 26754 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:37.667606 26642 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.649902 26688 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:11:37.673108 26632 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.673825 26368 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.673452 26827 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.668640 26749 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:37.719985 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 133827us
I20260709 12:11:37.738071 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.719926 26504 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:37.742367 26504 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.745291 26504 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:37.746657 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 170861us
I20260709 12:11:37.747761 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.749306 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:37.714042 26799 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.649709 26645 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.721329 26368 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.756985 21846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:37.761291 21846 raft_consensus.cc:606] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:37.706506 26642 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.758769 26827 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:37.780236 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 103619us
I20260709 12:11:37.780328 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.782342 21996 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:37.772271 26799 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:37.786062 22549 leader_election.cc:400] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:11:37.786454 22549 leader_election.cc:403] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:37.788890 22575 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:11:37.790794 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:37.794071 26826 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:11:37.798623 26619 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:37.802837 26642 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:37.803021 26771 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:37.806811 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.807019 26748 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:37.808144 26763 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:37.808470 26749 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:37.808537 26763 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:37.809446 26763 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.810150 26756 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:37.792178 26674 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:11:37.810895 26754 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:37.788904 26799 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.812983 26766 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:37.813282 26799 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:37.791250 26832 log.cc:927] Time spent T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:11:37.815374 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:37.815997 21999 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.801124 26839 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.785722 26833 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:37.822479 26833 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:37.823067 21850 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:37.824652 26833 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:37.826711 26822 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.444s	user 0.002s	sys 0.000s
I20260709 12:11:37.826745 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:37.829568 26655 consensus_meta.cc:287] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.870s	user 0.010s	sys 0.002s
I20260709 12:11:37.830319 21852 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:37.822799 22581 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:11:37.843699 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 61132.2us
I20260709 12:11:37.846298 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.850509 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.842629 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:37.859913 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.861586 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.867132 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:37.868287 21923 raft_consensus.cc:2410] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:37.810402 26763 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:37.871524 26674 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.871694 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:37.872512 21851 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:37.875185 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:37.875918 21927 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:37.879925 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:37.881095 21850 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:37.879925 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:37.896005 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:37.896816 21922 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:37.898010 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 53294.2us
W20260709 12:11:37.904803 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 44960.5us
I20260709 12:11:37.874549 26468 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.861656 26799 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:37.875178 26754 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:37.908295 26674 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:37.913125 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:37.879518 26749 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.917896 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 127183us
I20260709 12:11:37.920472 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.897842 26838 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.933848 26818 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.935364 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:37.922891 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:37.928349 21818 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:37.939070 21843 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:37.942052 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:37.942705 21852 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:11:37.943181 21892 leader_election.cc:400] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:37.944033 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.897512 26752 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.913710 26842 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.951957 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:37.955433 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:37.956694 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.957794 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:37.961954 21922 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:37.934707 26655 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.965078 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:37.965371 21920 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:37.941480 26748 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.940158 26771 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.945282 26578 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.934489 26818 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:37.970479 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 52265us
I20260709 12:11:37.941143 26754 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:37.978057 21927 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:11:37.915829 26468 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:37.919631 26743 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:37.965952 21920 pending_rounds.cc:85] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 7
I20260709 12:11:38.002053 21920 pending_rounds.cc:107] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:38.002996 21920 raft_consensus.cc:2889] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.979964 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:37.965960 21922 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:37.978770 26674 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.984295 26841 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.988756 26825 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:37.994278 26722 raft_consensus.cc:3055] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:37.917524 26639 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:11:37.995915 26828 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.953967 26645 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:37.922487 26749 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.000051 21927 pending_rounds.cc:85] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 5
I20260709 12:11:38.024422 21927 pending_rounds.cc:107] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:38.024772 21927 raft_consensus.cc:2889] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.949841 26766 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.004349 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:37.967115 26799 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:37.966667 26456 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.012753 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:37.980479 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:37.971060 26817 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:38.016559 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.013312 21815 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:37.975806 26748 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:38.020816 26773 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.045709 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:37.976785 26823 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.023365 21919 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:37.953123 26662 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 12:11:38.052117 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 136594us
I20260709 12:11:37.984297 26685 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:37.963680 26619 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:38.033385 21918 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:37.978858 26642 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:37.975216 26655 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.015801 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:38.044966 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 64576.4us
I20260709 12:11:38.034650 26752 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:38.002568 26833 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:11:38.055801 26781 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:38.083813 26749 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.091156 26468 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:38.092617 26833 raft_consensus.cc:3055] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:38.093034 26833 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:38.053108 26766 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:38.102963 26766 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.103361 26766 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:38.112586 26772 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.113487 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 97764.1us
I20260709 12:11:38.113332 26772 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.020699 26722 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:38.115041 26722 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.115675 26772 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:38.116372 26722 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.116313 26772 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:38.116395 26374 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:11:38.118939 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.119521 21852 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:38.023918 26834 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.120205 26834 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.120963 21849 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:11:38.121323 21849 pending_rounds.cc:85] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 7
I20260709 12:11:38.121536 21849 pending_rounds.cc:107] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:37.963917 26842 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.121788 21849 raft_consensus.cc:2889] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:38.001994 26779 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:11:38.000480 21999 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
W20260709 12:11:38.055081 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50823.5us
I20260709 12:11:38.125170 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:38.021834 26841 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:37.998196 26771 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.126297 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.126813 26578 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.031260 26799 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.059464 26835 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:38.127518 26799 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:38.017402 26825 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:38.129381 26835 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:38.129522 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 69148.8us
I20260709 12:11:38.129874 26835 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:38.129930 26825 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.131336 26825 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.039531 26645 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 18 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:38.133509 26645 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.062878 26754 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.065275 26655 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:38.112679 26642 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.116564 26761 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:38.126932 21923 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:38.154560 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:38.018580 26674 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.047334 21844 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:38.046432 26748 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.039987 26817 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:38.136889 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.197058 21996 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:38.139405 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.140184 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.140996 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.142380 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.066756 26818 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.199550 21999 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 7.
I20260709 12:11:38.155932 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.143813 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.161315 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.162106 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.201617 22001 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:38.162606 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:38.167341 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.202718 22000 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:38.167805 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2308) took 1111 ms. Trace:
I20260709 12:11:38.169663 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.170303 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:38.205299 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 50710us
I20260709 12:11:38.208312 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:38.203787 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 260238us
W20260709 12:11:38.205431 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50967.6us
I20260709 12:11:38.210039 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:38.198280 22575 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 15.
I20260709 12:11:38.200932 21918 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:38.213253 21818 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:38.204454 22581 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:38.203476 21848 rpcz_store.cc:276] 0709 12:11:37.052357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.094731 (+ 42374us) service_pool.cc:224] Handling call
0709 12:11:37.298950 (+204219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.299319 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.299349 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.922615 (+623266us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b2c00014b88. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:11:37.922989 (+   374us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.044221 (+121232us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:38.044276 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.044369 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.157886 (+113517us) raft_consensus.cc:1685] finished
0709 12:11:38.157918 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.163385 (+  5467us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":374,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":18907,"spinlock_wait_cycles":53001600,"thread_start_us":73073,"threads_started":1,"wal-append.queue_time_us":112833}
I20260709 12:11:38.215270 26749 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:38.215895 26749 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:38.216367 26749 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:38.219313 21818 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:38.204144 21921 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:38.221972 21964 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:38.221225 21818 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:38.161808 26756 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.163923 26779 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.163626 26761 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.159200 26781 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:11:38.235329 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 73035.5us
I20260709 12:11:38.161375 26736 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:38.093950 26833 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.054111 26773 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:38.207052 26721 consensus_meta.cc:287] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.006s
W20260709 12:11:38.263036 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 53080.7us
I20260709 12:11:38.268491 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.232043 26504 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:38.233671 26025 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.207341 26817 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.253262 21818 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:38.254558 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 44255.1us
I20260709 12:11:38.258910 21850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d28906331f4545a29562f950eacb999e"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:38.298708 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.298727 21850 raft_consensus.cc:606] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:38.301404 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 48223.2us
I20260709 12:11:38.260645 21844 raft_consensus.cc:2468] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 19.
I20260709 12:11:38.272176 21817 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:38.248816 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:38.269224 22579 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:38.248554 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:38.167850 26642 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.242865 26848 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.269009 26768 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:38.298014 26632 consensus_meta.cc:287] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.007s
I20260709 12:11:38.247601 26756 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.255723 26761 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.280893 26504 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.275959 26857 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.276547 26655 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.287247 22575 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:38.308697 26848 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.312822 26662 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:11:38.323556 26861 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.280247 26025 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.276836 26743 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:38.324159 26841 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.276775 26721 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.252345 26779 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.322690 26740 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:38.308468 26839 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.358157 21851 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:11:38.371704 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.399441 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 150740us
I20260709 12:11:38.343648 26828 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:38.429893 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:38.400916 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.330549 26842 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:38.334062 26776 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:11:38.407833 26780 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:38.342178 26632 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.344213 26504 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.340215 26834 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:38.418059 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 169569us
I20260709 12:11:38.426829 26748 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.339022 26816 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.393010 26848 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.402537 26674 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.468060 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.468294 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:38.410944 26368 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.642s	user 0.014s	sys 0.000s
I20260709 12:11:38.435019 26771 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:38.469695 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:38.405953 26743 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.405591 26025 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:38.440547 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 131916us
I20260709 12:11:38.449343 22549 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:38.451442 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.463204 22582 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:38.466497 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.496821 21850 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:38.466886 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.437988 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:38.354120 26781 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.495014 21919 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
W20260709 12:11:38.498288 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 60372.1us
I20260709 12:11:38.444557 26578 consensus_queue.cc:1048] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:38.495978 22549 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:38.504556 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:38.357098 26857 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.509236 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.510092 21848 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:38.515102 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:38.519475 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:38.521104 22549 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:38.505344 26763 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.003s
I20260709 12:11:38.491537 26778 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.497155 26743 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.503190 26818 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:38.441912 26828 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.448534 26780 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.495534 26645 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.506089 26674 raft_consensus.cc:2804] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:38.473280 26368 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.568727 26857 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:38.569787 26368 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.539834 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.541288 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.572285 22575 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:38.534128 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:38.575124 21818 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:38.537772 26818 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:38.576061 26818 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.576442 26639 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.577068 26639 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:38.577594 26639 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.579723 26642 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:38.566815 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 260499us
I20260709 12:11:38.518726 26773 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:38.527334 26632 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.521955 26839 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.522527 26842 raft_consensus.cc:2764] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:38.527616 26841 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.567258 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:38.531260 26862 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.615670 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.582592 21996 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:38.587755 22578 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:38.581861 21817 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:38.537636 26776 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.598536 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.605093 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.620941 22001 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
W20260709 12:11:38.633821 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 99759.8us
I20260709 12:11:38.568776 26849 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.632601 21918 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:38.619932 22000 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
W20260709 12:11:38.606614 26852 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:11:38.538137 26778 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.645983 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.648392 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:38.652015 22575 raft_consensus.cc:2410] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:38.644865 26776 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.644778 26885 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.653631 26456 consensus_meta.cc:287] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.001s
I20260709 12:11:38.654066 26456 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.653965 26885 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.655207 26776 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:38.657388 26885 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:38.620898 26799 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.631992 26368 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:38.661108 26368 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.661533 26368 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.614223 26841 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:38.667093 26841 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.602703 26674 raft_consensus.cc:697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:38.597820 26632 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.620172 26862 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.597733 26879 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.660277 26799 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.635701 26756 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.639858 26849 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.697834 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:38.687067 26632 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.685508 26879 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.688946 26721 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:38.686131 26831 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.706339 26879 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.718511 26839 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:38.721966 26828 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:38.691660 26736 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.694332 26849 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.704052 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:38.644701 26504 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.696585 26779 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.709160 26645 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.708843 26674 consensus_queue.cc:237] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.709388 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:38.726171 26749 consensus_meta.cc:287] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.001s
I20260709 12:11:38.710714 26780 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:38.710965 26869 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:11:38.711686 26867 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 12:11:38.713316 26856 log.cc:927] Time spent T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:11:38.737076 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.735541 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.732115 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:38.789634 21921 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.703519 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.747994 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.728379 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:38.734890 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:38.736243 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:38.791478 21852 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:38.789135 21847 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:38.790469 21846 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:38.755028 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:38.686950 26862 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:38.714228 26766 consensus_meta.cc:287] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.000s
W20260709 12:11:38.763687 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 63261.7us
W20260709 12:11:38.763988 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 66262.9us
I20260709 12:11:38.733949 26662 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 12:11:38.803004 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 74702.5us
I20260709 12:11:38.804250 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.768900 22577 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:38.710072 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:38.777194 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.806491 21848 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.778523 26866 raft_consensus.cc:993] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:11:38.779383 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:38.813788 21924 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.779587 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.781049 26761 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.825685 21847 raft_consensus.cc:1275] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:11:38.750614 26748 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.752091 26736 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:38.785025 26825 consensus_meta.cc:287] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.653s	user 0.003s	sys 0.011s
I20260709 12:11:38.772408 26799 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:38.844601 21922 raft_consensus.cc:2410] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:38.810952 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.800015 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:38.722215 26833 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.811000 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.767443 26645 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:38.819820 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.820119 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:38.826287 21847 pending_rounds.cc:85] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 10
I20260709 12:11:38.831198 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.857002 21847 pending_rounds.cc:107] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:38.857347 21847 raft_consensus.cc:2889] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:38.831943 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:38.836655 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:38.844519 26799 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:38.839538 21852 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:38.840978 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.841792 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:38.848418 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 48518.1us
I20260709 12:11:38.812806 26857 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.853170 26025 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.864975 21850 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:38.858472 21919 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:38.791983 26749 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.884302 26749 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:38.859596 22001 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.886644 26865 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.888085 26757 raft_consensus.cc:1081] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:11:38.894331 26025 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:38.896625 21848 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:38.899487 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.899914 22001 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:38.900765 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:38.901530 21844 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:38.903054 21921 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:38.867511 22583 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:38.869087 26761 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:38.870487 26817 consensus_meta.cc:287] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.004s
I20260709 12:11:38.919092 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:38.918913 26817 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.921263 26817 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:38.874213 26632 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.921857 26817 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.815001 26766 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.876689 26743 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:38.923991 26632 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.925249 26778 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:38.925630 26743 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:38.878859 26841 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.928057 26841 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:38.843014 26736 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.932875 21851 raft_consensus.cc:1240] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 12:11:38.895452 26869 log.cc:927] Time spent T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:11:38.863248 26368 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.881189 21846 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:38.881560 26857 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.903815 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:38.860723 22549 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:38.943703 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 83115.3us
I20260709 12:11:38.945250 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:38.945336 22549 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:38.945946 21846 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.904374 21817 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:38.890667 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.910336 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:38.896565 26721 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.911901 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:38.913316 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:38.914108 26025 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:38.846396 26816 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.914522 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 755) took 1006 ms. Trace:
I20260709 12:11:38.956779 21843 rpcz_store.cc:276] 0709 12:11:37.908389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.951202 (+ 42813us) service_pool.cc:224] Handling call
0709 12:11:37.968533 (+ 17331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.092980 (+124447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.093013 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.093491 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.274687 (+181196us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:38.274723 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.337271 (+ 62548us) spinlock_profiling.cc:243] Waited 95.6 ms on lock 0x7b5400208854. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:38.337347 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.906623 (+569276us) raft_consensus.cc:1685] finished
0709 12:11:38.906644 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.914391 (+  7747us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28424,"raft.queue_time_us":30082,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":219916032,"thread_start_us":180914,"threads_started":1,"wal-append.queue_time_us":312781}
I20260709 12:11:38.847957 26756 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:11:38.897791 26799 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.866097 26645 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.917321 26732 consensus_queue.cc:1048] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:11:38.865662 26674 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.918057 26374 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:38.934257 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.879813 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:38.936259 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:38.938669 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 120418us
I20260709 12:11:38.911629 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:38.905570 26828 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.954635 26025 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:38.963423 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 59161.4us
I20260709 12:11:38.923997 26766 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:38.953521 26841 raft_consensus.cc:2804] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:39.004751 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.040169 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:38.922354 26817 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:38.954239 26721 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.954535 26632 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:39.044276 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:38.975992 26688 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:39.002403 26674 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.059990 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.060922 21921 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:38.951336 26639 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.062426 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:39.063436 22582 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.075800 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:38.968014 26816 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.077780 26025 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.050343 26721 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.051389 26632 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.057085 26766 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:39.054426 26841 raft_consensus.cc:697] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:39.096199 22582 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:39.057816 26762 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:39.062635 26674 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.107440 26823 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:39.069707 26688 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:11:39.113682 26848 consensus_meta.cc:287] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.641s	user 0.007s	sys 0.002s
I20260709 12:11:39.115187 26892 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.098585 21926 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:39.117908 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.144311 21921 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:39.063943 26504 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.099643 21967 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:39.156508 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 56952.5us
I20260709 12:11:39.049454 26828 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.140241 26688 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:39.140967 26891 log.cc:927] Time spent T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:11:39.141595 26841 consensus_queue.cc:237] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.095213 26632 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.160892 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.163383 21993 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:39.142696 26849 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.166239 26662 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:39.143029 26848 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.127945 26762 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.223346 26817 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:39.224171 26835 consensus_meta.cc:287] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 1.058s	user 0.011s	sys 0.000s
I20260709 12:11:39.224728 26368 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.224614 26835 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.225637 21919 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.231839 26799 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.232786 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.264288 21927 raft_consensus.cc:2376] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14. Re-sending same reply.
I20260709 12:11:39.233314 21846 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:39.268445 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.269213 21846 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.235158 26762 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.236455 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:39.240942 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.272042 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.242905 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.272719 21921 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
I20260709 12:11:39.197652 26766 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.243176 26816 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.244745 21847 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:11:39.210948 26662 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:39.274267 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.249979 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.241555 26645 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.279088 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.256886 21843 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.275278 21999 raft_consensus.cc:3060] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:39.276253 21997 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:11:39.278187 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 366638us
I20260709 12:11:39.279706 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.287011 22001 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.292689 21924 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:39.295405 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.296301 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.296881 21927 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.297415 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.299322 21919 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:39.165812 26892 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.318749 21992 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:39.311393 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:39.324766 21921 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:39.328197 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.328595 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.326570 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.325287 21925 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:39.328958 22001 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:39.329618 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:39.331225 21999 raft_consensus.cc:2468] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 8.
I20260709 12:11:39.335325 22000 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:39.331496 21846 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:39.286057 21923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "947619c833644483a9745291e5d8ba38"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:11:39.338725 21923 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:39.339078 21923 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.295298 26857 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:39.339893 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.341274 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.336498 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.341867 21850 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.342794 21999 raft_consensus.cc:2368] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:39.344441 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.345211 21852 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:39.347757 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.355087 22000 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:39.355223 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.360037 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.360857 21921 raft_consensus.cc:2393] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:39.298226 26766 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.368300 26828 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.368430 26645 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.370635 26662 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:39.371331 26818 consensus_meta.cc:287] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.001s
I20260709 12:11:39.420969 26818 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:39.372957 26879 consensus_meta.cc:287] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.000s
I20260709 12:11:39.421991 26879 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.423337 26766 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:39.424196 26879 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.425137 21849 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:39.372921 21995 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:39.427129 21922 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:39.372671 26849 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:39.373741 26848 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:39.374583 26877 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:39.375885 26862 consensus_meta.cc:287] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.003s
I20260709 12:11:39.378698 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.439733 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.440241 21924 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:39.440625 21995 raft_consensus.cc:2410] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:39.379180 21994 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:39.379254 26831 consensus_queue.cc:1059] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:39.384087 26909 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.384274 26736 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.444631 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.445863 21921 raft_consensus.cc:2410] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:39.385797 21852 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:39.377940 21923 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:39.387204 26897 log.cc:927] Time spent T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:11:39.388365 26799 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:39.390039 21927 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:39.404841 21850 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:39.408123 26674 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:39.406006 26856 log.cc:927] Time spent T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:39.413931 26721 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.415071 26632 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.420183 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.453003 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.453514 21920 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.421231 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.428802 21847 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:39.454448 21923 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:39.454536 22000 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 16.
I20260709 12:11:39.432829 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:39.420993 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.442523 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.442997 21966 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:39.452143 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 140832us
I20260709 12:11:39.456542 21918 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.373245 26892 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:39.457816 21997 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:39.458138 22547 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:39.459218 21992 raft_consensus.cc:2368] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:39.464710 22547 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:39.450591 26639 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.443429 26879 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:11:39.471779 21927 raft_consensus.cc:3055] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:39.472324 21927 raft_consensus.cc:740] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:39.475790 26818 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.477793 26721 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:39.478571 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.478495 26721 consensus_queue.cc:1059] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:39.479812 26721 raft_consensus.cc:3055] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:39.480139 26721 raft_consensus.cc:740] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:39.483505 26736 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.485749 26674 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:39.487454 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:39.443782 26862 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.488591 21927 consensus_queue.cc:260] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.497522 21927 raft_consensus.cc:3060] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:39.499480 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.471202 26866 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:39.467391 26892 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:39.502985 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:39.503211 21923 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:39.488086 26799 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:39.532721 21920 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:39.496338 26639 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:39.524547 26910 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.536684 26817 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:11:39.542225 26817 consensus_queue.cc:1243] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:39.546589 26835 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:39.526819 26799 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.551537 26799 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.556824 26632 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:39.557549 21918 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
W20260709 12:11:39.560853 26907 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.174s	user 0.000s	sys 0.002s
I20260709 12:11:39.564178 26862 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:39.537879 26892 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:39.566344 26892 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.540731 26866 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:39.570371 26866 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.498493 26721 consensus_queue.cc:260] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.580420 22584 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:39.581616 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:39.583717 22581 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:39.584939 26721 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:39.588855 26889 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.670s	user 0.003s	sys 0.000s
I20260709 12:11:39.592744 22583 raft_consensus.cc:1240] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 18. Current term is 19. Ops: []
W20260709 12:11:39.596997 26906 log.cc:927] Time spent T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.225s	user 0.003s	sys 0.000s
I20260709 12:11:39.595578 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:39.599545 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:39.600184 26849 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.605007 26799 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.641759 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:39.605316 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:39.605861 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 74550.4us
I20260709 12:11:39.606343 26877 consensus_queue.cc:1059] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:39.599789 26916 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.225s	user 0.000s	sys 0.005s
I20260709 12:11:39.606710 26365 consensus_queue.cc:1059] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:39.612735 21927 raft_consensus.cc:1275] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:11:39.613370 26766 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:39.653191 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.616019 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:39.617761 26918 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:11:39.618445 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.654471 21843 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.654384 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:39.622201 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.622627 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:39.628710 26885 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:39.659462 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:39.645936 26616 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:39.662834 21815 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:39.631623 26818 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:39.629127 26907 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.067s	user 0.004s	sys 0.000s
W20260709 12:11:39.632148 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.633975 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2339) took 1135 ms. Trace:
I20260709 12:11:39.635234 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:39.640688 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:39.643103 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:39.668485 22581 raft_consensus.cc:2368] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:39.668318 22577 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:39.656178 26504 raft_consensus.cc:3055] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:39.647112 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:39.675163 22583 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.648016 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:39.676191 22584 raft_consensus.cc:2368] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:39.615115 21847 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:39.655092 22576 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.657013 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:39.626132 26722 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:11:39.658840 26834 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:39.627892 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:39.665138 21850 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:39.666750 21845 rpcz_store.cc:276] 0709 12:11:38.498877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.501599 (+  2722us) service_pool.cc:224] Handling call
0709 12:11:38.501983 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.289754 (+787771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.289783 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.290252 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.453420 (+163168us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:39.453457 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.633599 (+180142us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002909d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:39.633647 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.633702 (+    55us) raft_consensus.cc:1685] finished
0709 12:11:39.633715 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.633918 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72306,"raft.queue_time_us":67620,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":19054,"spinlock_wait_cycles":1656962816,"thread_start_us":115800,"threads_started":1,"wal-append.queue_time_us":197270}
I20260709 12:11:39.662600 21966 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:39.693545 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:39.643585 21892 leader_election.cc:400] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:39.697011 21892 leader_election.cc:403] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:39.672328 26779 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:39.662119 26849 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 12:11:39.696076 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 68259.4us
W20260709 12:11:39.697471 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 54079.1us
I20260709 12:11:39.680351 26879 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:39.673756 22582 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:39.703248 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 1010) took 1423 ms. Trace:
I20260709 12:11:39.680047 26616 raft_consensus.cc:697] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:39.694614 26923 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:39.674690 26504 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:39.672549 26877 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:11:39.704595 22580 rpcz_store.cc:276] 0709 12:11:38.279576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.279725 (+   149us) service_pool.cc:224] Handling call
0709 12:11:38.296006 (+ 16281us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:38.303061 (+  7055us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:38.749863 (+446802us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b180041f560. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cab455 00007f3be87933c7 00007f3be4da59a7 00007f3be4db50bf 00007f3be4db5038
0709 12:11:38.975999 (+226136us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.305061 (+329062us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:39.325726 (+ 20665us) log.cc:844] Serialized 52 byte log entry
0709 12:11:39.326131 (+   405us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:39.327067 (+   936us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.365581 (+ 38514us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.385308 (+ 19727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.385524 (+   216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.560304 (+174780us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:39.703003 (+142699us) raft_consensus.cc:1685] finished
0709 12:11:39.703029 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.703188 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21892,"prepare.queue_time_us":653225,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":24354,"raft.queue_time_us":155202,"raft.run_cpu_time_us":565,"raft.run_wall_time_us":26436,"spinlock_wait_cycles":140786816,"thread_start_us":511410,"threads_started":3,"wal-append.queue_time_us":344085}
I20260709 12:11:39.697095 26756 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.674839 26818 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.662372 26885 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.703830 26879 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.699579 26779 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.717998 26779 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.718202 26799 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:39.706115 26780 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:39.719256 26780 raft_consensus.cc:697] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:39.720183 26780 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.722074 26504 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.698477 26578 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:39.709574 26923 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:39.708428 21892 leader_election.cc:400] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:39.703840 21966 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:39.735128 21892 leader_election.cc:403] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:39.698906 26910 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.724249 21843 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
W20260709 12:11:39.724767 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 43776us
I20260709 12:11:39.702977 26816 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:39.726859 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:39.709224 22549 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:39.715257 26662 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:39.723428 26879 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:39.748116 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.765933 21996 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:39.766891 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.750504 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.714118 26722 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:11:39.752315 21994 raft_consensus.cc:1217] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[7.9-11.11]   Dedup: 7.9->[9.10-11.11]
I20260709 12:11:39.770911 21994 pending_rounds.cc:85] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 9
I20260709 12:11:39.754045 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:39.771674 21843 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:39.772861 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.754820 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.774200 21926 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:39.747401 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:39.763377 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.763899 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.749449 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:39.767869 21999 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.777227 26892 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.777601 26892 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.777942 26892 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.752322 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.780997 21927 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.782822 26921 consensus_queue.cc:1059] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:39.784162 26674 raft_consensus.cc:3055] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:39.770044 21893 leader_election.cc:400] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:39.784519 26674 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:39.785018 21893 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:39.771215 21994 pending_rounds.cc:107] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:11:39.785717 21994 raft_consensus.cc:2889] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:39.785396 26674 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.755801 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.787142 21845 raft_consensus.cc:3060] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.787381 26674 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.790944 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.791549 21847 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.792366 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.793977 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.795979 21999 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:39.798298 21997 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:39.797981 21927 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:39.799872 21893 leader_election.cc:400] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:39.800181 21893 leader_election.cc:403] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:39.802078 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.800978 22547 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:39.802902 21922 raft_consensus.cc:3060] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.750502 26870 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:39.744797 26662 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:39.813059 21845 raft_consensus.cc:2468] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:39.763501 26732 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.763368 26504 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.822427 22583 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:39.767300 26799 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:39.768843 26816 raft_consensus.cc:697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:39.735949 26578 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.797499 26749 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:39.865372 21997 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:39.805184 26817 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:39.809370 26831 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:39.802897 26909 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:39.875114 21922 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:39.769397 26900 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 12:11:39.814684 26870 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.817584 26920 raft_consensus.cc:2804] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:39.890347 21847 raft_consensus.cc:2468] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:39.890964 22547 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:39.894441 26909 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:39.907430 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 107690us
I20260709 12:11:39.871258 26799 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:39.889065 26831 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.914477 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:39.922149 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:39.923877 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.924636 21918 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:39.891108 26903 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:39.898164 26870 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.893021 26749 raft_consensus.cc:697] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:39.930732 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:39.933202 22576 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:39.879582 26883 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:11:39.939153 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:39.910164 26752 raft_consensus.cc:2804] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:39.910175 26833 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.944295 26833 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.946992 26833 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.948480 26365 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.816732 26616 consensus_queue.cc:237] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:39.954432 26928 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:11:39.956346 26899 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.785s	user 0.004s	sys 0.000s
I20260709 12:11:39.962915 26749 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:39.967185 26927 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:11:39.967725 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:39.969099 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:39.969810 22582 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 16.
I20260709 12:11:39.970728 22576 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:39.916716 26645 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:39.972007 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:39.972219 26645 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.973052 22580 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:39.974213 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:39.906613 26816 consensus_queue.cc:237] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.892810 26923 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.897969 26921 consensus_queue.cc:1048] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:11:39.919677 26920 raft_consensus.cc:697] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:39.975292 22577 raft_consensus.cc:2393] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 11: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:39.991621 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:39.927531 26831 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.891839 26817 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:39.984407 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.985273 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.999809 21847 raft_consensus.cc:2368] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:40.000779 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:39.986305 21925 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:39.993696 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:40.003549 21844 raft_consensus.cc:2368] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
W20260709 12:11:39.969993 26925 log.cc:927] Time spent T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:11:39.913203 26835 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:11:39.938503 26736 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.005887 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:40.009184 22581 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:40.010340 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:40.011057 21844 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.005877 21818 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:40.012445 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.013517 21850 raft_consensus.cc:2410] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:11:39.974982 26926 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:11:39.974368 26645 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.019594 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:40.002396 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.024878 21818 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:40.027545 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.028187 21847 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 10.
I20260709 12:11:40.028306 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:40.028952 21852 raft_consensus.cc:2368] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:39.979393 26818 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:39.979012 26885 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:40.038151 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:40.031997 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:39.995381 26921 consensus_queue.cc:1243] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:39.987371 26752 raft_consensus.cc:697] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:40.030215 21847 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:39.980437 26909 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.015938 26835 consensus_queue.cc:1243] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:40.047282 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:40.043318 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.006047 26374 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.922277 26662 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:39.985674 26892 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.031251 26756 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.055814 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:40.062211 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 294586us
I20260709 12:11:40.077133 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:40.078544 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:40.051533 21818 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:40.062844 21844 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:40.045866 26688 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:40.045044 26834 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.061681 26874 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.091637 21992 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:40.045332 26937 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:40.092262 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:40.071784 26936 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.099066 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:40.088696 26368 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:40.090174 26885 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:40.104635 26908 log.cc:927] Time spent T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.728s	user 0.003s	sys 0.000s
I20260709 12:11:40.124341 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.125510 21844 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 16: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:40.107249 26828 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:11:40.111734 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:40.118952 26773 raft_consensus.cc:993] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:11:40.124190 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.056707 26849 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:11:40.071754 26639 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 12:11:40.139092 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 55152.7us
I20260709 12:11:40.099794 26923 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.146117 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:40.146759 21926 raft_consensus.cc:1217] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Deduplicated request from leader. Original: 11.11->[13.12-19.15]   Dedup: 13.12->[14.13-19.15]
I20260709 12:11:40.147441 21926 pending_rounds.cc:85] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 12
I20260709 12:11:40.147734 21926 pending_rounds.cc:107] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:11:40.148015 21926 raft_consensus.cc:2889] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:40.148370 21926 pending_rounds.cc:107] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:11:40.148640 21926 raft_consensus.cc:2889] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:40.149816 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:40.150712 21925 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:40.145118 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:40.124225 26368 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.126232 26857 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:40.067189 26799 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.167977 21892 leader_election.cc:400] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:40.172987 26456 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:40.173456 26456 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:40.174369 26456 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.154976 26688 raft_consensus.cc:1081] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:11:40.178699 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:40.180999 21892 leader_election.cc:400] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:40.181948 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:40.182554 26818 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.183323 26892 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.183785 26818 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.122756 26937 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.126020 26779 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:40.184796 21919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60634 (request call id 2399) took 1294 ms (client timeout 1516 ms). Trace:
W20260709 12:11:40.185252 21919 rpcz_store.cc:269] 0709 12:11:38.881866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.911554 (+ 29688us) service_pool.cc:224] Handling call
0709 12:11:40.176186 (+1264632us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54003610d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:40.176295 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623696768}
I20260709 12:11:40.156167 26368 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.175470 26952 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.157785 26749 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:40.185065 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:40.157538 26923 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:40.155059 26825 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:11:40.125403 26752 consensus_queue.cc:237] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.163502 26857 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.229928 26949 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.237510 26857 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.237579 26949 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:40.237907 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 2070) took 1413 ms. Trace:
I20260709 12:11:40.238090 26949 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.233526 26923 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.238588 21848 rpcz_store.cc:276] 0709 12:11:38.824939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.899347 (+ 74408us) service_pool.cc:224] Handling call
0709 12:11:38.941762 (+ 42415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.969384 (+ 27622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.969420 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.015318 (+ 45898us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.200116 (+184798us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:39.200388 (+   272us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.254025 (+ 53637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.254099 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.103948 (+849849us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:40.192410 (+ 88462us) raft_consensus.cc:1685] finished
0709 12:11:40.237581 (+ 45171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.237784 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19268,"prepare.queue_time_us":38284,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":78209,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":24082,"spinlock_wait_cycles":62058240,"thread_start_us":140263,"threads_started":1,"wal-append.queue_time_us":328580}
I20260709 12:11:40.100281 26920 consensus_queue.cc:237] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:40.243395 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 58388.9us
I20260709 12:11:40.244091 21849 raft_consensus.cc:2368] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:11:40.245814 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:40.246217 21892 leader_election.cc:400] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:40.246554 21892 leader_election.cc:403] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:40.149621 26468 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:40.250756 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:40.252126 22581 raft_consensus.cc:2393] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 10: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:40.252746 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:40.191846 26749 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:40.255581 26937 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.269220 26749 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.270869 26950 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10.
I20260709 12:11:40.271275 26946 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.248526 26817 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.279726 21892 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:40.251276 26655 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:11:40.314376 26910 consensus_meta.cc:287] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 12:11:40.285241 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:40.315779 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 187084us
W20260709 12:11:40.287380 26944 log.cc:927] Time spent T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:11:40.287179 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.292119 26779 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:40.293218 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:40.293731 26732 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
W20260709 12:11:40.299515 26879 consensus_meta.cc:287] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 12:11:40.300459 26857 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.302865 26946 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.303539 26937 raft_consensus.cc:2804] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.309753 21925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60628
I20260709 12:11:40.310315 26949 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.310792 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:40.347991 21923 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.312899 26831 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.315049 26910 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13.
I20260709 12:11:40.323990 22577 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.326141 22578 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:40.346529 21925 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:40.353389 21925 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.336329 26817 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:40.336599 26892 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:40.366122 21923 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:40.370694 21918 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:40.376190 22577 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:40.377453 21919 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:40.338234 26936 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:40.382923 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.378446 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:40.346259 26674 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:40.359920 26937 raft_consensus.cc:697] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:40.346612 26879 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.419504 26951 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:40.422528 22575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58892 (request call id 1013) took 1717 ms. Trace:
I20260709 12:11:40.428333 22575 rpcz_store.cc:276] 0709 12:11:38.705116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.705279 (+   163us) service_pool.cc:224] Handling call
0709 12:11:38.764614 (+ 59335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:38.788997 (+ 24383us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:40.052822 (+1263825us) spinlock_profiling.cc:243] Waited 996 us on lock 0x7b18003dec40. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cab455 00007f3be87933c7 00007f3be4da59a7 00007f3be4db50bf 00007f3be4db5038
0709 12:11:40.126759 (+ 73937us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.327596 (+200837us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.327700 (+   104us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:40.345470 (+ 17770us) log.cc:844] Serialized 52 byte log entry
0709 12:11:40.345644 (+   174us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:40.345846 (+   202us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.346015 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.346159 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.422266 (+ 76107us) raft_consensus.cc:1685] finished
0709 12:11:40.422289 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.422462 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22634,"prepare.queue_time_us":325948,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":111,"raft.queue_time_us":39069,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":16799,"spinlock_wait_cycles":15948800,"thread_start_us":239714,"threads_started":2,"wal-append.queue_time_us":229963}
I20260709 12:11:40.424451 26857 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.419334 26947 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:40.449370 26947 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.451581 26947 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.388875 26892 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.453624 26766 raft_consensus.cc:993] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:11:40.453825 26892 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.454130 26766 raft_consensus.cc:1081] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:11:40.456064 26870 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:40.457887 26886 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 1.039s	user 0.005s	sys 0.004s
I20260709 12:11:40.380183 26817 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.460585 26817 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.431416 26937 consensus_queue.cc:237] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.462347 26862 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:40.462918 26862 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:40.471288 21998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1954) took 1190 ms. Trace:
I20260709 12:11:40.471721 21998 rpcz_store.cc:276] 0709 12:11:39.281076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.306880 (+ 25804us) service_pool.cc:224] Handling call
0709 12:11:39.442704 (+135824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.450661 (+  7957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.450695 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.451129 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.645003 (+193874us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:39.662989 (+ 17986us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.666403 (+  3414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.666665 (+   262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.102207 (+435542us) raft_consensus.cc:1685] finished
0709 12:11:40.102227 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.471064 (+368837us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003f3250. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:40.471187 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16492,"prepare.queue_time_us":17052,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":11538,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":11441,"spinlock_wait_cycles":261619328,"thread_start_us":186805,"threads_started":1,"wal-append.queue_time_us":293596}
I20260709 12:11:40.433708 26879 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:40.413323 26936 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.476621 26936 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.440338 26951 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.418617 26779 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:40.477703 26779 raft_consensus.cc:697] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:40.478453 26662 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.478814 26951 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.478973 26779 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.447082 26831 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:40.448719 26949 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:40.458151 26870 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:40.426656 21925 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.504384 21925 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.532714 22001 raft_consensus.cc:3055] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:40.533167 22001 raft_consensus.cc:740] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:40.533897 22001 consensus_queue.cc:260] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.534499 26749 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.535061 22001 raft_consensus.cc:3060] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.539355 26578 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.522759 26782 raft_consensus.cc:3055] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.542770 26782 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:40.543615 26782 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.545133 26782 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.546387 21924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d28906331f4545a29562f950eacb999e"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60628
I20260709 12:11:40.546989 21924 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:40.547313 21924 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.549353 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:40.550082 22577 raft_consensus.cc:2393] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 10: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:40.550802 26857 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:40.551316 26857 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.552614 22576 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:11:40.553351 26857 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.553750 21924 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.554495 22549 leader_election.cc:400] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:11:40.554913 21995 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
I20260709 12:11:40.562783 22549 leader_election.cc:403] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:40.496438 26368 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.564211 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:40.564813 21843 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.567042 21924 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:40.567422 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.569136 21849 raft_consensus.cc:1275] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:40.551467 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:40.558719 21922 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:40.571096 21851 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:40.571638 26368 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:40.573872 21843 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:40.575620 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:40.577370 22001 raft_consensus.cc:2468] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:40.579241 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:40.580040 22578 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.583541 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.587245 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:40.588080 21924 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.425896 26674 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.582044 26857 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 10. Current term is 11.
I20260709 12:11:40.578321 26921 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.581929 26892 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:11:40.583681 26799 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:40.616509 21924 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
W20260709 12:11:40.617547 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.618266 21815 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:40.591287 26749 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:11:40.620929 26368 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:40.636669 26368 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:40.660395 26862 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.673658 21924 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:40.678402 22578 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
W20260709 12:11:40.670811 26965 log.cc:927] Time spent T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:40.691063 21849 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:40.682181 26862 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.692744 26368 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.686012 26834 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:11:40.698035 26892 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 12:11:40.715178 26964 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.273s	user 0.003s	sys 0.000s
I20260709 12:11:40.701097 26825 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:40.721670 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 473173us
I20260709 12:11:40.719633 26938 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:40.719718 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 574640us
W20260709 12:11:40.715883 26961 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.301s	user 0.000s	sys 0.003s
I20260709 12:11:40.738893 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:40.724464 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 401376us
W20260709 12:11:40.729561 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 350445us
I20260709 12:11:40.740161 21966 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:40.740553 21918 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:40.741832 21927 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:40.720342 26365 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:40.734700 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.735594 21964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.66:34757 timed out after 1.516s (SENT) [suppressed 46 similar messages]
I20260709 12:11:40.737876 21922 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:40.739086 21925 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:40.728348 26456 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.754365 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.779418 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:40.779954 21849 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:40.742249 26762 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.757038 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:40.723995 26825 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:40.758747 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:40.781415 22581 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:40.780227 21849 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:40.759229 26879 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:40.753587 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.759351 26799 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:40.761101 26921 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:40.762110 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:40.764312 26938 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:40.753697 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:40.808104 21921 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.808244 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:40.767247 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.808974 21893 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:40.768563 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:40.809840 21852 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:40.810164 21852 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:40.769977 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:40.771137 22580 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:40.771976 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:40.811976 21847 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.772776 22578 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:40.773168 26674 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:40.791945 26879 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.821666 21992 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:40.823971 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:40.824533 21995 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:40.772991 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:40.789826 26920 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:40.790536 26903 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:40.781572 26900 consensus_queue.cc:1048] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 12:11:40.793452 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 57887.3us
I20260709 12:11:40.796831 22575 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.797245 22581 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:40.765465 26468 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:40.827605 21925 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 12:11:40.829703 21846 raft_consensus.cc:1240] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:40.782191 26834 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:40.816257 26365 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:40.875490 21998 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:40.870268 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:40.877158 21918 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.877626 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:40.877883 21847 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
W20260709 12:11:40.853394 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 80459.5us
I20260709 12:11:40.869736 26674 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:40.882961 26674 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:40.883421 26674 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.874998 26874 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.887441 26874 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.891407 21995 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:40.897672 21921 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
W20260709 12:11:40.828245 26970 log.cc:927] Time spent T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:11:40.889726 26874 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:40.830173 26827 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.800767 26857 consensus_queue.cc:1059] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:11:40.899446 22547 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:40.920150 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.822856 26578 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.828626 26782 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:40.925622 21925 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:40.928884 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:40.940784 21919 raft_consensus.cc:2376] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10. Re-sending same reply.
I20260709 12:11:40.939169 21918 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
W20260709 12:11:40.944427 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 72530.2us
I20260709 12:11:40.945672 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:40.946825 21992 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:40.947135 21851 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:11:40.947945 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:40.948107 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:40.949031 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:40.949460 21993 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:40.954067 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 76571.6us
I20260709 12:11:40.906244 26779 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:40.921718 26903 consensus_queue.cc:1243] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:40.959761 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:40.962853 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:40.966322 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:40.966362 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:40.966982 21998 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.967397 21996 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 16.
I20260709 12:11:40.828868 26368 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 12:11:40.969614 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:40.856562 26920 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.972826 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:40.909461 26938 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.854542 26756 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 12:11:40.984007 21964 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:40.938639 26827 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:40.891026 26834 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.954939 26772 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.994949 26772 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:40.997205 26772 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:40.999758 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:41.000093 26920 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.000475 22581 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:40.953910 26740 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:41.002059 21967 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:40.991837 26827 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.002898 26825 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.003939 26900 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.004576 26900 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:40.994359 26834 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:41.013319 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.016912 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:40.987257 22575 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
W20260709 12:11:40.990900 26972 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:11:41.065121 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:41.065721 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 166386us
I20260709 12:11:40.958431 26782 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:41.054137 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 52153.3us
I20260709 12:11:41.075282 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:41.076040 21996 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.018989 26749 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.082744 22000 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14. Ops: [11.10-13.12]
I20260709 12:11:41.084591 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.085183 22000 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:41.086476 22000 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:41.087529 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:41.088948 26722 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:41.095623 26879 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:41.095744 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:41.096961 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:41.100596 26744 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:41.082775 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.105209 21998 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:41.115836 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:41.105726 21996 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:41.118394 21925 raft_consensus.cc:1275] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:41.048466 26850 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:41.110240 21992 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:41.066617 26939 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:41.120774 26722 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.121423 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.250469 21999 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:11:41.123050 26744 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.124795 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:41.252818 21843 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
I20260709 12:11:41.108913 21993 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:41.137496 26939 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.124962 26879 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:41.068161 26978 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:11:41.075678 26979 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:11:41.134624 26825 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:41.005441 26365 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.115402 26749 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.015921 26504 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 12:11:41.159056 26900 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.254057 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:41.273459 21843 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:41.247852 26862 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:41.253554 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 118128us
I20260709 12:11:41.281769 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.278054 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:41.285725 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:41.259938 26879 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.248992 26850 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:41.287315 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:41.260533 26939 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:41.319001 21892 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:41.279969 26749 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.288702 26722 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.317986 26879 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:41.324635 26828 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:41.329128 26722 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.329646 26828 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:41.329764 26722 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.330606 26828 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.314292 26779 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:41.332223 26779 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.336249 26674 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.336642 26879 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.338795 26850 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.339469 26879 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:41.340831 26368 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.341080 26782 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:41.341363 26368 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.342306 26978 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.342896 26978 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.343497 26368 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.344004 26368 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.344857 26749 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.344946 26978 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.345420 26749 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.314725 26578 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:41.280689 26862 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.349673 26862 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.313997 26645 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.367609 26749 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:41.350811 26674 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.344401 26368 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.371518 26368 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:41.377241 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 496087us
I20260709 12:11:41.385912 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.390919 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.391860 21998 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:41.377689 26825 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.397496 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:41.379912 26368 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.403185 22001 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:41.406932 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.416191 21992 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
I20260709 12:11:41.407553 26825 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:41.421303 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 102373us
I20260709 12:11:41.421885 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:41.422773 21844 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:41.431228 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:41.432787 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:41.435268 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.436250 21922 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:41.440593 21926 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:11:41.445827 21926 pending_rounds.cc:85] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 11
I20260709 12:11:41.446102 21926 pending_rounds.cc:107] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:11:41.446375 21926 raft_consensus.cc:2889] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:41.409811 26368 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.452014 26978 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.452178 26981 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.452443 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:41.452661 26978 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.453263 22575 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:41.453083 26981 consensus_queue.cc:1048] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:41.430099 26910 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.454250 26910 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.440333 26989 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.456486 26989 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.458525 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:41.459381 21850 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:41.440578 26979 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:41.463117 26987 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:11:41.463310 26979 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.462978 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:41.465749 21850 raft_consensus.cc:2368] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17.
I20260709 12:11:41.467072 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:41.437111 26879 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:41.468400 21850 raft_consensus.cc:2393] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 16: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:41.468930 26879 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.470567 21850 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:41.482559 26982 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:41.499660 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 66963.3us
I20260709 12:11:41.504343 22549 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:41.508917 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:41.465775 26981 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.548558 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:41.519717 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.550001 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 108484us
I20260709 12:11:41.559528 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:41.560252 21996 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:41.552891 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:41.545017 26456 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.563283 26993 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.563439 26456 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.563836 26993 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.558295 26981 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.565737 26456 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:41.566716 26834 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.551877 26991 raft_consensus.cc:2804] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:41.559352 26982 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:11:41.567277 26834 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.572070 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.573155 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.600574 21845 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 12:11:41.604683 21850 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:41.605747 21845 raft_consensus.cc:1275] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:41.573344 21996 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:41.607127 21850 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:41.566236 26981 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:41.559648 26985 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.468392 26825 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:41.612428 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 63963.8us
I20260709 12:11:41.617436 21817 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:41.615962 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.618454 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.621018 21996 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:41.621611 22549 leader_election.cc:400] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17.
I20260709 12:11:41.622591 22547 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:41.562341 26749 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.623756 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.642168 21996 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:41.642835 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.643100 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:41.604681 26910 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.631619 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.632459 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:41.601900 26834 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:41.601776 26982 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:41.608661 26991 raft_consensus.cc:697] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:41.646507 21926 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:41.700214 26939 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.648296 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:41.714845 21993 raft_consensus.cc:2368] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17.
W20260709 12:11:41.712793 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 80416.8us
I20260709 12:11:41.617493 26985 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.714560 21851 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 9.
W20260709 12:11:41.717530 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 100071us
I20260709 12:11:41.716612 21924 raft_consensus.cc:1275] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:41.620353 26744 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:41.711012 26970 log.cc:927] Time spent T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.715s	user 0.003s	sys 0.000s
I20260709 12:11:41.703537 26779 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:11:41.717661 26995 log.cc:927] Time spent T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:41.749260 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.717162 26456 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:41.713627 26879 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:41.750726 21923 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:41.768509 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:41.769140 21924 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:41.719187 26834 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.751484 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.767522 21925 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 9.
I20260709 12:11:41.731894 26985 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.777311 21851 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:41.646544 26749 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:41.782526 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 160188us
I20260709 12:11:41.783215 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.783598 22547 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:41.778070 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.770073 26456 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.779966 21926 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:41.712534 26939 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:41.789338 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:41.700412 27005 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:11:41.796190 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.799517 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.770912 26732 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:41.771503 27008 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:41.814428 22580 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:41.815136 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.816183 21925 raft_consensus.cc:2393] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:41.791785 26456 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.816897 26982 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:11:41.817673 27006 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:11:41.833258 27020 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.814029 26368 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.834972 27014 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:41.778910 26834 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.844890 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:41.851567 21920 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 10.
I20260709 12:11:41.852209 27020 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:41.852717 27000 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:11:41.853492 27002 log.cc:927] Time spent T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:11:41.854704 26834 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:41.860910 26749 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.861835 21851 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
W20260709 12:11:41.839612 27004 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:41.817886 26732 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.818102 26722 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:41.826377 26991 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:41.874986 21924 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:41.817292 26779 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:41.863694 26368 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.889111 27012 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.891145 21851 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:11:42.036257 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.119735 26732 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:41.896693 26834 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.146255 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 362694us
I20260709 12:11:42.129249 26749 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.126009 27012 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.163049 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 785) took 1388 ms. Trace:
I20260709 12:11:42.186267 21844 rpcz_store.cc:276] 0709 12:11:40.774196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.423736 (+649540us) service_pool.cc:224] Handling call
0709 12:11:41.423995 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.437451 (+ 13456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.437480 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.437905 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.617255 (+179350us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:41.617294 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.617370 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.162762 (+545392us) raft_consensus.cc:1685] finished
0709 12:11:42.162790 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.162973 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13651,"raft.queue_time_us":16539,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":5044,"thread_start_us":179073,"threads_started":1,"wal-append.queue_time_us":284991}
W20260709 12:11:42.197427 27007 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 12:11:42.201006 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:42.183846 27009 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 12:11:42.198661 26722 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.221490 26910 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:42.132298 26368 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.191205 27012 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.200114 27014 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:41.887969 26982 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.152871 26834 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:42.265765 27018 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
I20260709 12:11:42.260429 26996 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:42.192080 26749 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.226364 26779 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.309082 26989 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.311700 26834 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.316298 27020 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.304000 26996 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.319226 26996 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.320360 27034 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.320927 27034 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.323192 27034 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:42.323698 27034 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.324121 27034 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:42.334789 26985 consensus_meta.cc:287] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent flushing consensus metadata: real 0.543s	user 0.000s	sys 0.009s
I20260709 12:11:42.335789 26985 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.340015 26749 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:42.346060 26985 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.377552 26368 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:42.266973 26910 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:42.380617 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 97309.8us
W20260709 12:11:42.383911 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 258849us
I20260709 12:11:42.399523 27012 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.403039 22581 raft_consensus.cc:1240] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15. Ops: [12.8-14.9]
W20260709 12:11:42.404862 26756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.007s	sys 0.015s
W20260709 12:11:42.405373 26756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.007s	sys 0.015s
I20260709 12:11:42.389786 26744 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:42.407846 26744 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.410117 26744 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:42.414191 21993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 831) took 1028 ms. Trace:
I20260709 12:11:42.296548 26981 consensus_queue.cc:1048] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:11:42.288610 27014 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.415730 21993 rpcz_store.cc:276] 0709 12:11:41.385423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.385603 (+   180us) service_pool.cc:224] Handling call
0709 12:11:42.414011 (+1028408us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54002c6d54. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:42.414136 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754288512}
W20260709 12:11:42.428622 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 162354us
I20260709 12:11:42.442121 21926 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:42.443746 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:42.422251 27012 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:42.426513 26744 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:42.446118 21926 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:42.421962 26639 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:11:42.439196 26456 consensus_meta.cc:287] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.005s
I20260709 12:11:42.450912 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:42.451501 21926 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 10.
I20260709 12:11:42.452265 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:42.452755 21926 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.450189 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:42.454627 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:42.446867 27046 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.458669 26639 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.458988 26827 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:42.469839 26827 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.470353 26639 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:42.471966 26827 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:42.461148 26982 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.473062 26982 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.473469 26982 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.474797 27034 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.478091 27014 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:42.458863 27012 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:11:42.479326 26910 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.453868 26744 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.480217 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:42.480938 21847 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:42.481822 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:42.483210 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:42.484208 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:42.485296 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:42.460740 26857 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.481557 26744 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:42.486428 27046 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.462384 27032 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:42.459244 26456 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.487741 26981 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.491974 26857 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.508662 21926 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:42.515223 21923 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:42.508690 27032 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.520556 27032 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.511317 26857 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.511406 26981 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.511493 22547 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:42.536332 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.540186 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.542907 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:42.546634 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:42.542238 26799 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.551097 26799 raft_consensus.cc:697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:42.552034 26799 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.554651 21926 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:42.557478 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.560592 22577 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:42.563406 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:42.564993 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.565685 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.568445 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:42.568832 27046 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:42.570779 26937 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.571008 26456 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:42.571877 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:42.564834 26639 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.567761 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:42.579115 26639 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:42.579766 26639 consensus_queue.cc:1059] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:42.579986 21996 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:42.580541 26981 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:42.562386 26827 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:42.581669 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:42.581574 26827 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.582479 26456 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.582994 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.583148 26456 consensus_queue.cc:1048] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:42.583793 26827 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.588832 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.591908 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.597122 22549 leader_election.cc:400] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17.
I20260709 12:11:42.597631 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:42.597820 22549 leader_election.cc:403] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:42.599516 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.600255 22575 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
W20260709 12:11:42.600986 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 88276.7us
I20260709 12:11:42.601796 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:42.579377 26857 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.602535 27014 raft_consensus.cc:3060] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.611054 27038 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.619263 27038 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:42.620203 27038 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.620790 26982 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.622090 22578 raft_consensus.cc:2368] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11.
I20260709 12:11:42.624624 26982 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:42.602644 26456 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:42.606359 27054 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.605396 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:42.605298 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.610848 22583 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:42.607786 21818 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:42.607640 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.610121 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:42.635926 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:42.609781 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.603677 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:42.603012 26981 consensus_queue.cc:1059] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:11:42.672214 21848 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
W20260709 12:11:42.672578 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 68981.9us
W20260709 12:11:42.677796 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 73653.5us
I20260709 12:11:42.675171 22577 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:42.638621 27054 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.635998 26456 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.685177 27054 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:42.638089 26857 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.682663 26981 consensus_queue.cc:1243] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:42.686262 26456 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.680879 26744 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.689225 26744 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:42.689638 26744 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.703920 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2393) took 1282 ms. Trace:
I20260709 12:11:42.704505 21845 rpcz_store.cc:276] 0709 12:11:41.421436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.606483 (+185047us) service_pool.cc:224] Handling call
0709 12:11:41.606716 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.812324 (+205608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.812354 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:41.812396 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:41.812435 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.703595 (+891160us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400115154. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:42.703675 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.703844 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472393472}
I20260709 12:11:42.671681 22575 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 15.
I20260709 12:11:42.709098 21994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2708) took 1887 ms. Trace:
I20260709 12:11:42.714797 27047 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:42.715406 27047 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.716406 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:42.717310 21926 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:42.719822 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:42.720460 21926 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.723680 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:42.724504 21927 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.709647 21994 rpcz_store.cc:276] 0709 12:11:40.821267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.821380 (+   113us) service_pool.cc:224] Handling call
0709 12:11:40.821616 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:40.821810 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:40.938467 (+116657us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.938879 (+   412us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.708363 (+1769484us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b18003b2b40. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be4951d70 00007f3be4945293 00007f3be493acea 00007f3be493b23a 00007f3be4da5a2a 00007f3be4db50bf 00007f3be4db5038
0709 12:11:42.708630 (+   267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.708709 (+    79us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:42.708778 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.708874 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.709027 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23006,"prepare.queue_time_us":402209,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":6018,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8515,"spinlock_wait_cycles":7359744,"thread_start_us":81768,"threads_started":1}
I20260709 12:11:42.731403 21852 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.732411 21927 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:42.732632 21852 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.733389 27061 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.734947 27061 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.742183 21852 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:42.742909 26946 raft_consensus.cc:3055] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:42.743126 21847 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:42.743386 26946 raft_consensus.cc:740] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:42.745580 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 535458us
I20260709 12:11:42.748095 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.750180 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.750898 21926 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:42.744359 26946 consensus_queue.cc:260] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.752146 26655 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:42.752779 26946 raft_consensus.cc:3060] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.752933 26744 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:42.754781 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 147054us
I20260709 12:11:42.757256 21818 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:42.758143 26993 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.761124 21818 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:42.762732 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:42.766351 21845 raft_consensus.cc:2376] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12. Re-sending same reply.
I20260709 12:11:42.767259 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:42.769124 26879 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:42.771303 26879 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.771365 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.772078 21996 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:42.763739 27014 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17.
I20260709 12:11:42.764634 26766 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.765308 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:42.765795 21852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 2090) took 1979 ms (client timeout 1905 ms). Trace:
I20260709 12:11:42.775691 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:42.781446 21852 rpcz_store.cc:269] 0709 12:11:40.768191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.768308 (+   117us) service_pool.cc:224] Handling call
0709 12:11:42.731060 (+1962752us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b4c001c7fc0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3067a20 00007f3be3078a29 00007f3be303e644 00007f3be3065f2d 00007f3be3065b93 00007f3be4d9618b 00007f3be4d96cb5 00007f3be4d91f30 00007f3be4d937de 00007f3be4d9f27c 00007f3be9d60b17
0709 12:11:42.747339 (+ 16279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15510912}
I20260709 12:11:42.784134 22547 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:42.786260 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.788686 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:42.789745 22575 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:11:42.774081 27061 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:42.795596 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.795750 27034 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.795868 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:42.796299 27034 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.796706 27034 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:42.798403 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 51126.4us
I20260709 12:11:42.799314 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:42.793869 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:42.801723 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 118669us
I20260709 12:11:42.800000 21967 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:42.801015 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:42.810194 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 49140.1us
I20260709 12:11:42.810307 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:42.813616 22582 raft_consensus.cc:2468] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:11:42.800060 26662 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:11:42.813270 26772 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:11:42.805301 26645 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:42.813108 26757 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:11:42.824244 26850 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:42.821969 22547 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:42.810551 26946 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:42.825953 26946 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:42.826365 26946 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.835469 26991 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:42.835940 21966 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:42.836760 26850 raft_consensus.cc:2804] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:42.837452 26772 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:42.836486 26946 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:42.840442 26850 raft_consensus.cc:697] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:42.843212 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2655) took 2018 ms. Trace:
I20260709 12:11:42.843915 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.844110 26645 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.843597 21922 rpcz_store.cc:276] 0709 12:11:40.824792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.824918 (+   126us) service_pool.cc:224] Handling call
0709 12:11:40.825170 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.436849 (+611679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.842959 (+1406110us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001a5254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:42.843137 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404920704}
I20260709 12:11:42.846184 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35522 (request call id 1982) took 1763 ms. Trace:
I20260709 12:11:42.841346 26850 consensus_queue.cc:237] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.846549 21999 rpcz_store.cc:276] 0709 12:11:41.082753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.089546 (+  6793us) service_pool.cc:224] Handling call
0709 12:11:41.131302 (+ 41756us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:41.250903 (+119601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.846023 (+1595120us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b540018f6d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:42.846134 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95272320}
I20260709 12:11:42.850244 26946 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:42.852104 21926 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:42.852849 21927 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:42.853116 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:42.853636 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:42.854272 21924 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:42.821305 27011 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.856573 27011 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.856976 27011 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.858079 27047 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:42.804759 26749 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:42.859071 26744 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:42.819675 26939 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:42.813879 27051 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.859826 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:42.922685 21922 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:42.845469 21921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 750) took 1778 ms. Trace:
I20260709 12:11:42.863328 26954 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:42.868877 26721 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:42.870561 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 48676.8us
I20260709 12:11:42.871030 27005 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.853725 21926 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:42.878746 22577 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:42.884593 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.930138 21994 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
I20260709 12:11:42.885540 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.903846 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:42.930519 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.931061 22584 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:42.912652 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:42.915892 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.918749 21997 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:42.933353 22000 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:42.923636 21921 rpcz_store.cc:276] 0709 12:11:41.066879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.067030 (+   151us) service_pool.cc:224] Handling call
0709 12:11:41.076827 (+  9797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.077271 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.077311 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.105903 (+ 28592us) log.cc:844] Serialized 26 byte log entry
0709 12:11:42.628038 (+1522135us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b1800490600. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b0d1 00007f3be4d56a0f
0709 12:11:42.804237 (+176199us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:42.804289 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.804425 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.845214 (+ 40789us) raft_consensus.cc:1685] finished
0709 12:11:42.845233 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.845417 (+   184us) inbound_call.cc:177] Queueing success response
0709 12:11:42.872377 (+ 26960us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b48000627d8. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be9cc4aa1 00007f3be9cbbb37 00007f3be9cbb9ca 00007f3be9db326f 00007f3be9db2f37 00007f3be9dc755c 00007f3be9dc7508 00007f3be9dc7488 00007f3be9dc7443 00007f3be9dc66ec 00007f3be8cf0a96
Metrics: {"raft.queue_time_us":618,"raft.run_cpu_time_us":24665,"raft.run_wall_time_us":1793536,"spinlock_wait_cycles":32040704,"thread_start_us":176007,"threads_started":1,"wal-append.queue_time_us":1697440}
W20260709 12:11:42.919700 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44749.8us
I20260709 12:11:42.922432 27051 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:42.938993 27051 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.940016 21964 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:42.940723 26848 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:42.941661 26764 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:42.943110 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:42.943488 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.917987 26939 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.937543 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:42.947911 21964 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:42.951122 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:42.951692 21922 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:42.918124 26991 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:11:42.956884 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.936353 26982 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.963311 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:42.967885 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:42.975585 21996 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:42.955101 26744 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.957661 26939 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:42.929288 27054 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:11:42.957950 27047 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:42.957141 27005 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:42.992945 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:43.005944 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.932476 26954 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:42.999653 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:42.986863 26848 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.986032 26850 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.996471 26744 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:43.073107 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:43.086934 27069 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:11:43.088953 27065 log.cc:927] Time spent T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.286s	user 0.003s	sys 0.000s
I20260709 12:11:43.004087 26772 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.003902 26949 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:43.095588 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:43.099747 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:43.006062 27047 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:43.102960 22000 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:42.989717 26982 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.073523 27005 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.068957 26639 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.071022 26848 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:43.098677 26744 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.099550 26946 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:43.136549 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:43.110349 27047 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.114167 27064 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.151831 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:43.116142 26949 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.124675 27011 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.131354 26848 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.140560 27039 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.180303 26978 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.111588 26772 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.134305 26946 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:43.168902 27071 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:11:43.185645 26954 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.186638 26946 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.188123 27011 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.167881 27040 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:43.190850 27040 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:43.191499 26982 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:43.102373 26991 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.191676 27040 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.196094 26772 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.197712 21992 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:43.190163 26949 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.186113 26920 raft_consensus.cc:3055] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.205582 26920 raft_consensus.cc:740] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:43.206609 26920 consensus_queue.cc:260] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.179100 26979 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.146005 26937 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:43.154479 26639 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.208894 26639 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:43.209349 26639 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.193544 26757 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.213104 26757 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:43.213598 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2426) took 1341 ms. Trace:
I20260709 12:11:43.213987 26757 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.214071 21920 rpcz_store.cc:276] 0709 12:11:41.872722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.872935 (+   213us) service_pool.cc:224] Handling call
0709 12:11:41.873279 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.123953 (+250674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.123982 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.124023 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:42.124056 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.213318 (+1089262us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400040454. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:43.213371 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.213529 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576051072}
I20260709 12:11:43.215471 26757 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.173416 27051 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.218935 21999 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.162460 27064 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.220715 27034 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.221845 27064 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:43.222945 27051 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.231043 26939 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.233768 26939 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:43.235807 27010 log.cc:927] Time spent T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 1.039s	user 0.001s	sys 0.002s
I20260709 12:11:43.240531 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 755) took 1629 ms. Trace:
I20260709 12:11:43.240893 21919 rpcz_store.cc:276] 0709 12:11:41.610799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.610922 (+   123us) service_pool.cc:224] Handling call
0709 12:11:41.611230 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.611548 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.611576 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.612020 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.867333 (+255313us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:41.868172 (+   839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.869367 (+  1195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.235233 (+1365866us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:43.240231 (+  4998us) raft_consensus.cc:1685] finished
0709 12:11:43.240258 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.240470 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5496,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":20989,"spinlock_wait_cycles":6086528,"thread_start_us":253576,"threads_started":1,"wal-append.queue_time_us":543873}
I20260709 12:11:43.243892 21851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 793) took 1347 ms. Trace:
I20260709 12:11:43.244401 21851 rpcz_store.cc:276] 0709 12:11:42.133029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.133257 (+   228us) service_pool.cc:224] Handling call
0709 12:11:42.133657 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.738564 (+604907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.738595 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.740888 (+  2293us) log.cc:844] Serialized 26 byte log entry
0709 12:11:42.799111 (+ 58223us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:42.799162 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.243405 (+444243us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540017e8d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:43.243472 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.243538 (+    66us) raft_consensus.cc:1685] finished
0709 12:11:43.243558 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.243821 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":489976,"raft.queue_time_us":448621,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":361178368,"thread_start_us":57819,"threads_started":1,"wal-append.queue_time_us":95567}
I20260709 12:11:43.242079 21925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60634 (request call id 2433) took 1050 ms. Trace:
I20260709 12:11:43.252856 21925 rpcz_store.cc:276] 0709 12:11:42.191608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.191760 (+   152us) service_pool.cc:224] Handling call
0709 12:11:43.241324 (+1049564us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b540013a528. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be9cc4aa1 00007f3be9d3febc 00007f3be9d7508c 00007f3be9d5f93b 00007f3be9d5f3d2 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c
0709 12:11:43.241482 (+   158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.241718 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.241747 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:43.241786 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:43.241818 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.241875 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.242012 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16371072}
I20260709 12:11:43.205299 26744 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.219532 26946 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:43.287128 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 177051us
I20260709 12:11:43.290319 21927 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:43.292258 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:43.293059 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:43.295428 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:43.296718 26827 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:43.297122 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:43.297328 26827 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.273387 26892 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:11:43.312479 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 160725us
I20260709 12:11:43.286657 27034 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:43.315418 21918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46426 (request call id 751) took 2247 ms. Trace:
I20260709 12:11:43.300933 27012 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:43.316820 21997 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:43.318403 27039 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:43.315847 21918 rpcz_store.cc:276] 0709 12:11:41.067509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.067625 (+   116us) service_pool.cc:224] Handling call
0709 12:11:41.070265 (+  2640us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:41.073699 (+  3434us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:41.073744 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:43.238060 (+2164316us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b180021d7e0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c7c2a6 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a
0709 12:11:43.238523 (+   463us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b2c00000e98. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a4372 00007f3be4dd6a01 00007f3be4d9b43a 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2
0709 12:11:43.239206 (+   683us) log.cc:844] Serialized 52 byte log entry
0709 12:11:43.296534 (+ 57328us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:43.296578 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.298635 (+  2057us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.315200 (+ 16565us) raft_consensus.cc:1685] finished
0709 12:11:43.315220 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.315351 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"raft.queue_time_us":1971,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":17907,"spinlock_wait_cycles":15069824,"thread_start_us":56935,"threads_started":1,"wal-append.queue_time_us":55464}
I20260709 12:11:43.323566 21992 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:43.326323 21992 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.332280 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:43.332587 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:43.332991 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:43.333123 22578 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.333557 22575 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:43.332476 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:43.336325 26744 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:43.328418 27039 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.338971 27039 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:43.342001 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.341856 26855 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:43.344307 22575 raft_consensus.cc:2468] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 18.
I20260709 12:11:43.346858 26862 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:43.348031 22578 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:43.348721 27082 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:43.349642 26946 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.350714 27047 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.351099 26639 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.321625 26949 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:11:43.386332 26862 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.327512 26825 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:43.387924 26825 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.388896 26862 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:43.352747 26848 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.326133 27012 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.368661 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:43.369169 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:43.384738 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:43.385694 27039 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:43.392470 21967 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:43.394274 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:43.395232 22575 raft_consensus.cc:2393] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:43.398911 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:43.386173 26639 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.406230 22583 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:43.383473 27008 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:43.408901 22576 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.417886 22577 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.410142 26825 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.420348 27083 raft_consensus.cc:3055] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:43.423614 27083 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:43.425410 26645 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.426640 27012 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.392171 27082 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.413364 27008 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.433620 27008 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:43.434042 27067 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.631s	user 0.004s	sys 0.000s
I20260709 12:11:43.362085 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:43.488713 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 96673.1us
I20260709 12:11:43.491420 21967 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:43.501943 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 198650us
I20260709 12:11:43.507481 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:43.512147 21925 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:43.488713 21927 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.513990 26616 raft_consensus.cc:2804] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:43.514995 26616 raft_consensus.cc:697] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:43.516950 26721 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:43.517690 26721 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:43.517148 26616 consensus_queue.cc:237] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.521595 21893 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:43.523276 26578 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:43.519367 26721 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.524525 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:43.526844 26645 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.530359 27008 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:43.529717 26892 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 12:11:43.572867 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 48628.4us
I20260709 12:11:43.574304 21893 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:43.581528 21893 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:43.582914 26825 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.596016 21927 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:43.577733 27039 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:43.601249 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:43.602983 22581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58908 (request call id 1159) took 1820 ms. Trace:
I20260709 12:11:43.612577 22581 rpcz_store.cc:276] 0709 12:11:41.782768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.783036 (+   268us) service_pool.cc:224] Handling call
0709 12:11:41.783329 (+   293us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:42.403566 (+620237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.602069 (+1198503us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54006a45d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:43.602785 (+   716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424531840}
I20260709 12:11:43.617096 26848 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:43.618538 26850 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.619103 26850 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.632239 27047 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:43.631896 21849 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.633456 21849 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.642721 26937 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.643733 26937 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.600441 27090 consensus_queue.cc:1059] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:43.614202 26827 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.653360 26937 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.655269 22580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55322 (request call id 10) took 1515 ms. Trace:
W20260709 12:11:43.657352 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 76146.9us
I20260709 12:11:43.657769 22580 rpcz_store.cc:276] 0709 12:11:42.139869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.139981 (+   112us) service_pool.cc:224] Handling call
0709 12:11:43.654750 (+1514769us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54006a45d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4da1735 00007f3be4d999fa 00007f3be9d614c9 00007f3be32ddc54 00007f3be32ddbe2 00007f3be32ddb11 00007f3be32dda8c 00007f3be32dcd42 00007f3be30d648c 00007f3be30d58c6
0709 12:11:43.655077 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568475392}
I20260709 12:11:43.666112 21847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 2102) took 1276 ms. Trace:
I20260709 12:11:43.666632 21847 rpcz_store.cc:276] 0709 12:11:42.389159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.489403 (+100244us) service_pool.cc:224] Handling call
0709 12:11:42.742813 (+253410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.743618 (+   805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.663783 (+920165us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540017fcd0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:43.665234 (+  1451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582289152}
I20260709 12:11:43.669448 21925 raft_consensus.cc:1240] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:43.668066 21926 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
W20260709 12:11:43.672713 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 861275us
I20260709 12:11:43.672995 21844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 794) took 1532 ms. Trace:
I20260709 12:11:43.673777 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:43.675148 21818 leader_election.cc:400] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11.
I20260709 12:11:43.673408 21844 rpcz_store.cc:276] 0709 12:11:42.141064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.187975 (+ 46911us) service_pool.cc:224] Handling call
0709 12:11:42.188239 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.188425 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:42.437774 (+249349us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.747041 (+309267us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.794343 (+ 47302us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.186695 (+392352us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b1800357280. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae522 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:11:43.669494 (+482799us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b1800357280. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c28c0a 00007f3beb368219 00007f3be1cb0a40 00007f3be1cab4e4 00007f3be1cab455 00007f3be4d93060 00007f3be4da5716 00007f3be4db6287 00007f3be4db6208
0709 12:11:43.672251 (+  2757us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:43.672395 (+   144us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:43.672508 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.672639 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.672817 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":311830,"prepare.queue_time_us":51262,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":5961,"raft.queue_time_us":305316,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":1363,"spinlock_wait_cycles":7684736,"thread_start_us":276830,"threads_started":2,"wal-append.queue_time_us":61344}
I20260709 12:11:43.675448 21818 leader_election.cc:403] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:43.679546 21737 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1238ec38c933498cadf6153a5554f6e0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:43.682008 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:43.682760 26368 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:43.683897 26749 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.684796 22582 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:43.686547 27090 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:43.670750 21926 pending_rounds.cc:85] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 8
I20260709 12:11:43.690644 26779 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.691453 26779 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.694154 22580 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:43.696856 21967 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:43.698967 26365 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.699554 26365 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:43.687352 26756 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:43.699970 26365 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.694128 26779 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.683248 26368 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.671280 26920 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.710510 26368 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:43.711947 21746 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 2 to 9, term changed from 9 to 12, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to <none>, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:43.714704 21926 pending_rounds.cc:107] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:11:43.718653 21926 raft_consensus.cc:2889] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.700392 26756 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:43.744446 26985 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:11:43.745922 26985 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:43.746425 26985 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:43.759809 21849 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
W20260709 12:11:43.760447 21818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.725185 26756 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.733299 26645 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.764036 21850 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:43.767153 26779 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:43.769413 26986 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:43.770639 26979 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:43.771303 26992 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:43.774194 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:43.774245 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:43.774863 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:43.776824 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:43.769647 27083 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.777211 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:43.787608 21847 raft_consensus.cc:2376] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13. Re-sending same reply.
I20260709 12:11:43.754130 27090 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:11:43.793239 21849 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56594 (request call id 2093) took 3017 ms (client timeout 1843 ms). Trace:
I20260709 12:11:43.796789 21846 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 8.
I20260709 12:11:43.796610 26992 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.797214 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:43.797926 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:43.798130 21847 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:43.798779 21846 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:43.799290 26992 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.799567 26937 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:43.800266 27082 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:43.800884 21848 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:43.747763 26985 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.806969 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:43.789687 26779 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.807548 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:43.799919 21852 raft_consensus.cc:2376] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13. Re-sending same reply.
I20260709 12:11:43.808851 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:43.808709 26986 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.809283 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:43.811060 27105 log.cc:927] Time spent T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:11:43.811233 26986 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:43.806996 27083 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:43.812520 26979 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.807262 27090 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:43.814857 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:43.815347 26979 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.816299 27090 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:43.817339 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:43.755697 26850 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:43.795519 21849 rpcz_store.cc:269] 0709 12:11:40.769740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.779192 (+  9452us) service_pool.cc:224] Handling call
0709 12:11:40.888691 (+109499us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b4c001c7c40. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3067a20 00007f3be3078a29 00007f3be303e644 00007f3be3065f2d 00007f3be3065b93 00007f3be4d9618b 00007f3be4d96cb5 00007f3be4d91f30 00007f3be4d937de 00007f3be4d9f27c 00007f3be9d60b17
0709 12:11:42.774079 (+1885388us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540022a4a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d1906f 00007f3be4d91f60 00007f3be4d937de 00007f3be4d9f27c 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2
0709 12:11:43.630731 (+856652us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b540022a4a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d18520 00007f3be4d91f70 00007f3be4d937de 00007f3be4d9f27c 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2
0709 12:11:43.787558 (+156827us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3592573568}
I20260709 12:11:43.807314 26985 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.855727 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:43.857539 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:43.854285 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:43.860249 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 45449.1us
I20260709 12:11:43.866422 21817 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:43.866778 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:43.867369 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 74130.4us
I20260709 12:11:43.871405 26850 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:43.872033 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 1.0726e+06us
I20260709 12:11:43.882876 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:43.874790 26892 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:43.883857 26892 consensus_queue.cc:1243] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:43.881596 21848 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 16.
I20260709 12:11:43.886981 21845 raft_consensus.cc:1240] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: [15.6-15.6]
I20260709 12:11:43.887336 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:43.888123 21848 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:43.889853 26645 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:43.891924 26456 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.892427 26456 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:43.893548 26456 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.895038 26779 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.895639 26779 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.896045 26779 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.896427 26779 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.899597 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:43.901813 27108 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.900168 26986 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:43.903098 26986 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:43.905478 26986 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:43.900233 26992 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.905488 21815 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:43.903496 22577 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:43.922256 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 2098) took 2363 ms. Trace:
I20260709 12:11:43.922720 26986 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.922775 21850 rpcz_store.cc:276] 0709 12:11:41.558859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.607827 (+ 48968us) service_pool.cc:224] Handling call
0709 12:11:43.763336 (+2155509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.778467 (+ 15131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.921964 (+143497us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54004015d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:43.922177 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4922395520}
I20260709 12:11:43.923882 21964 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:43.924365 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:43.924703 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 61664.1us
I20260709 12:11:43.925750 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:43.926362 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:43.916496 21848 raft_consensus.cc:1240] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 12:11:43.927320 21817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.929008 21851 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:43.929735 26986 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:43.926939 21746 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:43.930678 22580 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:43.956530 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:43.958105 26732 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:43.958259 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 60059.4us
I20260709 12:11:43.958770 26732 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:43.959385 26732 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.944638 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:43.922613 26456 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.982139 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:43.984808 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:43.930591 27055 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.992956 21849 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:43.993606 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:43.994375 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:44.002657 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.010251 27048 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.011026 27048 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:44.013697 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.039270 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 113070us
W20260709 12:11:44.039597 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 44586.3us
I20260709 12:11:44.040596 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:44.041564 21995 raft_consensus.cc:1240] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:44.013216 27048 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:44.043207 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.043558 26979 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:44.042110 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.044932 26979 raft_consensus.cc:3055] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:44.045109 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.045439 26979 raft_consensus.cc:740] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:44.046712 27109 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:44.049808 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:44.041301 27107 consensus_queue.cc:1059] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:44.029909 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.055092 21993 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:44.018918 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:44.028064 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.039619 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.084318 21927 raft_consensus.cc:2468] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:44.086704 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:44.088120 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.089708 21921 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:44.090698 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.095703 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:44.096037 21919 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:44.096374 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:44.102442 26979 consensus_queue.cc:260] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.026785 27055 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.030803 26368 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.015153 26954 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:44.102830 21920 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:44.118846 21817 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:44.119503 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.119164 26365 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.119642 27107 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:44.120564 22584 raft_consensus.cc:2410] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:44.128484 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.144109 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.131561 21923 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:44.119167 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.122123 21992 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:44.094067 27109 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:44.158897 27042 consensus_queue.cc:1059] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:11:44.160130 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:44.168763 21892 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:44.169117 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:44.169519 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.172452 21924 raft_consensus.cc:2393] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 10: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:44.066924 26992 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.185155 21847 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:11:44.194192 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:44.234798 27042 consensus_queue.cc:1243] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:11:44.234972 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 66395.4us
I20260709 12:11:44.233112 26827 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:44.252077 26368 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:44.235736 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 116986us
I20260709 12:11:44.256039 27055 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:44.258798 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.260051 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:44.260353 27113 log.cc:927] Time spent T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.304s	user 0.001s	sys 0.005s
I20260709 12:11:44.261188 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.261722 21998 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:44.262833 21925 pending_rounds.cc:85] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 7
I20260709 12:11:44.263183 21925 pending_rounds.cc:107] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:44.263499 21925 raft_consensus.cc:2889] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.264461 26779 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:44.237260 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 44720.3us
I20260709 12:11:44.239302 26879 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.236415 26834 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.243741 26732 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:44.279435 22579 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:11:44.279814 22579 pending_rounds.cc:85] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 10
W20260709 12:11:44.245888 26749 consensus_meta.cc:287] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.004s
I20260709 12:11:44.279959 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.249567 21926 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:44.280593 21851 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:44.280995 26732 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:44.246549 21844 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:44.281318 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.282655 27109 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:44.177685 26920 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:11:44.283280 27109 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.250627 22547 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:44.284598 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 92165.5us
I20260709 12:11:44.285748 27109 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:44.192932 21922 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:44.285874 26979 raft_consensus.cc:3060] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:44.231446 21843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 792) took 2417 ms. Trace:
I20260709 12:11:44.236400 27039 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.280401 26749 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11.
I20260709 12:11:44.197794 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:44.178237 21746 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 11 to 12, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:44.067456 26756 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:44.235536 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.253471 21993 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:11:44.253506 22001 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:44.254261 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.254565 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.253683 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:44.254695 26827 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:44.279034 26879 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.253952 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:44.280009 22579 pending_rounds.cc:107] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:11:44.311023 22579 raft_consensus.cc:2889] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.280540 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.265365 26825 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:11:44.285962 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.281744 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:44.291981 21918 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:44.262194 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.292369 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:44.295481 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 62066.4us
I20260709 12:11:44.249861 27011 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:44.300891 21922 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:44.231348 26954 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:44.302194 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.283281 27023 raft_consensus.cc:3055] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:44.298388 21993 pending_rounds.cc:85] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 11
I20260709 12:11:44.336845 21993 pending_rounds.cc:107] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:11:44.337186 21993 raft_consensus.cc:2889] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.252097 26365 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:44.303009 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.287009 21843 rpcz_store.cc:276] 0709 12:11:41.708743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.868683 (+159940us) service_pool.cc:224] Handling call
0709 12:11:41.869005 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.869270 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:11:42.216994 (+347724us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.316047 (+1099053us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b180044ad60. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1c90e07 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b23a 00007f3be4da5a2a
0709 12:11:44.003606 (+687559us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.085895 (+ 82289us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.111524 (+ 25629us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:44.111904 (+   380us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:11:44.112441 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.113469 (+  1028us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.125688 (+ 12219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238667,"prepare.queue_time_us":815805,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":134,"raft.queue_time_us":203129,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":364,"spinlock_wait_cycles":18318592,"thread_start_us":764074,"threads_started":4,"wal-append.queue_time_us":1233189}
I20260709 12:11:44.338991 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.340195 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.340320 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:44.340965 21850 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.343427 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:44.344866 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.345568 26732 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.346009 26732 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:44.346398 26732 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.347259 21919 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:44.347936 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.348644 21919 raft_consensus.cc:1240] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:44.349327 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:44.339037 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 85443.1us
I20260709 12:11:44.350618 26991 raft_consensus.cc:2804] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.351199 26991 raft_consensus.cc:697] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:44.351976 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:44.352532 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.352255 26991 consensus_queue.cc:237] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.353103 26456 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.354563 27083 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.354974 27083 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:44.355350 27083 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.361963 21924 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:44.334271 21845 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:44.364109 26779 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:44.363852 27083 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:44.365633 27011 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.367614 26954 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:44.369436 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.371083 27083 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:44.371917 26879 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:44.373086 21851 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:44.375989 21846 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:44.376994 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:44.385357 26756 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:44.385797 21844 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.386121 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:44.386500 26827 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:44.387279 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.341686 21923 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.378242 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.390167 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.389653 21846 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:44.394383 21849 raft_consensus.cc:1240] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:44.391798 21847 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:44.401703 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:44.406098 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.406656 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.408202 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:44.409214 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:44.413810 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:44.414734 21998 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 13: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:44.311527 26920 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:11:44.388970 27023 raft_consensus.cc:740] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:44.424419 21997 raft_consensus.cc:1240] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:44.417493 26825 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:11:44.417382 21846 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:44.418867 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:44.412552 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
W20260709 12:11:44.434862 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 80452.5us
I20260709 12:11:44.435214 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:44.436919 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:44.411203 21843 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:44.442823 21845 raft_consensus.cc:1275] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:44.336146 27039 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.457234 22575 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:11:44.464898 26674 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:44.467914 26456 consensus_queue.cc:1059] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:44.469188 26825 raft_consensus.cc:3055] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.469553 26825 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:44.471398 27040 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:44.471832 27040 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:44.472179 27040 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.475603 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.476119 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:44.477618 27039 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:44.478358 26736 consensus_queue.cc:1059] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:44.479483 27085 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:44.480005 27085 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:44.480902 27085 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.481492 27047 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.481922 27047 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:44.482841 27047 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.484423 21846 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:44.485378 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:44.487797 26992 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:44.488266 26992 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.490797 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:44.407904 26879 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:11:44.500088 21847 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:44.501647 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.502756 27083 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:44.505496 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:44.506456 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:44.508137 21818 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:44.461876 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:44.509294 21818 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:44.429965 27048 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:44.513324 21998 raft_consensus.cc:2410] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:44.478389 21966 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.518401 26937 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.518903 26937 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.475494 27023 consensus_queue.cc:260] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.521000 26937 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:44.521541 26749 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.521849 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:44.522547 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.525082 22549 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.526216 26674 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.526571 26920 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.537664 21850 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:44.542681 21843 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:44.544261 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:44.544634 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.551537 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.553335 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:44.557241 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:44.516548 26756 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.541121 27047 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.563022 21847 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:11:44.563759 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 57411.2us
I20260709 12:11:44.564173 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:44.562290 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 83969.4us
I20260709 12:11:44.543953 26736 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.558228 27082 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:44.584443 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59495.3us
I20260709 12:11:44.587180 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.571112 26834 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.513857 26825 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:44.600257 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:44.600791 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 54989.6us
I20260709 12:11:44.601775 21815 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.604136 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:44.579866 27082 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:44.593554 27090 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:44.611459 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 67272.1us
I20260709 12:11:44.569878 27048 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:44.609781 27082 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.640112 26762 consensus_queue.cc:1059] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:44.640717 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.641598 22575 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:44.642001 22575 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:44.642925 22575 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.644060 22575 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:44.659739 27048 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:11:44.665180 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 53250.5us
I20260709 12:11:44.622959 26879 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.662115 26732 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:44.695668 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 55052.7us
I20260709 12:11:44.696557 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:44.698875 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.638545 26825 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.698316 21815 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.714759 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:44.716159 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.717592 26985 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:44.717829 26674 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.718178 26985 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.718902 26985 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.718923 26892 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:11:44.718375 26674 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:44.727676 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.692209 27109 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:44.698307 27042 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.684715 26992 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:44.728554 26674 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.731019 26879 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.733364 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.707116 26365 raft_consensus.cc:3055] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:44.730708 26749 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.749166 26365 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:44.737865 21846 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:44.771198 21845 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:44.777117 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.778896 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49608.5us
I20260709 12:11:44.778605 26365 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:44.780277 27042 consensus_queue.cc:1059] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:44.780378 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.796893 22575 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:11:44.797673 22575 pending_rounds.cc:85] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 12
I20260709 12:11:44.798053 22575 pending_rounds.cc:107] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:11:44.798494 22575 raft_consensus.cc:2889] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.806952 27088 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:44.807559 26992 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:44.792980 27040 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.805806 26985 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.800341 26779 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.796964 27109 consensus_queue.cc:1059] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:11:44.838302 26937 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.839280 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:44.813997 26992 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:11:44.856297 21924 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:44.857184 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.837649 26732 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:44.863102 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:44.908761 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 45778.1us
W20260709 12:11:44.863878 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 243884us
I20260709 12:11:44.909718 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.911257 26368 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.924121 26368 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.926940 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.841719 27109 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:11:44.938786 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:44.843415 26937 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:44.939512 21844 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:44.859102 27042 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:11:44.945874 21815 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:44.948700 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:44.949966 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.935858 26834 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:44.960892 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 375396us
I20260709 12:11:44.956920 27085 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.959437 27109 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:44.999517 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.001948 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:44.962965 26879 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:45.004757 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:45.010754 21999 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:45.011482 26743 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.013018 26743 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.009749 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 94539.7us
W20260709 12:11:45.017787 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 107608us
I20260709 12:11:45.045257 27147 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 12:11:45.048148 27011 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:45.045699 27135 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:11:45.017103 26827 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:45.049098 27128 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260709 12:11:45.063256 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46674.3us
I20260709 12:11:45.036245 26985 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:45.057178 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:45.064931 21967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.078385 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:45.080564 26749 raft_consensus.cc:3055] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:45.080992 26749 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:45.055389 27147 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:45.087117 21926 raft_consensus.cc:1240] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:45.088990 27129 log.cc:927] Time spent T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:11:45.081887 26749 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.034042 26743 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:45.093566 27138 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:11:45.095631 26749 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:45.126605 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:45.141651 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 64690.8us
I20260709 12:11:45.102480 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:45.141817 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:45.106566 21920 raft_consensus.cc:2410] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:45.128382 27147 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.082582 26732 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:45.131878 27136 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:11:45.093878 27153 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:11:45.133565 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 187789us
I20260709 12:11:45.107695 21817 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:45.141903 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.170677 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.144984 21852 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:45.156179 21843 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
W20260709 12:11:45.172751 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 65161.4us
I20260709 12:11:45.177073 21817 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:45.117698 27145 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:45.174713 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:45.101740 26937 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.169289 26985 consensus_queue.cc:1059] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:11:45.116858 27152 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.104075 26743 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.182719 27142 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:45.112134 27137 log.cc:927] Time spent T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:11:45.184882 27011 consensus_queue.cc:1059] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:45.185511 26992 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.185662 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.181584 26662 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:45.180523 27153 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.237215 27108 raft_consensus.cc:3055] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:45.180088 27147 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.191893 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:45.122319 27088 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:45.104151 27040 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.188989 27109 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:45.234970 21923 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:45.236878 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 51348.6us
I20260709 12:11:45.238365 27048 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:45.248327 27153 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.248958 27023 raft_consensus.cc:3060] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.249341 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.187937 26756 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:45.242928 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.233870 26937 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.175108 26674 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.281291 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:45.283131 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:45.242544 26662 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.264475 27107 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:45.318811 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 69549.8us
I20260709 12:11:45.319335 27153 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.265117 27108 raft_consensus.cc:740] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:45.282240 27047 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:11:45.283758 27088 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.232252 27160 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:11:45.209039 27152 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.286267 27048 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:45.340461 21966 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:45.340992 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:45.336164 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 242061us
I20260709 12:11:45.346663 21850 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:45.349191 22583 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:45.285528 27083 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:11:45.362555 27144 consensus_queue.cc:1048] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:11:45.364126 27154 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:45.379484 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:45.380330 21843 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:45.370164 27082 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.676s	user 0.006s	sys 0.006s
I20260709 12:11:45.346583 26937 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.378014 26456 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.405799 27040 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.411147 27040 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.413848 27040 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.409211 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:45.435292 22000 raft_consensus.cc:2393] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 10: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:45.441340 21918 raft_consensus.cc:1275] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:45.388639 27082 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.444172 27154 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.444713 27154 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.445269 27082 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:45.447141 21994 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:45.450066 26937 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.451009 26674 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:45.391705 27083 consensus_queue.cc:1059] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:11:45.375566 27108 consensus_queue.cc:260] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.452730 26992 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:45.453466 27108 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.453775 26992 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:45.454128 26992 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:45.455283 26992 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.456422 26992 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.458992 21993 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:45.460216 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:45.462311 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:45.463059 26979 consensus_queue.cc:1059] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:45.465051 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:45.465984 26756 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:45.466670 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.467177 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.474004 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.489579 22582 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:45.487768 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.495272 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:45.496124 21996 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:45.487294 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.500177 26662 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.500749 26365 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:45.506753 27147 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.508123 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.508383 27165 raft_consensus.cc:3055] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:45.508831 27165 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:45.509613 27165 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.510874 27165 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.511124 27090 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:45.512036 27090 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:45.512382 27090 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:45.513188 27090 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.533234 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.522358 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35508 (request call id 2727) took 1517 ms. Trace:
I20260709 12:11:45.542912 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.541268 21999 rpcz_store.cc:276] 0709 12:11:44.018572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.029058 (+ 10486us) service_pool.cc:224] Handling call
0709 12:11:44.029369 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:45.011212 (+981843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.522101 (+510889us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54000c4ed4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:45.522278 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061094144}
I20260709 12:11:45.385722 27048 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.549081 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:45.549669 21926 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:45.520805 27133 log.cc:927] Time spent T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.578s	user 0.000s	sys 0.002s
W20260709 12:11:45.563476 21816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.514402 27090 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.567764 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:45.567176 27085 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:45.575183 27156 log.cc:927] Time spent T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.391s	user 0.007s	sys 0.000s
I20260709 12:11:45.567356 26979 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:45.575959 26979 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.576968 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:45.578042 26979 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:45.545766 26850 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:11:45.579627 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:45.580303 27152 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:45.580739 26674 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.581032 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:45.521844 26732 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:45.582055 26732 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.583063 26892 raft_consensus.cc:3055] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:45.583463 26892 raft_consensus.cc:740] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:45.584365 26892 consensus_queue.cc:260] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.585449 26892 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.567415 27160 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:45.581296 26674 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.587004 27160 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.522858 26456 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:45.568825 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:45.516670 26986 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:45.590582 22549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.546057 27142 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:45.595639 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:45.604837 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.607375 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.608129 22578 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
W20260709 12:11:45.608548 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 175796us
I20260709 12:11:45.613601 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.614512 22581 raft_consensus.cc:2410] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:45.618633 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:45.573020 27107 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:45.594027 26456 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.631935 26892 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:45.634466 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:45.634778 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:45.634979 26674 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:45.635142 21992 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:45.638880 27160 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.639142 21919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60628 (request call id 2680) took 1380 ms. Trace:
I20260709 12:11:45.639412 21999 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:45.639587 21919 rpcz_store.cc:276] 0709 12:11:44.258196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.349362 (+ 91166us) service_pool.cc:224] Handling call
0709 12:11:44.349646 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.350008 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.350036 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.391544 (+ 41508us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.790705 (+399161us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:44.790844 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.791132 (+   288us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.520174 (+729042us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:45.638843 (+118669us) raft_consensus.cc:1685] finished
0709 12:11:45.638863 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.639063 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2921,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":14957312,"thread_start_us":352571,"threads_started":1,"wal-append.queue_time_us":446001}
I20260709 12:11:45.641672 27107 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.643241 21996 raft_consensus.cc:1240] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:45.643977 27107 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:45.645677 27083 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:45.646234 27083 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.647223 21921 raft_consensus.cc:1240] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:45.616633 26749 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:45.648686 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:45.648911 26749 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.646811 27088 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.651124 26749 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.652014 27088 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:45.652822 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.594393 26986 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:45.655710 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:45.655539 26986 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.656721 26986 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.658506 27083 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.623217 26991 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:45.658530 21849 raft_consensus.cc:1275] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:11:45.659686 21849 pending_rounds.cc:85] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 13
I20260709 12:11:45.659479 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:45.659972 21849 pending_rounds.cc:107] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:11:45.660250 21849 raft_consensus.cc:2889] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:45.661131 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.661773 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:45.662703 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:45.663363 21996 raft_consensus.cc:1240] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:45.633805 26732 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.670720 26749 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:45.671344 26749 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.672286 26732 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.673990 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:45.674427 21843 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
I20260709 12:11:45.681154 21995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56824 (request call id 853) took 1558 ms. Trace:
I20260709 12:11:45.681552 21995 rpcz_store.cc:276] 0709 12:11:44.122577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.199336 (+ 76759us) service_pool.cc:224] Handling call
0709 12:11:44.249205 (+ 49869us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:44.277754 (+ 28549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.277799 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:44.278404 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 12:11:44.736572 (+458168us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:44.752570 (+ 15998us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.754644 (+  2074us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.754881 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.754981 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.321579 (+566598us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b180038c4a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae522 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:11:45.679504 (+357925us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b2400255698. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1b349c4 00007f3be1b32acb 00007f3be1ceddc9 00007f3be1ceda55 00007f3be1cecfb0 00007f3be4963488 00007f3be4963be8 00007f3be493b398 00007f3be493676a 00007f3be4935bb6
0709 12:11:45.680965 (+  1461us) raft_consensus.cc:1685] finished
0709 12:11:45.680985 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.681100 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28096,"prepare.queue_time_us":18164,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":129,"raft.queue_time_us":30243,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":2839,"spinlock_wait_cycles":109286144,"thread_start_us":457701,"threads_started":1,"wal-append.queue_time_us":542783}
W20260709 12:11:45.684397 27132 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:11:45.685828 26749 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:45.687536 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.705483 21926 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:45.706658 21919 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:45.742120 27088 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.755884 21994 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 9.
W20260709 12:11:45.763085 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 315176us
I20260709 12:11:45.771648 26732 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.772325 26732 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:45.751391 27088 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.788692 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:45.790745 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:45.793372 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.795130 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:45.796397 21926 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:45.797811 21994 raft_consensus.cc:1240] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:45.798003 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:45.801057 21920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60628 (request call id 2687) took 1280 ms. Trace:
I20260709 12:11:45.805158 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:45.801999 21920 rpcz_store.cc:276] 0709 12:11:44.517163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.517319 (+   156us) service_pool.cc:224] Handling call
0709 12:11:45.795092 (+1277773us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540014b754. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:45.797531 (+  2439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342487808}
I20260709 12:11:45.805207 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.807020 21843 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.811475 26368 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.811565 21851 raft_consensus.cc:1240] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:11:45.812067 21893 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:45.816102 26825 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.798810 26992 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.818109 26992 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.823493 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:45.827548 21920 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:45.832804 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:45.839491 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:45.839824 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 214888us
I20260709 12:11:45.843089 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.847260 21843 raft_consensus.cc:2468] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:45.857213 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:45.857935 21851 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:45.859171 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.860224 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:45.864372 21921 raft_consensus.cc:1240] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:45.872031 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.810514 26456 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.809891 27170 consensus_queue.cc:1048] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:11:45.891551 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:45.891439 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49971.5us
I20260709 12:11:45.892864 26368 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.894565 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:45.862874 26756 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.874832 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:45.871512 27108 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:45.865346 26937 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:45.901721 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:45.831928 27160 consensus_queue.cc:1059] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:11:45.872722 26985 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:11:45.920770 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:45.925423 21846 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:45.927591 26992 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:45.945652 21846 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:45.947526 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:45.951016 21846 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:45.961714 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 84562.9us
I20260709 12:11:45.928642 27039 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:45.917382 26937 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:46.000243 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 104776us
I20260709 12:11:45.960901 26992 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:45.972496 27157 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:46.016978 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:46.021729 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:46.022404 22580 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:46.016505 21817 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:46.024015 21817 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:45.997661 26756 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:46.026278 27042 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.026811 26756 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.027344 27107 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.028991 26756 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.034734 27162 raft_consensus.cc:3055] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:46.035334 27162 raft_consensus.cc:740] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:46.036521 27162 consensus_queue.cc:260] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:45.997336 27085 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:11:46.008486 21877 heartbeater.cc:646] Failed to heartbeat to 127.20.56.126:35507 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.56.126:35507 timed out after 15.000s (SENT)
I20260709 12:11:46.043089 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:46.008947 27174 log.cc:927] Time spent T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:11:46.043162 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 44384.8us
I20260709 12:11:46.045600 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:46.047894 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:46.014426 27048 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.049539 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:46.012421 27153 raft_consensus.cc:3055] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:46.038123 27162 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.055583 21817 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:46.017894 27088 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.016350 27040 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:46.014892 27154 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.005962 26991 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 12:11:46.175566 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 120099us
W20260709 12:11:46.195641 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 199882us
I20260709 12:11:46.002632 27039 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.068966 27170 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:46.068565 27153 raft_consensus.cc:740] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:46.038766 27085 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.230654 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:46.216446 21892 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:46.305783 27055 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:46.213804 26674 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:11:46.313035 21921 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.069916 26756 consensus_queue.cc:1059] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.155s
I20260709 12:11:46.195936 27107 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:46.323642 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 93138.1us
I20260709 12:11:46.331343 27108 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:46.332507 27177 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:11:46.223310 27088 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:46.349887 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 139935us
W20260709 12:11:46.342618 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 294116us
I20260709 12:11:46.345768 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:46.354734 21999 raft_consensus.cc:2410] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:46.345989 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:46.357986 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:46.358016 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:46.358713 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:46.361991 22000 raft_consensus.cc:2393] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 12: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:46.365862 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.366788 21850 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:46.335493 26456 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.359932 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:46.314252 27109 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:46.372359 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:46.375900 21996 raft_consensus.cc:2410] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:11:46.358191 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:46.216075 27040 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.389598 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:46.390189 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.353490 27088 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:46.393853 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47922.4us
I20260709 12:11:46.389322 26937 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.397362 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:46.391031 21844 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:46.373395 27186 raft_consensus.cc:2804] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:46.403514 26986 consensus_meta.cc:287] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.007s
W20260709 12:11:46.404145 21892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.56.67:39721 timed out after 1.827s (SENT) [suppressed 11 similar messages]
I20260709 12:11:46.404203 27085 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.404825 27187 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:46.421048 26365 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:46.489781 26365 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.427446 26662 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.439647 27039 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.444375 27184 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.449009 27165 consensus_queue.cc:1048] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:46.459563 27186 raft_consensus.cc:697] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:46.500270 27186 consensus_queue.cc:237] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.464442 27187 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.504536 27187 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.507283 27177 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:46.508014 27177 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.512293 26879 raft_consensus.cc:3055] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:46.512861 26879 raft_consensus.cc:740] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:46.514469 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:46.515688 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:46.515952 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "574068a837ce42d6a654b65aa3b4a614" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:46.392889 27109 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.397500 27088 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.369565 27153 consensus_queue.cc:260] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.485690 27040 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.349563 27055 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.493137 22547 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:46.508096 21893 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:46.527279 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 503407us
I20260709 12:11:46.538456 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:46.537788 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 44746.4us
W20260709 12:11:46.545481 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 344124us
I20260709 12:11:46.513864 26879 consensus_queue.cc:260] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.566159 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:46.568683 21964 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:46.541141 26674 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:46.536249 26991 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:46.547739 27040 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.545915 27187 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.579569 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.579715 27109 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.580622 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:46.580762 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:46.581439 21923 raft_consensus.cc:2393] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:46.581727 26991 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.581348 27055 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.584429 26991 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:46.579718 27202 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.585105 27055 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.585455 27040 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.585985 27040 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.585661 27055 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:46.586277 27176 log.cc:927] Time spent T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.633s	user 0.000s	sys 0.001s
I20260709 12:11:46.587736 21845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 2137) took 1059 ms. Trace:
I20260709 12:11:46.587918 27055 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:46.588130 21845 rpcz_store.cc:276] 0709 12:11:45.528439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.541007 (+ 12568us) service_pool.cc:224] Handling call
0709 12:11:45.568549 (+ 27542us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:45.579510 (+ 10961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.579537 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:45.580164 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 12:11:45.742725 (+162561us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:45.742785 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.742878 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.585659 (+842781us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:46.587439 (+  1780us) raft_consensus.cc:1685] finished
0709 12:11:46.587460 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.587667 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7920,"raft.queue_time_us":9449,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":8533888,"thread_start_us":162168,"threads_started":1,"wal-append.queue_time_us":280998}
I20260709 12:11:46.589319 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:46.589946 21923 raft_consensus.cc:2468] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:46.592015 26892 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.592458 26892 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.592828 26892 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.593046 27187 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.564302 26986 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:46.595286 27187 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.595444 26986 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.596930 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:46.597707 26986 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.597529 21923 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:46.541782 26365 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.573562 26674 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.573468 27082 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.578316 27177 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.606917 26879 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.612463 26674 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.619406 27082 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:46.645394 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:46.654448 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:46.657393 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 251269us
W20260709 12:11:46.658357 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 92293.2us
I20260709 12:11:46.670763 27082 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.676539 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:46.682766 27203 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:46.683748 27203 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.684122 27203 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:46.682578 26674 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.688069 22576 raft_consensus.cc:2368] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16.
I20260709 12:11:46.687536 27040 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.660009 26743 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.689095 21918 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:46.689183 26743 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.691563 26743 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:46.657411 27170 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:46.694010 27170 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:46.697386 21815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.698971 27048 consensus_meta.cc:287] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
I20260709 12:11:46.699726 21746 catalog_manager.cc:5697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.701364 21746 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 10 to 12, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 12 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.706146 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:46.720151 21852 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:46.707408 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:46.724797 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59892.1us
I20260709 12:11:46.723702 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:46.725803 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:46.724604 21925 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:46.715108 21818 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:46.734200 21997 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:46.725586 21918 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 9.
I20260709 12:11:46.730964 21746 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 6 to 9, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 9 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.744062 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:46.747795 21746 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 9 to 12, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 12 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.712538 26756 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:46.706130 27040 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.712877 27108 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:46.707568 27109 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:46.712687 26749 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:46.758145 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:46.730798 26986 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:46.766636 21746 catalog_manager.cc:5697] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 12 to 13, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 13 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.767951 21966 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:46.776226 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:46.758069 26879 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.784082 21746 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 12 to 13, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 13 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.772575 27108 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.788107 27212 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.788420 26732 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.785167 21964 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:46.791191 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 387047us
I20260709 12:11:46.800434 21746 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 11 to 13, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 13 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.789068 27212 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.808755 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:46.781596 26986 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:46.816841 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 48997.6us
I20260709 12:11:46.817996 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:46.767300 26756 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.813295 21746 catalog_manager.cc:5697] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 9 to 11, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 11 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.776408 26749 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.773413 27109 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.847790 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:46.848923 27160 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.849458 27160 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:46.849941 27160 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.850077 27187 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:46.851418 27188 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:46.851784 27188 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:46.791558 26879 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.853124 21746 catalog_manager.cc:5697] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 10 to 13, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 13 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.808933 27090 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:11:46.842393 27152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.005s	sys 0.016s
I20260709 12:11:46.835426 27208 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.855260 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.856415 21845 raft_consensus.cc:3060] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.868078 21746 catalog_manager.cc:5697] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 7 to 9, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 9 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.823127 26365 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.875026 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.859077 21967 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:46.859294 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:46.862864 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:46.800361 27088 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.864337 22549 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:46.867290 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.883361 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.884083 21851 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:46.842160 27142 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.870921 27208 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.858009 26850 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.873596 27219 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.862875 26892 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.870638 27039 consensus_queue.cc:1059] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:11:46.881449 27184 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:46.885252 21848 raft_consensus.cc:2393] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 16: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
W20260709 12:11:46.881793 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 166786us
I20260709 12:11:46.908538 26850 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.840871 26825 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.892028 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.924630 21850 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:46.893450 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.869335 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:46.925578 21843 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:46.840034 27048 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:11:46.879455 27085 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.880807 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:46.917703 21746 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 10 to 12, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 12 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.916468 26365 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:46.922016 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:46.935207 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.935655 21851 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
I20260709 12:11:46.922574 22584 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:46.905443 27042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.011s	sys 0.030s
I20260709 12:11:46.908036 26743 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.931447 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50732.1us
I20260709 12:11:46.888608 27142 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.907590 27208 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.869556 27090 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:46.933001 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 68739.8us
I20260709 12:11:46.852561 27188 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:46.980127 27188 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.981129 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.982528 27208 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:46.983253 21750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58738 (request call id 284) took 24013 ms (client timeout 15000 ms). Trace:
I20260709 12:11:46.986029 27208 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.954491 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:46.988001 27055 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:46.988449 21892 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:46.988515 27055 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:46.989985 26732 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:46.990674 26732 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:46.992076 21997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35522 (request call id 2030) took 1338 ms (client timeout 1586 ms). Trace:
W20260709 12:11:46.992475 21997 rpcz_store.cc:269] 0709 12:11:45.653381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.661540 (+  8159us) service_pool.cc:224] Handling call
0709 12:11:46.991891 (+1330351us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003f4654. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:46.991996 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2400889216}
I20260709 12:11:46.993261 26986 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.994788 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:46.995828 27196 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.997370 27055 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.955298 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:46.956606 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.998880 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:46.999150 21848 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
I20260709 12:11:47.000442 27194 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.000449 21964 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:47.002776 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.003539 21927 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:47.004375 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.005263 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.006089 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.006799 27180 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:47.007306 27180 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.007661 27180 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.013949 27040 raft_consensus.cc:3055] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.957710 21746 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 8 to 14, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:46.937431 27039 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.018775 26986 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:46.931893 27222 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.022827 27222 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.023708 27194 consensus_queue.cc:1059] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.025348 27222 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.958192 27142 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.021960 21746 catalog_manager.cc:5697] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 6 to 8, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 8 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:46.971083 27209 log.cc:927] Time spent T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:11:47.029577 26879 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.973838 27108 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:46.968568 27090 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.966351 27160 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.022388 27039 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.030968 27088 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.978439 27212 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:46.979243 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:46.933799 27217 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.032281 27160 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.976785 27109 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.997393 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:46.954617 26892 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.034607 27186 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.974502 27207 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:11:46.934002 27219 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:47.016505 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:47.022786 26986 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.031046 27039 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.953572 21923 raft_consensus.cc:1240] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.957254 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:47.017361 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:46.973150 26749 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.045112 26850 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:46.936996 27085 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.045589 27219 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.035737 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:47.059049 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:47.059960 21850 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:47.025957 27180 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.021258 27040 raft_consensus.cc:740] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:47.040585 27186 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.072190 27162 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:47.075294 27162 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:47.075677 27162 raft_consensus.cc:3060] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:47.079103 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 220137us
I20260709 12:11:47.053802 27109 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:46.983650 21750 rpcz_store.cc:269] 0709 12:11:22.840080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.840354 (+   274us) service_pool.cc:224] Handling call
0709 12:11:46.843148 (+24002794us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:38.027317 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:38.095523 (+ 68206us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:38.095590 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:11:38.095616 (+    26us) tablet.cc:662] Decoding operations
0709 12:11:38.097655 (+  2039us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:38.097772 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:38.097815 (+    43us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:11:38.356966 (+259151us) tablet.cc:701] Row locks acquired
0709 12:11:38.415373 (+ 58407us) write_op.cc:260] PREPARE: finished
0709 12:11:38.457265 (+ 41892us) write_op.cc:270] Start()
0709 12:11:38.488999 (+ 31734us) write_op.cc:276] Timestamp: P: 1783599098444885 usec, L: 0
0709 12:11:38.491873 (+  2874us) op_driver.cc:348] REPLICATION: starting
0709 12:11:38.688119 (+196246us) log.cc:844] Serialized 6679 byte log entry
0709 12:11:39.246161 (+558042us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b18004a1220. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be1cae522 00007f3be1cb07c1 00007f3be1cb0779 00007f3be1cb0709 00007f3be1cb06d1 00007f3be1caf9cd 0000000000388634 0000000000388479 00007f3be1c9183a
0709 12:11:39.587398 (+341237us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:40.057418 (+470020us) op_driver.cc:464] REPLICATION: finished
0709 12:11:40.427499 (+370081us) write_op.cc:301] APPLY: starting
0709 12:11:40.427620 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:40.615144 (+187524us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:40.618588 (+  3444us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:40.653568 (+ 34980us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:40.653863 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:11:40.653907 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:40.658789 (+  4882us) log.cc:844] Serialized 156 byte log entry
0709 12:11:40.659640 (+   851us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:40.659842 (+   202us) write_op.cc:454] Released schema lock
0709 12:11:40.659908 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:40.670231 (+ 10323us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:40.670261 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32158,"reported_tablets":48,"spinlock_wait_cycles":657664,"child_traces":[["op",{"apply.queue_time_us":335866,"apply.run_cpu_time_us":24272,"apply.run_wall_time_us":238516,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75153,"num_ops":17,"prepare.queue_time_us":180701,"prepare.run_cpu_time_us":26214,"prepare.run_wall_time_us":925733,"raft.queue_time_us":363610,"raft.run_cpu_time_us":20457,"raft.run_wall_time_us":333973,"replication_time_us":1523115,"spinlock_wait_cycles":50786048,"thread_start_us":704083,"threads_started":4,"wal-append.queue_time_us":230167,"wal-append.run_cpu_time_us":118985,"wal-append.run_wall_time_us":2808225}]]}
I20260709 12:11:47.071221 21848 pending_rounds.cc:85] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 9
I20260709 12:11:47.079909 21967 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.080413 21848 pending_rounds.cc:107] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:47.080757 21848 raft_consensus.cc:2889] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:46.962384 26743 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.046854 27144 consensus_queue.cc:1059] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:11:47.079020 27186 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:47.110728 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.083420 26850 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.085904 27185 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:47.082751 27109 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.118645 21967 leader_election.cc:400] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16.
I20260709 12:11:47.134600 21967 leader_election.cc:403] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.142352 21845 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:47.143463 21817 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.145056 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.146175 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:47.146275 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:47.147050 22577 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.148547 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.138914 27088 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:47.152429 27088 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.154234 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.154867 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.155565 21992 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:47.155910 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.156812 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.137576 27109 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.157977 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:47.158929 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.160130 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.161093 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.162261 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.163151 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.163868 22582 raft_consensus.cc:2393] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:47.161798 21996 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:47.165535 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:47.155613 22001 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:47.166548 27108 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.168167 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:47.148912 27048 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.156649 21995 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
W20260709 12:11:47.174675 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 116592us
I20260709 12:11:47.177302 21893 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:47.154878 22581 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:11:47.180102 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.188033 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:47.201128 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:47.202055 21852 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
I20260709 12:11:47.202699 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:47.203805 21851 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:47.205257 21851 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:47.195966 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:47.206687 21849 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.194061 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:47.197250 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 137416us
I20260709 12:11:47.215610 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:47.216368 21996 raft_consensus.cc:2376] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14. Re-sending same reply.
I20260709 12:11:47.139271 26756 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:47.218075 21927 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:47.140966 27185 raft_consensus.cc:697] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:47.172704 27208 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:47.235491 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 58344.8us
I20260709 12:11:47.238826 26986 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:47.126502 27040 consensus_queue.cc:260] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:47.239989 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47624.4us
I20260709 12:11:47.241994 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.246186 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:47.236999 21849 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
I20260709 12:11:47.250762 27048 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16.
I20260709 12:11:47.156554 27203 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.260421 27203 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.287055 21966 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:47.291997 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:47.298341 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 87550us
I20260709 12:11:47.301033 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:47.239274 27208 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.284560 27088 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:47.290277 27219 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:47.287636 27245 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.302177 26986 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.336886 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.339660 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.317446 26756 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.320343 27220 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.321303 27180 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:47.323516 27108 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.340330 21919 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 15.
I20260709 12:11:47.365077 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.366171 21995 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:47.367045 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.368731 22001 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:47.369048 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:47.369211 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 82258.1us
I20260709 12:11:47.371938 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.357005 26743 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:47.374830 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.346861 26986 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.398340 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.400137 22001 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 15.
I20260709 12:11:47.356225 27108 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.363473 27142 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.354282 26756 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.397876 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:47.403884 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 102951us
I20260709 12:11:47.403514 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:47.370038 27244 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:47.422379 26749 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:47.422331 27244 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.422884 22547 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.425359 27244 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:47.406102 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.425879 27152 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:47.415263 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62108.6us
I20260709 12:11:47.414649 21967 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:47.417143 22577 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
I20260709 12:11:47.427703 27152 consensus_queue.cc:1059] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:47.428516 27152 consensus_queue.cc:1243] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer ecd8f47cd089480aa1f77728a400384a log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:47.334890 27185 consensus_queue.cc:237] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.436955 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:47.431129 27233 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.397151 27255 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.436257 27208 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:47.430603 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet d50c36e857cb4e33997aee7e5dd39447 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:32960
W20260709 12:11:47.441848 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 187419us
I20260709 12:11:47.351616 27220 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.448019 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:11:47.449252 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 45865.4us
I20260709 12:11:47.450742 21992 raft_consensus.cc:2368] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11.
I20260709 12:11:47.430817 27109 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.440511 27244 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:47.458453 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:47.454334 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.469111 22577 raft_consensus.cc:3055] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:47.469702 22577 raft_consensus.cc:740] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:47.473450 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:47.475466 22577 consensus_queue.cc:260] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.468114 27247 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.479417 27233 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.474078 27217 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.483868 22577 raft_consensus.cc:3060] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.470970 27244 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.496608 26879 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.457526 27255 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.497280 26879 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.499617 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.500167 27244 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:47.502108 26879 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.503122 27108 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.503687 26756 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.504458 26986 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.505018 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:47.506733 27261 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.507453 27109 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.483731 27039 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.511523 21847 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:47.511991 27040 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.512400 27039 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.514228 27142 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:47.501924 27162 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.476090 27263 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.481142 27233 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:47.519569 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.520366 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.523018 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.523741 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:47.523135 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.525431 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.501770 27220 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:47.525494 21927 raft_consensus.cc:2468] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:47.535935 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:47.528900 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.524547 21921 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:47.498663 27255 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.540933 22577 raft_consensus.cc:1275] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:47.542553 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.542121 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.520891 27233 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.527097 27109 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.545995 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:47.524396 26986 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:47.546744 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.545238 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.530185 27108 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.542738 27220 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.556320 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:47.556914 21852 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.558897 26674 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.560127 26749 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.561154 27108 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.544641 26879 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.566726 27225 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:47.567451 27225 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.551548 27109 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.571846 26986 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.544201 27263 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.573185 27263 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:47.573537 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 203659us
W20260709 12:11:47.575109 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 160556us
I20260709 12:11:47.565559 27162 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.576272 27250 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.547080 27255 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.576812 21967 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:47.577021 27255 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.577809 27250 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:47.578701 27055 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.580818 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:47.580860 26762 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:47.589190 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.589351 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.558514 27244 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:47.598210 26368 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:47.588753 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.595351 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:47.587821 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 133606us
I20260709 12:11:47.598291 21817 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:47.599215 26368 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.596128 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:47.603622 26368 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.578320 27250 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 16 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:47.608147 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:47.610863 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.616291 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:47.618281 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.623298 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:47.624964 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:47.630300 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.609982 26879 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.632925 27182 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.637576 27185 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:47.655515 27185 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:47.638830 27216 log.cc:927] Time spent T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.766s	user 0.004s	sys 0.000s
I20260709 12:11:47.641888 26749 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:11:47.659963 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.662282 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.666219 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:47.666890 21851 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:47.667141 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.669981 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:47.671911 27196 consensus_queue.cc:1048] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:47.673003 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.675408 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.680284 26762 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:47.680860 26762 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:47.683574 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.684582 21996 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:47.644609 27250 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.646658 27224 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:47.647168 27260 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.647742 27108 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.723099 27260 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.723628 27260 raft_consensus.cc:3060] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.724035 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:47.724660 21926 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.647565 27090 consensus_queue.cc:1059] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:47.727576 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.728384 21927 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
W20260709 12:11:47.648574 27186 consensus_meta.cc:287] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.516s	user 0.002s	sys 0.012s
I20260709 12:11:47.649740 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet d50c36e857cb4e33997aee7e5dd39447 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:11:47.723657 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:47.747495 21919 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 15: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:47.746269 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:47.651242 21846 raft_consensus.cc:1240] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:47.687412 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:47.688155 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:47.752807 21843 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.688859 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:47.692140 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.694794 21851 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:47.695422 26368 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.757762 26368 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.758898 21845 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 16: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:47.690589 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
W20260709 12:11:47.759846 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 69334.7us
I20260709 12:11:47.716473 21852 raft_consensus.cc:2468] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:47.768262 21926 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
I20260709 12:11:47.774732 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:47.775450 22000 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.776046 21844 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.776876 27194 consensus_queue.cc:1059] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:47.688519 27220 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.773742 21893 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:47.778753 21736 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 129159us
W20260709 12:11:47.784003 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 238822us
I20260709 12:11:47.785859 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:47.778863 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:47.713246 27082 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.003s	sys 0.008s
W20260709 12:11:47.782069 27083 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.369s	user 0.036s	sys 0.111s
I20260709 12:11:47.787513 22001 raft_consensus.cc:2393] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:47.790721 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:47.730464 27224 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.798724 21892 leader_election.cc:400] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11.
I20260709 12:11:47.802384 21892 leader_election.cc:403] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.798835 21843 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:47.800311 21815 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.801964 21919 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:47.804580 26368 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:47.790225 27082 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.003s	sys 0.012s
I20260709 12:11:47.806591 21815 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.782935 27167 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:47.794589 27083 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.376s	user 0.036s	sys 0.111s
I20260709 12:11:47.815558 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:47.815951 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:47.822324 26368 raft_consensus.cc:2764] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:47.824739 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.825646 26992 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.826109 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.826171 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.827051 26992 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.828845 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.823472 27187 raft_consensus.cc:3060] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.832094 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:47.805904 27224 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:47.780930 27186 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.833920 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:47.803712 27196 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:47.835295 21926 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.836018 27191 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.836333 27259 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.819594 27272 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.837018 27272 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:47.837455 27272 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.838979 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:47.840222 27196 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:47.815060 27167 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.824244 27220 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:47.851908 21926 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 16.
I20260709 12:11:47.846705 22000 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 16.
I20260709 12:11:47.860576 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:47.824909 27255 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:47.862483 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:47.862906 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 64394.5us
I20260709 12:11:47.824925 27090 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.865828 21851 raft_consensus.cc:2376] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14. Re-sending same reply.
I20260709 12:11:47.867110 21817 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:47.841151 27196 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.870983 21892 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:47.875741 21922 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 12: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:47.878175 21844 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:47.878897 22549 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:47.867036 22547 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:47.885845 21892 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:47.864295 27167 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.887669 26368 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:47.890092 26368 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 16 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:47.890965 26368 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.901281 27186 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:47.902513 27217 raft_consensus.cc:2804] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:47.903149 27217 raft_consensus.cc:697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:47.904227 27217 consensus_queue.cc:237] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.875367 26992 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.911250 27152 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:47.914201 27108 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.886576 26825 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.891530 26732 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:47.956029 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.881529 27090 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.924615 26986 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:47.967605 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 74302.2us
I20260709 12:11:47.931284 26732 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:47.892207 27233 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.990561 27281 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:47.991273 27281 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:47.992300 27281 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.995558 27260 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:47.997843 27260 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:47.998735 21994 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
W20260709 12:11:47.999178 27271 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:11:48.005896 21846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56594 (request call id 2142) took 1084 ms. Trace:
I20260709 12:11:48.006328 21846 rpcz_store.cc:276] 0709 12:11:46.921065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.922217 (+  1152us) service_pool.cc:224] Handling call
0709 12:11:47.651064 (+728847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.772042 (+120978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.005697 (+233655us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54004015d0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9a8ad 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:48.005836 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675239808}
I20260709 12:11:47.928972 27108 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:47.972393 26732 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.012562 27280 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:11:48.013490 27280 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:48.013877 27280 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:48.014911 27280 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.016573 27280 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.019915 27108 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.022065 27109 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.029441 26762 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.033623 21995 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
I20260709 12:11:48.033890 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.012784 27153 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.036899 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.042645 27233 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.038462 27109 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.044430 27225 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.044239 27109 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.045018 27090 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:48.037106 27108 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.046352 27109 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:48.051589 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.054534 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:48.055680 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:48.095875 21995 raft_consensus.cc:2393] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 9: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:48.056198 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.098555 21997 raft_consensus.cc:1240] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:48.057237 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.057698 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:48.100554 21920 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.102717 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.119508 21926 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:48.074537 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:48.076278 21966 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:48.051316 21848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39640 (request call id 835) took 1035 ms. Trace:
W20260709 12:11:48.136188 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59992.9us
I20260709 12:11:48.083554 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:48.084537 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:48.081369 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:48.139693 21921 raft_consensus.cc:2393] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 16: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:48.085050 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:48.135993 21848 rpcz_store.cc:276] 0709 12:11:47.015980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.036174 (+ 20194us) service_pool.cc:224] Handling call
0709 12:11:47.058661 (+ 22487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.084724 (+ 26063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.084767 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.085393 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.200506 (+115113us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:47.200540 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.050903 (+850363us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b5400206554. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9be01 00007f3be4d9a83e 00007f3be9d5f419 00007f3be32d6bd4 00007f3be32d6b62 00007f3be32d6a91 00007f3be32d6a0c 00007f3be32d5cc2 00007f3be30d648c 00007f3be30d58c6
0709 12:11:48.050959 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.051008 (+    49us) raft_consensus.cc:1685] finished
0709 12:11:48.051020 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.051250 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13608320,"thread_start_us":68649,"threads_started":1,"wal-append.queue_time_us":105670}
I20260709 12:11:48.143674 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:48.150120 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.152998 21921 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:48.059896 26365 raft_consensus.cc:3055] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:48.092221 27248 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.653s	user 0.002s	sys 0.000s
I20260709 12:11:48.053661 27085 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:48.085587 27263 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:48.052366 27185 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:48.171411 21927 raft_consensus.cc:1240] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:48.149134 27208 raft_consensus.cc:2804] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:48.146725 27233 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:48.180418 27233 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.157008 27047 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:48.182435 27233 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:48.182811 27047 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:48.183795 27047 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.161458 26762 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.172405 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:48.174481 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:48.188050 21846 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:48.149389 27225 consensus_queue.cc:1059] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:11:48.087369 27272 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.166985 27280 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:48.179320 27187 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 10. Current term is 11.
I20260709 12:11:48.179888 27208 raft_consensus.cc:697] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:48.190238 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.193059 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.195299 27194 raft_consensus.cc:3055] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.156088 26365 raft_consensus.cc:740] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:48.206107 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.216553 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:48.217813 21848 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 8.
I20260709 12:11:48.206568 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.070011 26732 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.163451 27224 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.234308 27224 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.234895 21923 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:48.234889 22001 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:48.236704 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.237221 21817 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.237748 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:48.215387 21995 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:48.226468 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:48.239928 21926 raft_consensus.cc:2393] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:48.218057 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:48.241261 21849 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 12: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:48.241528 21998 raft_consensus.cc:1240] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:48.242030 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:48.219174 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:48.223914 27244 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:48.218353 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:48.216595 27280 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.232401 27272 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:48.239399 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.218353 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:48.247850 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.243844 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:48.208061 27184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.275s	user 0.024s	sys 0.021s
I20260709 12:11:48.248710 21851 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:48.258879 21920 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:48.249639 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:48.222214 21892 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:48.273227 27278 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:48.276041 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:48.277455 21923 raft_consensus.cc:1240] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:48.276197 21850 raft_consensus.cc:2468] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
I20260709 12:11:48.215718 27243 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:48.225911 27194 raft_consensus.cc:740] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:48.280592 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.281260 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.287571 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.289373 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.289700 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:48.291425 27170 consensus_queue.cc:1059] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:48.292023 27280 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:48.292423 27170 raft_consensus.cc:3055] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.292714 21966 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:48.292865 27170 raft_consensus.cc:740] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:48.293300 27203 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.293686 27203 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:48.294132 27263 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.293766 27170 consensus_queue.cc:260] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.294494 27243 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.236167 27208 consensus_queue.cc:237] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.295419 27170 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.296597 27243 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.297624 27194 consensus_queue.cc:260] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.299000 27225 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:48.299404 27225 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.299757 27225 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.301661 21892 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.302321 27284 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:48.303128 27284 consensus_queue.cc:1243] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:11:48.303543 27170 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:48.303606 27263 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.304028 27170 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:48.304430 27263 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.305289 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:48.305157 27170 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.306315 27263 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:48.306695 27263 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.306789 27170 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:48.307065 27263 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.311443 26732 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.279032 27244 raft_consensus.cc:2804] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:48.313279 27244 raft_consensus.cc:697] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:48.314312 27244 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.317014 26365 consensus_queue.cc:260] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.318044 26365 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.319281 27187 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.319720 21892 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:48.322858 26662 raft_consensus.cc:3055] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:48.323311 26662 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:48.323634 27263 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.324150 26662 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.325407 26662 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.327183 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:48.329553 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.330504 21843 raft_consensus.cc:1240] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:48.331525 27082 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.331846 26732 raft_consensus.cc:2804] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:48.247534 27109 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:48.303880 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:11:48.259423 27184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.025s	sys 0.022s
I20260709 12:11:48.336980 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:48.335633 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.354677 21921 raft_consensus.cc:2468] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
W20260709 12:11:48.364442 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 88894.7us
I20260709 12:11:48.332342 26732 raft_consensus.cc:697] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:48.358866 26892 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:48.369038 27263 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.369289 26892 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.369411 26732 consensus_queue.cc:237] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.371502 26892 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:48.262676 27140 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.372071 27194 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.372375 27200 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:48.372192 27140 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.372807 27200 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:48.371269 27235 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:48.374934 21999 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
I20260709 12:11:48.372304 27187 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:11:48.378618 27203 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.379840 27167 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.385115 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:48.386168 21920 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 16: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:48.387774 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.389920 22575 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 16: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:48.391518 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:48.392251 22001 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:48.393069 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
W20260709 12:11:48.397547 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 63655.2us
W20260709 12:11:48.411574 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 121952us
W20260709 12:11:48.412746 21999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 867) took 1272 ms (client timeout 1633 ms). Trace:
W20260709 12:11:48.413367 21999 rpcz_store.cc:269] 0709 12:11:47.140157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.162023 (+ 21866us) service_pool.cc:224] Handling call
0709 12:11:48.412525 (+1250502us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002c6354. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:48.412681 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2787455360}
W20260709 12:11:48.414565 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 132489us
I20260709 12:11:48.415953 21818 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:48.419947 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 48242.6us
I20260709 12:11:48.417496 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:48.422921 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.426033 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.434237 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.394948 27167 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:48.444373 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.445441 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:48.448838 21852 raft_consensus.cc:3060] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.446619 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
W20260709 12:11:48.446799 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 115418us
I20260709 12:11:48.444805 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.457453 21967 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.461272 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:48.462616 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:48.464018 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:48.465170 22579 raft_consensus.cc:2393] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 16: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:48.436547 27272 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.469539 21923 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:48.471246 21893 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.472826 21998 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:48.430202 27219 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:48.487787 21967 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.453202 27260 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:48.453888 26756 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.448217 27268 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:48.508862 26368 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.456660 27261 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:48.520819 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.472404 27272 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:48.518927 21852 raft_consensus.cc:2468] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 16.
I20260709 12:11:48.563726 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:48.526377 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 73895.2us
I20260709 12:11:48.526576 27140 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.628417 21964 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:48.555810 27200 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.524058 27245 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.532521 27263 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:48.576401 27048 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.641477 27048 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.495668 27167 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.141s
I20260709 12:11:48.527220 27090 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:48.644007 27048 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:48.623082 27272 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.522538 26986 consensus_queue.cc:1059] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 12:11:48.499624 27219 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:48.394129 27278 consensus_queue.cc:1175] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73070a828b23480e9c3588e376bce2ab" responder_term: 14 status { last_received { term: 12 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: [13.9-13.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:48.654039 27219 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.658798 27042 raft_consensus.cc:3055] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:48.659258 27042 raft_consensus.cc:740] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:48.660096 27042 consensus_queue.cc:260] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.661235 27042 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:48.669281 27272 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.495857 27224 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:11:48.630786 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 216675us
I20260709 12:11:48.555454 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:48.543699 26920 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.640949 27180 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.649207 21922 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:48.649369 27263 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.670562 27200 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.670989 27109 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:48.709709 21843 raft_consensus.cc:1240] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:48.710522 21964 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.712527 21844 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:48.713150 21964 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.713877 21846 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:48.674638 27225 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.627465 21845 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
W20260709 12:11:48.682904 22548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.703245 21849 raft_consensus.cc:1275] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 12:11:48.703418 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 232296us
I20260709 12:11:48.706489 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:48.706636 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.721985 21848 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:48.705308 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.702828 27180 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.718083 27195 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.724053 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.737030 21922 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:48.737211 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:48.738519 26368 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:48.739037 26368 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:48.715648 27208 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.742528 21996 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:48.743481 21966 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:48.744853 21998 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:11:48.744760 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 247784us
I20260709 12:11:48.747206 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:48.705819 26920 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.730216 27206 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.757244 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.731062 27180 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.763166 21966 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:48.757457 26368 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.775611 22584 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:48.779834 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.781543 21923 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 12: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:48.741696 27256 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:48.756103 27170 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:48.769749 27194 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.788121 21924 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:11:48.794193 27297 log.cc:927] Time spent T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:48.787690 27082 consensus_queue.cc:1059] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:11:48.796032 27294 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:11:48.799104 22550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.770031 27140 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:48.780942 27235 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:48.802568 27153 raft_consensus.cc:3055] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:48.804282 27153 raft_consensus.cc:740] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:48.809319 21996 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:48.785924 27212 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:11:48.811224 27203 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.766059 27152 consensus_queue.cc:1048] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:11:48.819036 27263 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.823696 22577 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:48.770015 21851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:48.828985 21851 raft_consensus.cc:606] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.829624 21851 raft_consensus.cc:614] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:48.834468 21843 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:11:48.835608 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 51960.8us
I20260709 12:11:48.802101 27235 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.835420 27268 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:48.837117 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:48.837750 21847 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.838230 27303 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:48.840548 27090 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:48.841233 26920 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:48.842664 27272 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:48.837253 27235 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.832129 27225 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:48.801322 27140 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.844380 27140 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:48.845607 27180 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.856595 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:48.858355 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:48.854485 27219 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:11:48.866693 21851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:48.867347 21851 raft_consensus.cc:606] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:48.867699 21851 raft_consensus.cc:614] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:48.870714 27180 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:48.876477 21851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:48.880563 21851 raft_consensus.cc:606] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.881227 21851 raft_consensus.cc:614] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:48.875717 27153 consensus_queue.cc:260] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.885039 27153 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.886590 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.887281 21845 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:11:48.892220 21847 raft_consensus.cc:2468] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:48.894296 21818 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.896381 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.890652 22549 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:48.902092 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
W20260709 12:11:48.902284 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 65496.6us
I20260709 12:11:48.902818 21847 raft_consensus.cc:606] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.906857 21847 raft_consensus.cc:614] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:48.903443 27272 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:48.917762 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:48.920679 22579 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:48.919195 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59011.2us
I20260709 12:11:48.905565 27281 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.922466 21966 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:48.922791 21892 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:48.906178 27090 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.928992 21923 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:48.931752 22001 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:48.933037 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:48.935395 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:48.936667 21848 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:48.940699 21847 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:48.940218 27090 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:48.922190 27272 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:48.923808 27281 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:48.942515 26662 consensus_meta.cc:287] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.002s
I20260709 12:11:48.956063 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:48.956809 21847 raft_consensus.cc:606] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.957212 21847 raft_consensus.cc:614] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:48.962805 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:48.963449 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:48.964757 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:48.939450 27307 raft_consensus.cc:2804] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:48.966516 27307 raft_consensus.cc:697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:48.967461 27307 consensus_queue.cc:237] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.971942 27140 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:48.949997 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:48.974835 21927 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:11:48.951880 27272 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.982005 21999 raft_consensus.cc:2368] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17.
I20260709 12:11:48.977042 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:48.983021 21924 raft_consensus.cc:3060] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.977540 21847 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:48.977689 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:48.923148 26732 consensus_queue.cc:1059] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:48.978319 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:48.948560 27088 raft_consensus.cc:2804] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:48.986742 26368 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.980628 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:48.990345 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:48.988442 21992 raft_consensus.cc:1275] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:48.927124 26743 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:11:48.926915 27206 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:11:48.974520 27281 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.035892 27185 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:49.037200 27303 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:11:49.051123 22581 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:49.054050 22579 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:49.065016 21920 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:48.990523 26662 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:11:49.017179 27088 raft_consensus.cc:697] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:48.998168 27301 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:11:49.039173 27244 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.080078 27225 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:11:49.086812 27220 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.087427 27220 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.089526 27090 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:49.090210 27245 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:11:49.084592 21967 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:49.062330 27234 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:49.100844 27235 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:49.127615 27184 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.128257 27184 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:49.107386 27200 raft_consensus.cc:2804] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:49.129592 27200 raft_consensus.cc:697] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:49.130527 27200 consensus_queue.cc:237] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.128613 27235 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:49.132006 27184 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:49.142678 21997 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:49.143837 27088 consensus_queue.cc:237] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:49.145612 27272 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.152705 27272 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:49.098479 27204 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:49.156172 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:49.159518 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:49.160202 21925 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:49.161237 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:49.162487 27220 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:49.163672 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:49.163954 27204 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.162324 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:49.167254 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:49.172814 21924 raft_consensus.cc:2468] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:49.172698 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:49.173807 21922 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 12: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:49.181521 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:49.182587 27204 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:49.183480 22579 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:49.185595 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:49.186664 27184 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.187242 27184 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.187698 27184 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.198091 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:49.198757 21845 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:49.201339 22549 leader_election.cc:400] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17.
I20260709 12:11:49.201890 22549 leader_election.cc:403] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:49.205411 27206 raft_consensus.cc:3060] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:11:49.206710 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:49.207595 21919 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:49.208264 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:49.208443 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:49.210726 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:49.212073 21844 raft_consensus.cc:1275] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:49.223723 21966 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:49.153296 27281 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.226698 21845 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:11:49.214500 27207 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.234123 21966 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:49.260404 22575 raft_consensus.cc:2368] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13.
I20260709 12:11:49.215713 27186 consensus_queue.cc:1048] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:11:49.265679 22001 raft_consensus.cc:1240] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:49.236816 27208 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.237924 27207 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:49.274062 27207 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.280416 27281 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:49.270686 26850 consensus_queue.cc:1048] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:11:49.262128 27048 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.284135 27304 raft_consensus.cc:3055] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:49.284741 27304 raft_consensus.cc:740] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:49.287959 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:49.288763 21845 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.291219 21924 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:49.286255 27304 consensus_queue.cc:260] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:49.292815 27206 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17.
I20260709 12:11:49.293105 27304 raft_consensus.cc:3060] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:49.304656 27272 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:49.305085 21891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.290282 27140 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:49.322580 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49631us
I20260709 12:11:49.324537 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:49.324656 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:49.331164 21919 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.340785 21919 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:49.353508 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:49.354058 21845 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:49.350054 22579 raft_consensus.cc:2468] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
W20260709 12:11:49.361675 21964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.363039 27326 log.cc:927] Time spent T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 12:11:49.367201 27316 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.241s	user 0.004s	sys 0.000s
I20260709 12:11:49.373183 21967 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:49.374198 21817 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:49.375347 27272 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:49.373775 27207 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.376351 27140 raft_consensus.cc:2804] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:49.376885 27140 raft_consensus.cc:697] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:49.377728 27140 consensus_queue.cc:237] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.380815 27272 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.382759 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 111108us
I20260709 12:11:49.383466 22549 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:49.414950 21818 leader_election.cc:400] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13.
I20260709 12:11:49.415377 21818 leader_election.cc:403] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:49.418111 26368 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for earlier term 12. Current term is 13.
I20260709 12:11:49.420305 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:49.421125 21926 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:49.393497 27191 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:49.389330 27272 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:49.437748 21893 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:49.424839 27244 consensus_queue.cc:1059] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:49.446985 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:49.431593 27191 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:49.430102 27202 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:49.447484 27207 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:49.453577 27196 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:49.467809 22581 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:49.477685 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:49.460631 27202 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.472858 27196 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:49.578974 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 76579.7us
I20260709 12:11:49.578962 27220 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:49.589555 27040 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:49.596971 27330 log.cc:927] Time spent T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 12:11:49.598120 27328 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:11:49.604444 22579 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:49.506832 27191 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.504585 27090 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:49.473646 27256 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.662061 21845 raft_consensus.cc:1275] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:49.475510 27184 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:49.708146 21998 raft_consensus.cc:1240] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.663693 27220 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.671945 27234 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:11:49.744336 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:49.704717 27090 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:49.666872 27040 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:49.742322 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:49.752840 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:49.689320 27256 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:49.740978 27185 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.758656 27184 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:49.769848 27261 consensus_queue.cc:1048] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:11:49.804894 27187 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.816075 27272 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:49.832572 27304 consensus_meta.cc:287] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.005s
W20260709 12:11:49.888985 27329 log.cc:927] Time spent T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 12:11:49.899889 27336 log.cc:927] Time spent T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 12:11:49.889760 27342 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 12:11:49.901242 27341 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:49.881151 27345 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:49.906903 27345 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.826180 27245 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.891618 27220 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:49.892089 27256 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:49.874511 27348 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.894755 27202 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:49.896310 27040 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:49.912403 21919 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:49.943183 21919 pending_rounds.cc:85] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: Aborting all ops after (but not including) 5
I20260709 12:11:49.943562 21919 pending_rounds.cc:107] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:49.943907 21919 raft_consensus.cc:2889] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:49.890815 27333 log.cc:927] Time spent T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:11:49.927462 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 125433us
I20260709 12:11:49.936681 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:49.939710 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 112150us
I20260709 12:11:49.946858 21843 raft_consensus.cc:2393] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 11: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:49.770673 27196 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.836264 27187 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:49.805263 27185 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.938202 27292 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.972352 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:49.973255 22577 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:49.950342 27167 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.977576 27167 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.980830 27167 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:49.981791 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:49.982555 21922 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
W20260709 12:11:49.984694 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 227436us
I20260709 12:11:49.989404 22579 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:49.986294 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.005414 26662 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.006105 26662 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.012298 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:50.012986 21852 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:49.911720 27090 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:49.940402 27245 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.052503 27357 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.048656 26662 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.053144 27357 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:49.950686 27348 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.051610 27352 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.054395 27245 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.064422 22583 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:50.064309 27352 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.065708 27348 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:49.984508 27292 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.066781 27352 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.068513 27292 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:50.045658 27225 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.069775 27225 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.072678 27225 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.046452 27187 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.075012 27187 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.079429 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:50.091707 27272 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:50.092386 27272 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.093632 27042 consensus_queue.cc:1059] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:50.059634 27185 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.062677 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:50.097712 21850 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:50.101284 27042 raft_consensus.cc:3055] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:50.101780 27042 raft_consensus.cc:740] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:50.102732 27042 consensus_queue.cc:260] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.103245 27357 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.103969 27042 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.107638 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:50.109923 27180 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.038272 27345 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.021476 27360 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.120921 27360 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:50.130136 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 248528us
I20260709 12:11:50.151849 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.152781 22579 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
W20260709 12:11:50.153688 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46143.4us
W20260709 12:11:50.156026 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 149676us
I20260709 12:11:50.156448 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.157305 22579 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
I20260709 12:11:50.158495 27307 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.163868 27307 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.164312 27307 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.179875 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:50.180594 21922 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:50.185056 21922 raft_consensus.cc:1275] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:50.185981 22001 raft_consensus.cc:1240] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:50.187109 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:50.187503 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.188185 22579 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:50.189495 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:50.190625 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.189545 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.191624 22579 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:50.193264 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.194029 22001 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 11.
W20260709 12:11:50.196087 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 181185us
I20260709 12:11:50.199331 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:50.199673 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:50.199970 21920 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 10.
I20260709 12:11:50.200381 21924 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:50.176909 27250 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.198089 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:50.210191 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.214790 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.211222 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.208477 21923 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:50.215632 22001 raft_consensus.cc:2410] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:50.212848 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.216468 21997 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:50.214073 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:50.206451 22549 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:50.218711 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.219350 21998 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:50.218052 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.219064 21893 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:50.190881 27208 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.254630 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:50.221643 21893 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:50.255869 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.265070 21999 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
W20260709 12:11:50.265118 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 43547.3us
I20260709 12:11:50.256696 21817 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:50.257129 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:50.265486 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:50.266208 21845 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:50.266741 21848 raft_consensus.cc:2410] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:50.258646 21851 raft_consensus.cc:1275] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:50.261596 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:50.268129 21847 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 11.
I20260709 12:11:50.270435 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.271152 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.272385 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:50.273065 21999 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:11:50.273075 21998 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:50.264268 21846 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
W20260709 12:11:50.276019 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 58974.2us
I20260709 12:11:50.277015 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:50.283102 27360 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.245316 27263 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:50.189365 26850 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:11:50.286288 21892 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:50.286288 21967 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:50.245020 27167 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.279764 27352 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:50.284621 27042 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.218474 27250 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.289106 27263 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.356098 27167 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.281709 27208 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.378821 27352 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:50.367336 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 81129.6us
I20260709 12:11:50.443168 27352 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.396718 27167 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:50.435756 27365 log.cc:927] Time spent T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:50.393515 27263 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.459936 27250 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:50.395323 27363 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:50.461428 27363 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:50.461815 27363 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.532174 21997 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 17: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:50.534086 27339 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:50.537062 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 250836us
W20260709 12:11:50.535727 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 258829us
I20260709 12:11:50.441943 27307 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:50.538728 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 210254us
I20260709 12:11:50.532936 27170 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.543934 21966 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:50.547760 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:50.554558 21922 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 13: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
W20260709 12:11:50.565702 27343 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.739s	user 0.001s	sys 0.010s
I20260709 12:11:50.572772 27358 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.577946 27184 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.578547 27368 consensus_queue.cc:1048] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 12:11:50.579453 27364 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.577301 27234 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:50.580335 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:50.540622 27235 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:50.574048 21817 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:50.623274 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 49362.6us
I20260709 12:11:50.540804 27339 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.625376 27339 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.625737 27307 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.625945 27339 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:50.627275 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 48279.2us
I20260709 12:11:50.628296 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:50.629627 27202 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.629998 26662 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:50.630686 27344 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.622339 27235 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.631675 27235 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.632298 26662 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.549749 27170 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.613142 27263 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:50.649032 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 213679us
W20260709 12:11:50.739724 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 82087.4us
I20260709 12:11:50.609635 27358 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:50.744024 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:50.745095 26368 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:50.746963 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:50.612826 27184 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.626320 27339 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.630005 27202 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.745818 26368 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.754905 27292 consensus_queue.cc:1048] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:11:50.741775 27042 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.645154 27208 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.751468 27358 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.767691 27351 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:50.765174 27339 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.634423 27234 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.777277 26368 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.777576 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:50.636289 26662 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:50.779287 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 149114us
I20260709 12:11:50.765452 27202 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.756371 27184 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.801499 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:50.802469 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:50.774014 27167 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.808000 27167 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.808780 27167 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:50.809170 27167 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.809490 27167 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.785162 27363 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.812340 27263 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.812964 27363 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.775274 27042 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.814288 27170 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.786512 27351 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.816644 27351 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.819324 21818 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:50.824985 27042 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.826740 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:50.827077 27272 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.827623 27352 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.827634 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.829700 27352 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.836366 26662 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:50.841996 27366 log.cc:927] Time spent T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.464s	user 0.003s	sys 0.006s
I20260709 12:11:50.843817 27234 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.845845 27339 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.846802 27375 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:50.847205 27304 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.847381 27375 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.847754 27304 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.848524 21845 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:50.849031 27339 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.849255 21846 raft_consensus.cc:2410] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:11:50.849624 27375 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.849783 27304 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.854606 26368 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.855050 26368 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:50.855417 26368 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.858724 21844 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:50.776257 27301 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:50.859444 27301 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.861047 21919 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:50.859453 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.862697 22583 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:50.864236 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.864805 22583 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:50.865394 21818 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:50.869935 21818 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:50.896487 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.897616 22581 raft_consensus.cc:2410] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:11:50.899295 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.899984 22001 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 18.
I20260709 12:11:50.904484 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.906307 22581 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:50.926491 22584 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:50.927166 27301 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:50.927611 27184 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.904721 27272 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:50.929131 27272 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.929497 27272 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:50.931144 27184 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:50.933175 27358 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.125789 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:50.936663 27358 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:50.867092 27368 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:50.938850 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:50.950762 22579 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:11:50.945798 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:50.953838 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:50.954854 22001 raft_consensus.cc:2410] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:50.956156 26368 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:50.903074 27042 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.011654 26368 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.027680 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:51.034622 26368 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:51.035527 26368 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.013207 21967 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:51.039017 21851 raft_consensus.cc:1275] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:51.060314 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:50.970422 27082 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.067905 22001 raft_consensus.cc:2393] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:50.960210 27042 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:51.072213 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:51.073235 22579 raft_consensus.cc:2368] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 14. Current term is 15.
I20260709 12:11:50.956856 27368 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.039175 27219 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
W20260709 12:11:51.077251 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 49713.4us
I20260709 12:11:51.075099 27042 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.085644 21966 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:50.993091 27202 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:50.976426 27364 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.039024 27090 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:11:51.038861 27184 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:11:51.075322 27082 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.101783 26368 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.104890 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.105195 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.083266 27382 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:51.112593 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:51.113550 21846 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.113000 21998 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 13: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:51.091850 27200 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:51.088708 27219 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.101873 27250 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.096487 27180 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:51.115409 27382 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:51.116101 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 933719us
I20260709 12:11:51.117432 27380 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:51.195616 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 402030us
I20260709 12:11:51.184818 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:51.197597 21845 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.199558 21844 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:51.186833 26368 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:11:51.189571 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 421453us
I20260709 12:11:51.200906 26368 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.199885 27382 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:51.203122 26674 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.203650 26674 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.205762 26674 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.206305 27048 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.207098 27048 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.207417 27207 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.207974 27207 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.208469 27225 consensus_queue.cc:1048] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:51.208779 27233 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:51.209311 27233 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.209990 27207 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.212080 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.212700 22577 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:51.214890 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.215519 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:51.217110 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:51.217592 22576 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.218829 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:51.220737 21846 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:51.196132 27384 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.222118 27384 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.223835 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.224495 27384 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:51.225618 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.227092 22580 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:51.229173 22575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.243655 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.125308 27200 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.245776 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.250059 21919 raft_consensus.cc:2410] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:51.186300 27250 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.246991 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:51.248173 26674 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.260710 21926 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 13: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:51.262190 21845 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:51.268095 22576 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 16.
I20260709 12:11:51.271850 22582 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:11:51.209338 27048 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.283285 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.285908 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:51.286579 21995 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.286865 21844 raft_consensus.cc:2410] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:51.292846 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.294561 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.259232 27250 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.301442 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.302174 21926 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:51.301445 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:51.255144 27370 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.305599 21996 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:51.302184 21993 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 17.
I20260709 12:11:51.306625 26368 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.313975 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:51.315716 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
W20260709 12:11:51.302124 27235 consensus_meta.cc:287] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.670s	user 0.021s	sys 0.003s
I20260709 12:11:51.297209 27233 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.320025 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:51.324453 21844 raft_consensus.cc:2368] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:51.318673 21995 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:51.325903 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:51.327474 22001 raft_consensus.cc:2368] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:51.328861 26368 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.331168 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.298897 27377 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:51.298550 27386 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:11:51.331180 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 47216.4us
I20260709 12:11:51.336735 21926 raft_consensus.cc:3060] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.214567 27380 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.340329 21993 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:51.343415 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.337044 26368 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.345016 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:51.282248 26674 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.347983 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.350780 21844 raft_consensus.cc:2393] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:51.352236 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.353674 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:51.353956 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.354465 21919 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:51.355198 22576 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:51.361717 21892 leader_election.cc:400] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:51.362159 21892 leader_election.cc:403] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:51.365178 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.334815 27303 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.323954 27272 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.375401 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.376392 27380 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.335208 27385 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:51.345412 27377 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.316874 27370 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.374678 21926 raft_consensus.cc:2468] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 12.
I20260709 12:11:51.387967 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:51.390978 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.310492 27167 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:51.375687 27392 log.cc:927] Time spent T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:51.379240 26674 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.395789 21851 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 19: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:51.399047 27377 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.403072 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.407757 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.351488 27042 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.411635 21846 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 17.
I20260709 12:11:51.412680 27042 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.414264 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.415222 21848 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
I20260709 12:11:51.417098 22001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:51.418259 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:51.420046 21997 raft_consensus.cc:2393] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 17: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:51.334474 27235 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.411777 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:51.427881 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.430991 22576 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:11:51.436105 22577 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 16: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:51.465276 26368 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.467128 26368 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.388958 27263 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093) with higher term. Message: Invalid argument: T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:51.349524 27386 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.467793 26368 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.411217 27272 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.472416 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:51.377707 27348 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 12:11:51.482158 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.483247 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.486011 21999 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 16: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:51.486459 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:51.492164 21919 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.384269 27303 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.464051 27390 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.498828 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.499944 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.499071 22576 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 19.
I20260709 12:11:51.519757 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.520602 21998 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:51.530459 27386 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.541889 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:51.542549 21847 raft_consensus.cc:606] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.542871 21847 raft_consensus.cc:614] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:51.543853 21919 raft_consensus.cc:2468] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:51.553504 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.554333 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.555878 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.419920 27385 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.557381 21926 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:51.565423 21966 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:51.570214 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.567296 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:11:51.513018 27390 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.578639 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.579653 21892 leader_election.cc:400] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 11. Current term is 12.
I20260709 12:11:51.577777 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.581254 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.584673 26368 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.586495 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.589752 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:51.595261 22576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.595778 22547 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:51.597431 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.554421 27370 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.599844 26368 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.579102 27048 raft_consensus.cc:2804] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:51.586444 27390 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.591295 27200 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.605322 21893 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:51.609308 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.613265 21815 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.614212 26368 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.620980 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:51.621587 21847 raft_consensus.cc:606] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:51.621945 21847 raft_consensus.cc:614] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:51.601984 27389 raft_consensus.cc:2804] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:51.591029 27377 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:11:51.613286 27042 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.622927 27307 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.629649 27048 raft_consensus.cc:697] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:51.649748 27382 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:51.639438 27397 log.cc:927] Time spent T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:11:51.655100 22001 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 19: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:51.636322 27389 raft_consensus.cc:697] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:51.644706 27167 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.673478 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3732a691799e4f2abfe58158cddce045"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:51.674302 21847 raft_consensus.cc:606] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.662719 27235 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:11:51.677850 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 74784.8us
W20260709 12:11:51.689216 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 83978.6us
W20260709 12:11:51.692408 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 95063.5us
I20260709 12:11:51.692922 21964 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.690936 21893 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:11:51.690752 27399 log.cc:927] Time spent T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:11:51.698352 21893 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:51.701531 21851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77a9143d931e458e9c5824195395a69b"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:51.703439 21851 raft_consensus.cc:606] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:51.703755 21851 raft_consensus.cc:614] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:51.695379 27196 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:51.716341 27354 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.716998 27354 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.689775 27090 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:11:51.719034 27090 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:51.719239 27354 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.719456 27090 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:51.720283 27090 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.721392 27090 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.722325 27385 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.724361 27042 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:51.724888 27042 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.726356 27390 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.727089 27042 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.729300 21851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d28906331f4545a29562f950eacb999e"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:51.729938 21851 raft_consensus.cc:606] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:51.730841 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:51.731338 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.731629 21847 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.730261 21851 raft_consensus.cc:614] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:51.734380 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:51.737618 22578 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:51.738674 26674 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:51.738106 27390 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.683959 27048 consensus_queue.cc:237] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:51.740114 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 150444us
I20260709 12:11:51.741016 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:51.742878 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 137741us
I20260709 12:11:51.744902 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.745134 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.745416 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.746182 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:51.746316 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:51.746590 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.746906 21995 raft_consensus.cc:3060] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.748826 22549 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.745528 21998 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:51.750903 21844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:51.751678 21844 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 19: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:51.755816 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.758764 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:51.699229 27387 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.761477 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.760162 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:51.772112 21847 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:51.773351 21995 raft_consensus.cc:2468] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:51.774776 27152 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.780035 27152 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.780342 27234 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.780808 27234 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:11:51.781181 27234 raft_consensus.cc:3060] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.693584 27307 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:11:51.783448 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.760124 27346 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:51.763278 27398 log.cc:927] Time spent T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.126s	user 0.000s	sys 0.002s
I20260709 12:11:51.761268 27385 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:51.791518 22549 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:11:51.767606 27400 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:11:51.767540 27191 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.761014 27377 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:51.706614 27167 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:11:51.793341 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.703097 27389 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.759614 27412 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.768327 27354 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:51.780395 27152 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.794899 27088 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.795085 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.796420 21892 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:51.808327 21923 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 15.
I20260709 12:11:51.807636 21924 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:51.810870 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.811244 27409 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:51.814358 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.815045 21845 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:51.818254 27387 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:51.818612 27390 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.819011 27387 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.821094 27387 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.821609 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.822222 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:11:51.823097 27250 consensus_meta.cc:287] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.004s
I20260709 12:11:51.823523 27250 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.824669 21996 raft_consensus.cc:2368] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14.
I20260709 12:11:51.825217 27307 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:51.825443 21892 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:51.810002 27354 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.826848 27414 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:51.793587 27042 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:51.827661 27042 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.828683 27354 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.809911 27385 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:51.829412 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:51.831588 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.832752 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.829692 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:51.830868 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.810133 27088 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.835801 21924 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 16: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:51.837150 21892 leader_election.cc:400] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14.
I20260709 12:11:51.837502 21892 leader_election.cc:403] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:51.799582 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:51.841349 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.843020 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.843628 21997 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
I20260709 12:11:51.844494 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.845422 27385 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.846447 27202 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:51.847435 27263 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:51.847824 27263 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.848160 27263 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.792001 27090 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:51.808440 27382 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.807678 27408 raft_consensus.cc:2804] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:51.850762 21919 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 16: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:51.852700 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:51.869226 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.852864 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.803675 27368 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:51.860447 27303 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.862861 26674 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.882902 26674 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:51.874867 27090 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.864308 27088 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:51.888237 21893 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:51.888682 27090 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.889654 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.870097 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:51.876888 22547 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.878214 27272 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.878815 27408 raft_consensus.cc:697] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:51.895602 27272 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.896054 27272 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.896245 27408 consensus_queue.cc:237] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.897137 21850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2584) took 1100 ms. Trace:
I20260709 12:11:51.900578 27250 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:51.892683 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:51.889464 27348 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.894520 27395 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.901978 27395 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:51.902523 27395 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.894884 27191 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.882251 27042 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.895153 27303 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.913089 27272 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.913906 21923 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 13: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:51.897513 21850 rpcz_store.cc:276] 0709 12:11:50.796733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.798402 (+  1669us) service_pool.cc:224] Handling call
0709 12:11:50.798692 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.798880 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:51.115142 (+316262us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.896609 (+781467us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b1800336160. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be49434bc 00007f3be1c9148b 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b23a
0709 12:11:51.896813 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.896862 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:51.896913 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.896978 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.897085 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":500556,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1386,"spinlock_wait_cycles":7477120,"thread_start_us":467037,"threads_started":2,"wal-append.queue_time_us":515114}
I20260709 12:11:51.889405 27387 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.915733 27272 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:51.916033 27082 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:51.919428 21849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56610 (request call id 2586) took 1122 ms. Trace:
I20260709 12:11:51.919814 21849 rpcz_store.cc:276] 0709 12:11:50.797207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.804087 (+  6880us) service_pool.cc:224] Handling call
0709 12:11:50.804345 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.805037 (+   692us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:51.192938 (+387901us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.918887 (+725949us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18003b1a60. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3beab76ab1 00007f3beab83281 00007f3be49434bc 00007f3be1c9148b 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be493520b 00007f3be493ad23 00007f3be493b23a
0709 12:11:51.919096 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.919149 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:51.919200 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.919267 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.919375 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55582,"prepare.queue_time_us":510428,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":86,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":3299200,"thread_start_us":421974,"threads_started":2,"wal-append.queue_time_us":418085}
W20260709 12:11:51.927172 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 73427.2us
I20260709 12:11:51.928702 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.931638 27048 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:51.934495 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.934279 27234 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:51.938030 27402 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.292s	user 0.002s	sys 0.000s
I20260709 12:11:51.938867 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:51.939944 27219 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.940193 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.943837 27387 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721) with higher term. Message: Invalid argument: T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 13. Current term is 14.
I20260709 12:11:51.944478 21818 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:51.946918 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:51.948017 21818 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:51.949965 27272 raft_consensus.cc:2764] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:11:51.949261 27339 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.946328 27395 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:51.951659 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 102428us
I20260709 12:11:51.955077 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:51.953442 21818 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:51.961489 27395 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:51.963672 21818 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:51.963840 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:51.970729 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.977164 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:51.978469 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:51.979254 21850 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 13: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:51.979729 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
W20260709 12:11:51.979880 21966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.978529 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:51.981127 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:51.982031 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:51.982374 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:51.982607 21848 raft_consensus.cc:3060] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.945936 27263 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:51.988379 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:51.943074 27152 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.989120 22000 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:51.967729 27272 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:51.997507 27272 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:51.968439 27219 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:52.000442 27219 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 19 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:52.001350 27219 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.005695 27152 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:52.006582 22578 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:51.983489 27339 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:52.007688 27339 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:52.008610 27339 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.011587 21967 leader_election.cc:400] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 14. Current term is 15.
I20260709 12:11:52.011962 21967 leader_election.cc:403] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.012456 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:52.014171 21967 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.015051 27345 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.015444 27345 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:52.015597 27263 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:52.015849 27345 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.012480 27180 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for earlier term 14. Current term is 15.
I20260709 12:11:52.019248 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.023769 21926 raft_consensus.cc:2393] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 16: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:52.027132 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:52.027925 21967 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:52.025291 27345 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.026746 27250 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.034605 21848 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:52.041210 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:52.045389 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:52.046164 22581 raft_consensus.cc:2393] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 16: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:52.029194 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:51.999900 27272 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:52.048614 22582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:52.058849 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:52.059290 21919 raft_consensus.cc:2468] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:11:52.059470 21848 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.987186 27370 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:52.067478 21852 raft_consensus.cc:2468] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
I20260709 12:11:52.070195 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:52.070325 21848 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 16.
I20260709 12:11:52.072659 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:52.073799 27272 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:52.079695 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:52.080286 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:52.080405 21892 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:52.077342 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:52.080838 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:52.078042 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:52.078699 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:52.081975 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:52.037163 27345 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:52.083230 22584 raft_consensus.cc:2393] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 19: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:52.037356 27200 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:52.085242 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 56143.3us
I20260709 12:11:52.084265 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:52.041391 27042 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:52.086041 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.085440 21967 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.087113 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.058493 27395 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:52.088114 27234 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:52.101394 27042 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.104463 27042 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:52.106477 26368 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.054783 26674 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.107069 27272 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:52.107650 27272 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:52.108955 26674 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:52.109795 27272 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:52.086534 26743 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.110888 27384 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.086512 27244 raft_consensus.cc:2804] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.112386 27244 raft_consensus.cc:697] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:52.113252 27244 consensus_queue.cc:237] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:52.088131 27303 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:11:52.114821 27421 log.cc:927] Time spent T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.121s	user 0.003s	sys 0.000s
I20260709 12:11:52.115036 27303 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:52.097131 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56824 (request call id 890) took 1273 ms. Trace:
I20260709 12:11:52.115911 27303 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:52.116559 21999 rpcz_store.cc:276] 0709 12:11:50.824076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.827409 (+  3333us) service_pool.cc:224] Handling call
0709 12:11:52.096918 (+1269509us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54003f3254. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d9f2fa 00007f3be9d60b17 00007f3be32db6d4 00007f3be32db662 00007f3be32db591 00007f3be32db50c 00007f3be32da7c2 00007f3be30d648c 00007f3be30d58c6 00007f3be30d526f
0709 12:11:52.097066 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500063104}
I20260709 12:11:52.117642 27395 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.125648 21967 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.126284 27207 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.127269 27235 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.128345 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:52.134850 21818 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:52.135419 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:52.138602 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:52.143391 27423 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:11:52.145717 27042 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:52.131206 21966 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:52.149313 21967 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.150096 27225 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.149801 21893 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:52.150876 27225 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.151582 21893 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:52.157039 21967 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:52.185479 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:52.186611 21848 raft_consensus.cc:1240] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:52.187057 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:52.188333 21815 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.190891 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:52.201934 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.154126 27040 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.125685 27395 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:52.180934 27418 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.189291 27082 raft_consensus.cc:2804] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:52.208630 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:52.213321 21999 raft_consensus.cc:2393] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:52.209400 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:52.210156 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:52.213538 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:52.214037 21995 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:52.215794 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.202600 27235 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:11:52.202780 27042 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.220531 21993 raft_consensus.cc:1240] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.221124 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:52.218051 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.224236 21817 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:52.225752 21995 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 18.
I20260709 12:11:52.228011 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:52.228448 27082 raft_consensus.cc:697] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:52.229437 26368 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.229378 27082 consensus_queue.cc:237] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:52.231248 27405 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.215636 27395 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.237905 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:52.222589 27219 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.251305 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.252655 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:52.254305 27390 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.254936 27212 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:52.255702 27212 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:52.256891 27212 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.249969 27388 consensus_queue.cc:1059] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:11:52.270308 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:11:52.299381 27430 log.cc:927] Time spent T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.077s	user 0.003s	sys 0.000s
I20260709 12:11:52.300683 27233 consensus_queue.cc:1059] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:52.301193 27219 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:52.301354 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.306915 21926 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:52.307638 27042 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:11:52.324369 27219 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:52.336817 27233 raft_consensus.cc:3055] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:52.337299 27233 raft_consensus.cc:740] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:52.300683 27339 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:52.330132 27427 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.354012 27354 raft_consensus.cc:3055] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.354583 27354 raft_consensus.cc:740] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:52.355214 27395 raft_consensus.cc:993] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:11:52.355715 27395 raft_consensus.cc:1081] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:11:52.340255 27042 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.355516 27354 consensus_queue.cc:260] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.361253 27047 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:52.363917 27225 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:52.365765 27429 log.cc:927] Time spent T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:11:52.367030 27219 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:52.338116 27233 consensus_queue.cc:260] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.368415 21926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3732a691799e4f2abfe58158cddce045"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60628
I20260709 12:11:52.369081 21926 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:52.369408 21926 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.373801 21843 raft_consensus.cc:1275] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:52.374737 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:52.376473 21748 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.382016 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:52.382263 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:52.377657 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:52.368628 27233 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.388130 21817 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.408320 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:52.436909 27082 consensus_queue.cc:1048] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:52.437413 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 49590.3us
I20260709 12:11:52.432288 27292 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.456494 21748 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:52.450838 27354 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.432157 27427 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.461380 21926 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:52.469190 21746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42850 (request call id 209) took 14333 ms (client timeout 15000 ms). Trace:
I20260709 12:11:52.473310 22578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:52.474207 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:52.474861 21843 raft_consensus.cc:3055] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:52.475144 21843 raft_consensus.cc:740] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:52.477866 21926 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:52.465680 27042 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:52.479190 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:52.485759 22583 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.467454 21748 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 12 to 11, leader changed from <none> to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:52.481308 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 63862.1us
I20260709 12:11:52.456259 27196 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:11:52.496904 21818 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:52.498674 21995 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:11:52.499166 21995 pending_rounds.cc:85] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 12
I20260709 12:11:52.499398 21995 pending_rounds.cc:107] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:11:52.499637 21995 raft_consensus.cc:2889] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:52.476958 21843 consensus_queue.cc:260] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.502038 21843 raft_consensus.cc:3060] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:52.469583 21746 rpcz_store.cc:269] 0709 12:11:38.132371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.132536 (+   165us) service_pool.cc:224] Handling call
0709 12:11:52.465719 (+14333183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:47.186651 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:47.187534 (+   883us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:47.187994 (+   460us) write_op.cc:435] Acquired schema lock
0709 12:11:47.188016 (+    22us) tablet.cc:662] Decoding operations
0709 12:11:47.191658 (+  3642us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:47.191751 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:47.191780 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:11:47.193046 (+  1266us) tablet.cc:701] Row locks acquired
0709 12:11:47.193097 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:11:47.193311 (+   214us) write_op.cc:270] Start()
0709 12:11:47.193449 (+   138us) write_op.cc:276] Timestamp: P: 1783599107193240 usec, L: 0
0709 12:11:47.193464 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:11:47.194183 (+   719us) log.cc:844] Serialized 6262 byte log entry
0709 12:11:48.090676 (+896493us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be493686e 00007f3be4935bb6 00007f3be49357d8 00007f3be493f221 00007f3be493f1d9 00007f3be493f169
0709 12:11:48.446150 (+355474us) op_driver.cc:464] REPLICATION: finished
0709 12:11:48.900458 (+454308us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be1c910ac 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1cab93f 00007f3be1cadc02 00007f3be87d1ef0
0709 12:11:48.956548 (+ 56090us) write_op.cc:301] APPLY: starting
0709 12:11:48.956649 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:49.136164 (+179515us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:49.136212 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:49.432301 (+296089us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:49.452691 (+ 20390us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:11:49.459763 (+  7072us) write_op.cc:312] APPLY: finished
0709 12:11:49.622824 (+163061us) log.cc:844] Serialized 148 byte log entry
0709 12:11:49.766015 (+143191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:49.799010 (+ 32995us) write_op.cc:454] Released schema lock
0709 12:11:49.812191 (+ 13181us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:49.893267 (+ 81076us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:49.893299 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3169588,"reported_tablets":31,"spinlock_wait_cycles":1107968,"child_traces":[["op",{"apply.queue_time_us":510019,"apply.run_cpu_time_us":47543,"apply.run_wall_time_us":878057,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70975,"num_ops":16,"prepare.queue_time_us":152323,"prepare.run_cpu_time_us":46238,"prepare.run_wall_time_us":146464,"raft.queue_time_us":177124,"raft.run_cpu_time_us":20763,"raft.run_wall_time_us":552884,"replication_time_us":1218470,"spinlock_wait_cycles":10610176,"thread_start_us":781651,"threads_started":5,"wal-append.queue_time_us":357049,"wal-append.run_cpu_time_us":15027,"wal-append.run_wall_time_us":2917264}]]}
I20260709 12:11:52.503217 27339 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.466951 27292 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:52.516260 27292 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:52.518743 22578 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:52.528882 21845 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:52.531358 21748 catalog_manager.cc:5697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.532998 21748 catalog_manager.cc:5697] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 7 to 9, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 9 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:52.534791 27412 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:52.563022 27412 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:52.563952 27412 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.565487 27412 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.539547 27307 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:52.535765 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:52.570894 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:52.541028 27390 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:52.571776 21850 raft_consensus.cc:2410] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:11:52.570766 27409 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:52.558527 22577 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:11:52.578969 27427 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:52.582546 21845 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:52.584386 27307 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:52.592815 21992 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:52.595726 27409 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:52.616016 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:52.617273 27184 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.625370 22580 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEADER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:52.628502 22000 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:52.628561 27427 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:52.629477 27427 consensus_queue.cc:1243] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:52.632227 27219 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:52.632594 27219 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:52.633489 27219 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.639390 27219 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:52.653093 21843 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:52.563766 21748 catalog_manager.cc:5697] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.678310 21748 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.681221 21748 catalog_manager.cc:5697] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 5 to 9, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 9 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.683213 21892 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:52.653911 27444 log.cc:927] Time spent T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.053s	user 0.000s	sys 0.006s
W20260709 12:11:52.654330 27446 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.056s	user 0.004s	sys 0.002s
W20260709 12:11:52.654726 27445 log.cc:927] Time spent T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:11:52.687784 27233 raft_consensus.cc:2804] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:52.655089 27443 log.cc:927] Time spent T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.073s	user 0.006s	sys 0.000s
I20260709 12:11:52.688367 27233 raft_consensus.cc:697] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
W20260709 12:11:52.655438 27441 log.cc:927] Time spent T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.113s	user 0.007s	sys 0.017s
W20260709 12:11:52.661687 27420 log.cc:927] Time spent T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.126s	user 0.005s	sys 0.008s
I20260709 12:11:52.689327 27233 consensus_queue.cc:237] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.637473 22583 raft_consensus.cc:2468] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:11:52.693524 22000 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:11:52.665287 21918 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:52.694890 27219 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:52.697549 27408 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:52.698664 21918 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:52.700553 27184 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:52.703497 21993 raft_consensus.cc:1275] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:52.712983 27348 consensus_queue.cc:1048] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:52.723434 21850 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:52.730949 21748 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.759891 21748 catalog_manager.cc:5697] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 7 to 10, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 10 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.762336 21748 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.741140 27385 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:52.781396 21850 raft_consensus.cc:1275] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:52.784045 27345 consensus_queue.cc:1048] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:11:52.811980 21995 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:52.857214 21748 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.858439 27272 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.858907 21748 catalog_manager.cc:5697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.859086 27272 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:52.861296 21748 catalog_manager.cc:5697] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 13, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 13 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.862217 27272 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:52.862836 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:52.863543 21995 raft_consensus.cc:2393] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cffb5c192e144f7caa7b94271976ed42 in current term 15: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:52.863785 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:52.865748 21817 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:52.866358 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:11:52.865847 27450 log.cc:927] Time spent T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:52.870147 27272 raft_consensus.cc:3060] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.824718 27348 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:11:52.882545 21843 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:11:52.882921 21843 pending_rounds.cc:85] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: Aborting all ops after (but not including) 13
I20260709 12:11:52.883142 21843 pending_rounds.cc:107] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:11:52.883395 21843 raft_consensus.cc:2889] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:52.884666 21999 raft_consensus.cc:1275] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:52.870077 21748 catalog_manager.cc:5697] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.901221 27152 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:52.901903 27412 consensus_queue.cc:1048] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:52.926754 22000 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:11:52.938678 27389 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:52.939569 27389 consensus_queue.cc:1243] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer 73070a828b23480e9c3588e376bce2ab log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:11:52.974833 22000 pending_rounds.cc:85] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Aborting all ops after (but not including) 12
I20260709 12:11:52.975163 22000 pending_rounds.cc:107] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:11:52.975422 22000 raft_consensus.cc:2889] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:52.990549 27272 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.998592 21748 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.015717 21843 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:53.021746 27152 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:11:53.146334 21852 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:53.149942 27385 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:53.206807 22584 raft_consensus.cc:1275] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:53.213845 27409 consensus_queue.cc:1048] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:53.454715 27354 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:53.455328 27354 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.457525 27354 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:53.459215 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:53.459897 21923 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:53.462046 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:53.462836 21993 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:53.462781 22547 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:53.463901 27355 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.464319 27355 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:53.464680 27355 raft_consensus.cc:3060] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.490880 27355 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.503235 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:53.507838 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:53.508693 22000 raft_consensus.cc:2393] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 15: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:53.508937 27355 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:53.562397 21923 raft_consensus.cc:2468] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:53.563747 22547 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:53.564989 27354 raft_consensus.cc:2804] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.565508 27354 raft_consensus.cc:697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:53.566370 27354 consensus_queue.cc:237] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.497257 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:53.627135 27355 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.627671 27355 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.629835 27355 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:53.631706 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:53.632563 21993 raft_consensus.cc:2410] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 17 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:53.638082 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:53.638763 21918 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
I20260709 12:11:53.642061 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab
I20260709 12:11:53.650945 27388 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:53.651383 27388 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.651723 27388 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.656155 21750 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 8 to 10, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 10 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:53.657660 21750 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 8 to 11, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 11 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:53.661096 27388 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.667786 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:53.668350 21926 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.681191 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:53.681831 21993 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.707336 21750 catalog_manager.cc:5697] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:53.709239 21750 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 13, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 13 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:53.724179 21750 catalog_manager.cc:5697] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.725814 21750 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.721278 21926 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 17.
W20260709 12:11:53.722848 21748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58722 (request call id 274) took 23101 ms (client timeout 15000 ms). Trace:
I20260709 12:11:53.728061 22547 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:53.728930 27354 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:53.729429 27354 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:53.720706 27388 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:53.730266 27354 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:53.727665 21748 rpcz_store.cc:269] 0709 12:11:30.621412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.624001 (+  2589us) service_pool.cc:224] Handling call
0709 12:11:53.722773 (+23098772us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:53.208896 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:53.209438 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:53.209470 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:11:53.209487 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:53.210893 (+  1406us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:53.210971 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:53.210994 (+    23us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:11:53.212133 (+  1139us) tablet.cc:701] Row locks acquired
0709 12:11:53.212168 (+    35us) write_op.cc:260] PREPARE: finished
0709 12:11:53.212304 (+   136us) write_op.cc:270] Start()
0709 12:11:53.212414 (+   110us) write_op.cc:276] Timestamp: P: 1783599113212254 usec, L: 0
0709 12:11:53.212435 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:53.231096 (+ 18661us) log.cc:844] Serialized 6351 byte log entry
0709 12:11:53.278206 (+ 47110us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b540041e1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d96e28 00007f3be87d1581 00007f3be87d0d58 00007f3be87d59f1 00007f3be87d59a9 00007f3be87d5939 00007f3be87d5901 00007f3be87d4b2d 0000000000388634 0000000000388479
0709 12:11:53.284146 (+  5940us) op_driver.cc:464] REPLICATION: finished
0709 12:11:53.310183 (+ 26037us) write_op.cc:301] APPLY: starting
0709 12:11:53.310282 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:53.351436 (+ 41154us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:53.351465 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:53.401563 (+ 50098us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:53.412880 (+ 11317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:11:53.412956 (+    76us) write_op.cc:312] APPLY: finished
0709 12:11:53.413352 (+   396us) log.cc:844] Serialized 148 byte log entry
0709 12:11:53.413526 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:53.413687 (+   161us) write_op.cc:454] Released schema lock
0709 12:11:53.413751 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:53.414202 (+   451us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:53.414229 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":366532,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":25762,"apply.run_cpu_time_us":20573,"apply.run_wall_time_us":104003,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70975,"num_ops":16,"prepare.queue_time_us":25908,"prepare.run_cpu_time_us":18112,"prepare.run_wall_time_us":69484,"raft.queue_time_us":15488,"raft.run_cpu_time_us":6800,"raft.run_wall_time_us":27630,"replication_time_us":71551,"spinlock_wait_cycles":41356672,"thread_start_us":78049,"threads_started":4,"wal-append.queue_time_us":34919}]]}
I20260709 12:11:53.728961 21750 catalog_manager.cc:5697] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 12 to 14, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:53.754541 21750 catalog_manager.cc:5697] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.756078 21750 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:53.757608 21750 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 13 to 14, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 14 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:53.759459 21993 raft_consensus.cc:2410] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 17 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:53.762339 21750 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 14, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 14 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:53.802333 27355 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.802937 27355 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.806449 27355 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:53.807129 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:53.808296 27292 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:53.808466 21852 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:11:53.808902 27292 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.809871 22549 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:53.811198 27292 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:53.813747 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:53.814368 21926 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:53.817834 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:53.818573 27292 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.818842 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:53.819077 27292 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:11:53.819535 27292 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.820894 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:53.821590 22584 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:53.825250 27388 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.825750 27388 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.826191 27388 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.827572 27292 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.835517 27346 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.838819 27346 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.841403 27346 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:53.844099 27292 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:53.844429 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:53.844429 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:53.851683 21926 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:11:53.852903 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:53.853650 27292 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:53.854067 27292 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.854453 27292 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:53.857280 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:53.859081 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:53.859766 22583 raft_consensus.cc:2393] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 15: Already voted for candidate ac07267c8cab47d4b59dc27d6fe9a386 in this term.
I20260709 12:11:53.863211 27292 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.872102 27292 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:53.877279 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:53.887625 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:53.888247 21918 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:53.905967 27233 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:11:53.906633 27233 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.909525 21923 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:11:53.931864 21964 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:53.932711 27090 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.933286 27090 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:53.934175 27090 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.934759 27233 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:53.941184 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:53.942768 21852 raft_consensus.cc:2393] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 14: Already voted for candidate cffb5c192e144f7caa7b94271976ed42 in this term.
I20260709 12:11:53.945169 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:11:53.960216 21918 raft_consensus.cc:2468] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 18.
I20260709 12:11:53.983256 21964 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:53.984104 22000 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:53.985055 27047 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.988504 27410 raft_consensus.cc:2804] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:53.989100 27410 raft_consensus.cc:697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:53.989763 27410 consensus_queue.cc:237] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.985582 27047 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:53.996234 27388 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:53.986099 27354 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:11:54.009233 22584 raft_consensus.cc:2368] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15.
I20260709 12:11:54.012408 27047 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:54.014297 27388 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:53.770372 21750 catalog_manager.cc:5697] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 11, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 11 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
W20260709 12:11:54.064225 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 93251.2us
I20260709 12:11:54.070215 21843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:54.071302 21843 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:54.074810 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 100006us
I20260709 12:11:54.061709 21750 catalog_manager.cc:5697] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.078064 21750 catalog_manager.cc:5697] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 12 to 13, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 13 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.088454 21750 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:54.092500 21750 catalog_manager.cc:5697] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 13, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 13 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.101681 27409 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.102878 27409 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:54.106880 27409 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:11:54.119761 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 51352.7us
I20260709 12:11:54.160697 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:54.167459 21843 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:54.198840 27355 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.204099 21852 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:11:54.207711 22549 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:54.210700 27469 raft_consensus.cc:2804] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:54.211441 27469 raft_consensus.cc:697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:54.211040 21750 catalog_manager.cc:5697] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 13 to 15, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 15 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.220891 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:11:54.221822 21845 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:54.199746 27355 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:54.231760 21750 catalog_manager.cc:5697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 12 to 13, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 13 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:54.231794 21921 raft_consensus.cc:1275] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:54.258740 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:54.259879 21993 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:11:54.234061 27355 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:54.279048 27469 consensus_queue.cc:237] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:54.286816 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:54.263631 21750 catalog_manager.cc:5697] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 12, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 12 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:54.290226 27472 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.290771 27472 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.291154 27472 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.289077 21750 catalog_manager.cc:5697] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 12, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 12 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.304585 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:54.305583 27409 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.306092 27409 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.306509 27409 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.310801 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:54.312568 21918 raft_consensus.cc:3060] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.339541 21750 catalog_manager.cc:5697] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 5 to 17, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 17 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.340636 21918 raft_consensus.cc:2468] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:11:54.341590 21750 catalog_manager.cc:5697] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 13 to 16, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 16 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:54.348891 27388 consensus_queue.cc:1048] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:54.356746 27472 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:54.366958 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:11:54.379184 27409 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:54.381554 27409 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:54.384546 21993 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:54.391281 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:54.392534 21918 raft_consensus.cc:2410] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:11:54.394683 21918 raft_consensus.cc:1240] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:54.343461 21750 catalog_manager.cc:5697] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 5 to 8, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 8 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:54.407150 21750 catalog_manager.cc:5697] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 13, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 13 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:54.407686 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:54.408599 21849 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.408809 21750 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 13, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 13 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:54.412640 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:11:54.413475 21923 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:54.409869 27469 consensus_queue.cc:1059] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:54.420913 27355 raft_consensus.cc:3055] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:54.421435 27355 raft_consensus.cc:740] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:11:54.421574 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:54.422623 27388 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.422780 27355 consensus_queue.cc:260] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:54.423996 27355 raft_consensus.cc:3060] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.428153 21849 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:11:54.441445 22583 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:54.446513 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:54.451764 21919 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:54.499760 21993 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:11:54.452476 21893 leader_election.cc:400] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15.
I20260709 12:11:54.500236 21893 leader_election.cc:403] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:54.501319 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 49305.4us
I20260709 12:11:54.502465 27488 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043) with higher term. Message: Invalid argument: T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a for earlier term 14. Current term is 15.
I20260709 12:11:54.502774 27478 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:54.504704 21892 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:54.505482 27488 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:54.448071 21750 catalog_manager.cc:5697] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 12, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 12 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.506285 27488 raft_consensus.cc:697] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:54.511142 21750 catalog_manager.cc:5697] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.511806 27488 consensus_queue.cc:237] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:54.512595 21750 catalog_manager.cc:5697] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 19, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 19 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.526199 22583 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:11:54.514115 21750 catalog_manager.cc:5697] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:54.527776 27478 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:54.528683 27478 consensus_queue.cc:1243] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer ac07267c8cab47d4b59dc27d6fe9a386 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:11:54.531445 22583 pending_rounds.cc:85] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 12
I20260709 12:11:54.531764 22583 pending_rounds.cc:107] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:11:54.532054 22583 raft_consensus.cc:2889] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.532600 27483 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:54.544716 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:11:54.545559 21848 raft_consensus.cc:2393] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab in current term 14: Already voted for candidate ecd8f47cd089480aa1f77728a400384a in this term.
I20260709 12:11:54.486461 27472 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:11:54.564114 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:54.574368 21923 raft_consensus.cc:1275] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:11:54.601464 21964 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:54.602427 27472 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.603528 27472 consensus_queue.cc:1048] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:54.629184 21849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01221e34ce744d078265a58313d176a5"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:54.630097 21849 raft_consensus.cc:606] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:54.630463 21849 raft_consensus.cc:614] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:54.633435 21849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:54.633989 21849 raft_consensus.cc:606] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:54.634305 21849 raft_consensus.cc:614] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:54.637341 21849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:54.638020 21849 raft_consensus.cc:606] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:54.638439 21849 raft_consensus.cc:614] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:54.641171 21849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:54.641937 21849 raft_consensus.cc:606] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:11:54.642307 21849 raft_consensus.cc:614] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:54.645313 21849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:11:54.645933 21849 raft_consensus.cc:606] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:11:54.646353 21849 raft_consensus.cc:614] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:54.647940 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:54.668286 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:54.679183 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:54.693364 21849 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:54.695003 27469 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:54.730821 21923 raft_consensus.cc:1275] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:54.732229 27469 consensus_queue.cc:1048] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:55.065344 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 134734us
I20260709 12:11:55.076375 22000 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:55.120266 21845 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:55.144548 27475 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:55.166131 27385 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:55.191790 21750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58722 (request call id 275) took 6877 ms. Trace:
I20260709 12:11:55.198854 21750 rpcz_store.cc:276] 0709 12:11:48.314286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.326969 (+ 12683us) service_pool.cc:224] Handling call
0709 12:11:48.959502 (+632533us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540041e1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d05090 00007f3be4da3f3a 00007f3beab59e9c 00007f3beac5804e 00007f3be91192a4 00007f3be9119232 00007f3be9119161 00007f3be91190dc 00007f3be9118392 00007f3be30d648c 00007f3be30d58c6
0709 12:11:55.191670 (+6232168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:54.676051 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:54.676773 (+   722us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:54.676821 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:11:54.676856 (+    35us) tablet.cc:662] Decoding operations
0709 12:11:54.690168 (+ 13312us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:54.690272 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:54.690306 (+    34us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:11:54.721926 (+ 31620us) tablet.cc:701] Row locks acquired
0709 12:11:54.721976 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:11:54.722180 (+   204us) write_op.cc:270] Start()
0709 12:11:54.722341 (+   161us) write_op.cc:276] Timestamp: P: 1783599114722099 usec, L: 0
0709 12:11:54.722366 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:11:54.736048 (+ 13682us) log.cc:844] Serialized 11345 byte log entry
0709 12:11:54.802459 (+ 66411us) op_driver.cc:464] REPLICATION: finished
0709 12:11:54.819051 (+ 16592us) write_op.cc:301] APPLY: starting
0709 12:11:54.819156 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:54.881999 (+ 62843us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:54.882113 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:55.010390 (+128277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:55.016684 (+  6294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 12:11:55.016739 (+    55us) write_op.cc:312] APPLY: finished
0709 12:11:55.017373 (+   634us) log.cc:844] Serialized 252 byte log entry
0709 12:11:55.017585 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:55.017833 (+   248us) write_op.cc:454] Released schema lock
0709 12:11:55.017922 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:55.018514 (+   592us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:55.018561 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"spinlock_wait_cycles":1007207168,"child_traces":[["op",{"apply.queue_time_us":16285,"apply.run_cpu_time_us":39029,"apply.run_wall_time_us":199402,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125289,"num_ops":29,"prepare.queue_time_us":14329,"prepare.run_cpu_time_us":14185,"prepare.run_wall_time_us":93710,"raft.queue_time_us":33185,"raft.run_cpu_time_us":13823,"raft.run_wall_time_us":16673,"replication_time_us":79894,"thread_start_us":80144,"threads_started":4,"wal-append.queue_time_us":28205}]]}
I20260709 12:11:55.169866 21746 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 11 to 16, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 16 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.220139 21746 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.236304 21746 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 12 to 16, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 16 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.253819 21746 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 12 to 14, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.270658 21746 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.272866 21746 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.275951 21746 catalog_manager.cc:5697] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 13 to 17, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 17 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.279039 21746 catalog_manager.cc:5697] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 6 to 13, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 13 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:11:55.284879 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 107615us
I20260709 12:11:55.282692 21746 catalog_manager.cc:5697] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 12 to 14, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 14 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.288347 21746 catalog_manager.cc:5697] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.301489 21746 catalog_manager.cc:5697] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 9 to 12, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 12 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.306481 21746 catalog_manager.cc:5697] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 14 to 16, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 16 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.325037 21746 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.549103 21746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42850 (request call id 210) took 2769 ms. Trace:
I20260709 12:11:55.580003 21746 rpcz_store.cc:276] 0709 12:11:52.779482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.779773 (+   291us) service_pool.cc:224] Handling call
0709 12:11:55.549017 (+2769244us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:55.347384 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:55.356282 (+  8898us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:55.356328 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:11:55.356350 (+    22us) tablet.cc:662] Decoding operations
0709 12:11:55.357527 (+  1177us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:55.357608 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:55.357634 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:11:55.358619 (+   985us) tablet.cc:701] Row locks acquired
0709 12:11:55.358636 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:11:55.358810 (+   174us) write_op.cc:270] Start()
0709 12:11:55.358942 (+   132us) write_op.cc:276] Timestamp: P: 1783599115358754 usec, L: 0
0709 12:11:55.358964 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:11:55.363922 (+  4958us) log.cc:844] Serialized 5156 byte log entry
0709 12:11:55.366024 (+  2102us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b540041e1d4. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d96e28 00007f3be87d1581 00007f3be87d0d58 00007f3be87d59f1 00007f3be87d59a9 00007f3be87d5939 00007f3be87d5901 00007f3be87d4b2d 0000000000388634 0000000000388479
0709 12:11:55.391943 (+ 25919us) op_driver.cc:464] REPLICATION: finished
0709 12:11:55.392265 (+   322us) write_op.cc:301] APPLY: starting
0709 12:11:55.392349 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:55.399294 (+  6945us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:55.399322 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:55.438385 (+ 39063us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:55.438749 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:11:55.438799 (+    50us) write_op.cc:312] APPLY: finished
0709 12:11:55.439147 (+   348us) log.cc:844] Serialized 121 byte log entry
0709 12:11:55.460098 (+ 20951us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:55.460255 (+   157us) write_op.cc:454] Released schema lock
0709 12:11:55.460316 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:55.460665 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:55.460694 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":92635,"reported_tablets":29,"spinlock_wait_cycles":67840,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":16929,"apply.run_wall_time_us":68353,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54314,"num_ops":13,"prepare.queue_time_us":15403,"prepare.run_cpu_time_us":6530,"prepare.run_wall_time_us":18828,"replication_time_us":32787,"spinlock_wait_cycles":9584000,"thread_start_us":16863,"threads_started":1}]]}
I20260709 12:11:55.601650 21745 catalog_manager.cc:5697] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.611523 21745 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 13 to 14, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 14 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:55.614504 21745 catalog_manager.cc:5697] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:55.616459 21745 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 9 to 13, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 13 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.655543 21745 catalog_manager.cc:5697] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:55.663408 21745 catalog_manager.cc:5697] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 8 to 10, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 10 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.683503 21745 catalog_manager.cc:5697] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 9 to 11, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 11 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.752526 21746 catalog_manager.cc:5697] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.754221 21746 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 13 to 15, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 15 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.755689 21746 catalog_manager.cc:5697] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.756909 21746 catalog_manager.cc:5697] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 11 to 12, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 12 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:55.759949 21746 catalog_manager.cc:5697] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 14 to 15, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 15 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.822744 22584 consensus_queue.cc:237] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:55.830338 21745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58738 (request call id 285) took 8935 ms. Trace:
I20260709 12:11:55.837251 21745 rpcz_store.cc:276] 0709 12:11:46.895008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.895289 (+   281us) service_pool.cc:224] Handling call
0709 12:11:55.830238 (+8934949us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:55.718704 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:55.719291 (+   587us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:55.719328 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:11:55.719347 (+    19us) tablet.cc:662] Decoding operations
0709 12:11:55.720148 (+   801us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:55.720213 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:55.720243 (+    30us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:55.720848 (+   605us) tablet.cc:701] Row locks acquired
0709 12:11:55.720869 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:11:55.721015 (+   146us) write_op.cc:270] Start()
0709 12:11:55.721131 (+   116us) write_op.cc:276] Timestamp: P: 1783599115720972 usec, L: 0
0709 12:11:55.721154 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:11:55.721826 (+   672us) log.cc:844] Serialized 2839 byte log entry
0709 12:11:55.723964 (+  2138us) op_driver.cc:464] REPLICATION: finished
0709 12:11:55.724404 (+   440us) write_op.cc:301] APPLY: starting
0709 12:11:55.724482 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:55.728154 (+  3672us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:55.728242 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:55.732976 (+  4734us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:55.733169 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:11:55.733224 (+    55us) write_op.cc:312] APPLY: finished
0709 12:11:55.733473 (+   249us) log.cc:844] Serialized 73 byte log entry
0709 12:11:55.733796 (+   323us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:55.734687 (+   891us) write_op.cc:454] Released schema lock
0709 12:11:55.734918 (+   231us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:55.735273 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:55.735310 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17267,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":222,"apply.run_cpu_time_us":9075,"apply.run_wall_time_us":10822,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29246,"num_ops":7,"prepare.queue_time_us":794,"prepare.run_cpu_time_us":3403,"prepare.run_wall_time_us":3403,"replication_time_us":2677}]]}
I20260709 12:11:55.888463 21918 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:55.893079 27485 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
W20260709 12:11:55.921989 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 48030.9us
I20260709 12:11:55.941448 22000 raft_consensus.cc:1275] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:55.956988 27354 consensus_queue.cc:1048] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:55.937112 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:55.996989 21747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58736 (request call id 282) took 10173 ms. Trace:
I20260709 12:11:55.998579 21747 rpcz_store.cc:276] 0709 12:11:45.823813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.824101 (+   288us) service_pool.cc:224] Handling call
0709 12:11:55.996790 (+10172689us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487444,"reported_tablets":47}
I20260709 12:11:56.043210 27516 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 9 to 13, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:56.046589 21918 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 9 to 13, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:56.083666 21737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 265f2ffa166449ee9bfd498dacfcc48f with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:56.090312 21993 raft_consensus.cc:2955] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 9 to 13, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:56.105863 21749 catalog_manager.cc:5697] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 5 to 9, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 9 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:56.204536 21747 catalog_manager.cc:5697] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 9 to 13, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 15 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:56.258106 21750 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 13 to 16, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 16 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:56.274315 21750 catalog_manager.cc:5697] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 14 to 15, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 15 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:56.291781 21750 catalog_manager.cc:5697] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 14, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 14 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:56.293624 21750 catalog_manager.cc:5697] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 14, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
W20260709 12:11:56.300619 21749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58736 (request call id 281) took 29455 ms (client timeout 15000 ms). Trace:
W20260709 12:11:56.301103 21749 rpcz_store.cc:269] 0709 12:11:26.844728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.851413 (+  6685us) service_pool.cc:224] Handling call
0709 12:11:56.300515 (+29449102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:56.152331 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:56.152860 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:56.152896 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:11:56.152910 (+    14us) tablet.cc:662] Decoding operations
0709 12:11:56.153243 (+   333us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:56.153303 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:56.153340 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:56.153540 (+   200us) tablet.cc:701] Row locks acquired
0709 12:11:56.153562 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:11:56.153751 (+   189us) write_op.cc:270] Start()
0709 12:11:56.153877 (+   126us) write_op.cc:276] Timestamp: P: 1783599116153682 usec, L: 0
0709 12:11:56.153909 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:11:56.154622 (+   713us) log.cc:844] Serialized 538 byte log entry
0709 12:11:56.185420 (+ 30798us) op_driver.cc:464] REPLICATION: finished
0709 12:11:56.185865 (+   445us) write_op.cc:301] APPLY: starting
0709 12:11:56.185943 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:56.186746 (+   803us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:56.186830 (+    84us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:56.187477 (+   647us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:56.187618 (+   141us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:11:56.187657 (+    39us) write_op.cc:312] APPLY: finished
0709 12:11:56.187841 (+   184us) log.cc:844] Serialized 25 byte log entry
0709 12:11:56.187991 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:56.188087 (+    96us) write_op.cc:454] Released schema lock
0709 12:11:56.188124 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:56.188491 (+   367us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:56.188515 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":415048,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":266,"apply.run_cpu_time_us":2579,"apply.run_wall_time_us":2579,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":1110,"prepare.run_cpu_time_us":2601,"prepare.run_wall_time_us":2601,"replication_time_us":31372}]]}
I20260709 12:11:56.339206 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 265f2ffa166449ee9bfd498dacfcc48f with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:39424
I20260709 12:11:56.295490 21750 catalog_manager.cc:5697] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:56.344229 21750 catalog_manager.cc:5697] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:56.350047 21997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "032f8014213a49d395c150ebc9f55752"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:56.350697 21997 raft_consensus.cc:606] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:56.345722 21750 catalog_manager.cc:5697] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:56.353612 21993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207491536b034836987ee3a520d08ff6"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:56.354167 21993 raft_consensus.cc:606] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:56.353760 21750 catalog_manager.cc:5697] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:56.358189 21993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:56.357851 21750 catalog_manager.cc:5697] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 7 to 11, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 11 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:56.358872 21993 raft_consensus.cc:606] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:56.359331 21750 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:56.360914 21750 catalog_manager.cc:5697] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
I20260709 12:11:56.369565 21993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:56.370378 21993 raft_consensus.cc:606] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:56.376157 27523 tablet_replica.cc:333] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:11:56.377555 27523 raft_consensus.cc:2243] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.378235 27523 raft_consensus.cc:2272] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.380653 27506 raft_consensus.cc:993] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:56.381140 27506 raft_consensus.cc:1081] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:56.381457 27523 ts_tablet_manager.cc:1916] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:56.390614 21845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "207491536b034836987ee3a520d08ff6"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:56.391352 21845 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:56.391748 21845 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.403503 27507 raft_consensus.cc:993] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:56.404068 27507 raft_consensus.cc:1081] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:56.406255 21848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:56.410257 21848 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:56.412385 21848 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.415328 21845 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:56.431778 21845 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:56.432901 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:56.437801 21997 raft_consensus.cc:3055] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:56.434074 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:56.438877 21918 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.432549 21993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:56.438094 21997 raft_consensus.cc:740] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:56.441635 21848 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:56.441782 21997 consensus_queue.cc:260] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:56.443100 21997 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.449978 21918 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:56.440347 21993 raft_consensus.cc:606] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 16 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:56.440930 27523 ts_tablet_manager.cc:1929] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 12:11:56.456792 27523 log.cc:1199] T 265f2ffa166449ee9bfd498dacfcc48f P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/265f2ffa166449ee9bfd498dacfcc48f
I20260709 12:11:56.458066 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:56.459915 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:56.460667 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:56.462899 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 265f2ffa166449ee9bfd498dacfcc48f (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:11:56.451431 27506 raft_consensus.cc:993] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:56.464897 27506 raft_consensus.cc:1081] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:56.456126 21815 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:56.470151 27504 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:56.480150 27507 raft_consensus.cc:993] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:56.480687 27507 raft_consensus.cc:1081] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:56.485165 21849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:56.485816 21849 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:56.486167 21849 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.495970 21852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "032f8014213a49d395c150ebc9f55752"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:56.496644 21852 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:56.496989 21852 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.503028 27504 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:56.504017 27504 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:56.529282 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 265f2ffa166449ee9bfd498dacfcc48f with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 9 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:39424
I20260709 12:11:56.530997 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 265f2ffa166449ee9bfd498dacfcc48f (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:11:56.533641 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:56.533665 21750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58722 (request call id 276) took 1202 ms. Trace:
I20260709 12:11:56.534305 21993 raft_consensus.cc:3055] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:56.534756 21993 raft_consensus.cc:740] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:56.535521 21993 consensus_queue.cc:260] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:56.536582 21993 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.539966 21997 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:56.543304 21993 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:56.534353 21750 rpcz_store.cc:276] 0709 12:11:55.331035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.331220 (+   185us) service_pool.cc:224] Handling call
0709 12:11:55.336269 (+  5049us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b54002eff90. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1c76b71 00007f3be1c770b2 00007f3beabf0759 00007f3beab88a76 00007f3beab59d58 00007f3beac5804e 00007f3be91192a4 00007f3be9119232 00007f3be9119161 00007f3be91190dc
0709 12:11:56.533581 (+1197312us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:56.383196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:56.383765 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:56.383802 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:11:56.383815 (+    13us) tablet.cc:662] Decoding operations
0709 12:11:56.384978 (+  1163us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:56.385040 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:56.385072 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:11:56.386114 (+  1042us) tablet.cc:701] Row locks acquired
0709 12:11:56.386135 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:11:56.386289 (+   154us) write_op.cc:270] Start()
0709 12:11:56.386404 (+   115us) write_op.cc:276] Timestamp: P: 1783599116386234 usec, L: 0
0709 12:11:56.406826 (+ 20422us) op_driver.cc:348] REPLICATION: starting
0709 12:11:56.407636 (+   810us) log.cc:844] Serialized 4389 byte log entry
0709 12:11:56.413057 (+  5421us) op_driver.cc:464] REPLICATION: finished
0709 12:11:56.414178 (+  1121us) write_op.cc:301] APPLY: starting
0709 12:11:56.414268 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:56.422690 (+  8422us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:56.422791 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:56.481112 (+ 58321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:56.481345 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:11:56.481396 (+    51us) write_op.cc:312] APPLY: finished
0709 12:11:56.481714 (+   318us) log.cc:844] Serialized 105 byte log entry
0709 12:11:56.481874 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:56.482005 (+   131us) write_op.cc:454] Released schema lock
0709 12:11:56.482052 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:56.482383 (+   331us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:56.482430 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6656,"reported_tablets":27,"spinlock_wait_cycles":2756864,"child_traces":[["op",{"apply.queue_time_us":889,"apply.run_cpu_time_us":14307,"apply.run_wall_time_us":68174,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45958,"num_ops":11,"prepare.queue_time_us":312,"prepare.run_cpu_time_us":4467,"prepare.run_wall_time_us":44605,"replication_time_us":6082}]]}
I20260709 12:11:56.547127 21817 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:56.549373 27524 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.570361 27524 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:56.521822 21852 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:56.588668 21849 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:56.598289 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:56.598901 21919 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.599596 27524 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:56.611814 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:56.612552 21997 raft_consensus.cc:3055] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:56.614099 21997 raft_consensus.cc:740] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:56.607366 21919 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:56.616125 21815 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:56.617070 27526 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.617645 27526 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:56.618659 27526 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:56.622386 21848 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:56.626636 21849 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:56.660727 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:56.661616 21918 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.659971 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:56.664968 22583 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.665897 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:56.666549 21993 raft_consensus.cc:3055] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:56.666851 21993 raft_consensus.cc:740] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:56.667536 21993 consensus_queue.cc:260] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:56.668557 21993 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.670521 21852 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:56.685137 22583 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:56.686513 21993 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:56.682404 21918 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:56.699234 21997 consensus_queue.cc:260] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:56.702987 21815 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:56.757206 21997 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:56.786399 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 77473.2us
W20260709 12:11:56.793226 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 84706.2us
I20260709 12:11:56.769265 27504 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:56.799356 27504 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:56.800503 27504 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:56.829670 21997 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:11:56.834131 21750 catalog_manager.cc:5697] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 12, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:56.875053 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 86864.1us
W20260709 12:11:56.929786 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 65784.2us
W20260709 12:11:56.931602 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 56535.4us
W20260709 12:11:56.999682 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 123548us
W20260709 12:11:57.102514 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 127076us
I20260709 12:11:57.127110 21923 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:57.173112 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 57150.4us
W20260709 12:11:57.200451 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 62758.4us
I20260709 12:11:57.209774 27504 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:57.243068 22577 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:57.245255 27524 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:57.253778 27534 raft_consensus.cc:993] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:57.254287 27534 raft_consensus.cc:1081] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 16 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:57.260842 21993 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:57.261170 22000 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:57.262713 21995 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:57.269212 27530 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:57.270627 27530 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:57.271859 27530 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:57.285396 21845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:57.286034 21845 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:57.286473 21845 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.329118 21918 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:57.348587 21845 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:57.364141 27538 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:57.383715 21845 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:57.403398 21918 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:57.415207 27504 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:11:57.431859 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:57.432592 22584 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.435830 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:57.436492 21996 raft_consensus.cc:3055] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:57.436779 21996 raft_consensus.cc:740] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:57.437525 21996 consensus_queue.cc:260] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:57.439173 21997 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:57.480432 22584 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:57.474673 27530 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:11:57.504770 21818 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:57.510795 21996 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.520946 21750 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 12 to 13, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 13 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:11:57.510983 27504 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:11:57.577549 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 55209.8us
I20260709 12:11:57.612008 21996 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:57.574043 27504 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
W20260709 12:11:57.770610 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 76296.4us
W20260709 12:11:57.773960 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 68080.7us
I20260709 12:11:57.722328 27504 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:11:57.790658 27501 log.cc:927] Time spent T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:57.875331 21745 catalog_manager.cc:5697] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 12 to 13, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 13 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } }
W20260709 12:11:57.910032 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 71983.1us
W20260709 12:11:57.983470 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 66023.5us
I20260709 12:11:57.924582 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:58.010885 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 65994.2us
I20260709 12:11:58.028822 21749 catalog_manager.cc:5697] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 13 to 14, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 14 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.089810 21750 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 16 to 17, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 17 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.208817 22578 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:58.210457 27504 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:58.244892 21996 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:58.246863 27527 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:58.355759 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01221e34ce744d078265a58313d176a5"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:58.356452 22000 raft_consensus.cc:606] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:58.367395 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:58.368029 22000 raft_consensus.cc:606] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:58.375198 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:58.375800 22000 raft_consensus.cc:606] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:58.378947 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:58.379545 22000 raft_consensus.cc:606] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:58.382966 21921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:11:58.383654 21921 raft_consensus.cc:606] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:58.389634 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:58.390357 22000 raft_consensus.cc:606] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:58.399014 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:58.400823 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:58.401598 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:58.499028 27584 raft_consensus.cc:993] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:58.499658 27546 raft_consensus.cc:1081] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:58.501751 21848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:58.502436 21848 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.502823 21848 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.519673 21848 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:58.525298 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:58.525945 21921 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.526243 21848 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:58.526961 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:58.527642 22000 raft_consensus.cc:3055] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:58.527976 22000 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:58.528833 22000 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:58.530647 22000 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.530642 27534 raft_consensus.cc:993] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:58.534850 21921 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 15.
I20260709 12:11:58.543010 21815 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:58.534814 27534 raft_consensus.cc:1081] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:58.543992 27527 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:58.544564 27527 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 15 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:58.545593 27527 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:58.546352 21849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:58.547031 21849 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.547407 21849 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.558712 21849 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:58.560250 22000 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 15.
I20260709 12:11:58.568302 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:58.576407 21849 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:11:58.576480 22000 raft_consensus.cc:3055] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:58.577986 22000 raft_consensus.cc:740] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:58.574860 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:11:58.580415 22584 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.606742 22584 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:58.608050 21818 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:58.612985 22000 consensus_queue.cc:260] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:58.616326 27504 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:58.638182 27504 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:58.641904 27504 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:11:58.670296 22000 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.700276 21750 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 14 to 15, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 15 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:58.709607 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 54537.9us
I20260709 12:11:58.710040 22000 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
W20260709 12:11:58.776981 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 71092.3us
I20260709 12:11:58.800303 27546 raft_consensus.cc:993] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:58.805879 27584 raft_consensus.cc:1081] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
W20260709 12:11:58.844938 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 60791.4us
I20260709 12:11:58.881124 27552 raft_consensus.cc:993] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:58.881647 27552 raft_consensus.cc:1081] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
W20260709 12:11:58.891312 27593 log.cc:927] Time spent T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:11:58.897467 27574 raft_consensus.cc:993] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:58.898748 27574 raft_consensus.cc:1081] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
W20260709 12:11:58.912747 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 76034.4us
I20260709 12:11:58.914435 21845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01221e34ce744d078265a58313d176a5"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:58.916090 21845 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.916663 21845 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.920015 21848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:58.920758 21848 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.921200 21848 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:58.938015 21845 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:58.940949 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:58.941499 21918 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.941982 21845 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:58.943987 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:58.944495 22000 raft_consensus.cc:3055] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:58.944779 22000 raft_consensus.cc:740] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:58.945480 22000 consensus_queue.cc:260] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:58.946486 22000 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.948221 21918 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:58.949401 21815 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
W20260709 12:11:58.950140 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 98672.3us
I20260709 12:11:58.950846 27504 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:58.951390 27504 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:58.952255 27504 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:58.952582 21848 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:58.957418 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:58.957986 21918 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:58.964166 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:58.964797 21998 raft_consensus.cc:3055] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:58.964923 21996 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:58.965135 21998 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:58.965911 21998 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:58.966943 21998 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:58.970604 21849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56594
I20260709 12:11:58.971181 21849 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.971505 21849 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.973935 27527 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:58.954788 22000 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 12.
I20260709 12:11:58.964164 21848 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:59.001453 27584 raft_consensus.cc:993] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:59.002044 27584 raft_consensus.cc:1081] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:11:59.002148 21998 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:59.002720 21849 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:59.003319 21817 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:11:59.004197 27527 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:59.004691 27527 raft_consensus.cc:697] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:59.004940 21849 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:59.005626 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:59.005513 27527 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:59.006280 21926 raft_consensus.cc:3055] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:59.007160 21926 raft_consensus.cc:740] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:11:59.007954 21926 consensus_queue.cc:260] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:59.009703 21926 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.014562 21849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:11:59.015154 21849 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:59.018241 21849 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.022087 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:59.022755 21998 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.026650 21926 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:59.039685 21849 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:59.063100 21921 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:59.067070 21995 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:59.102753 21815 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:59.103909 21849 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:11:59.106305 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:11:59.106648 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:11:59.106974 21996 raft_consensus.cc:3055] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.107292 21921 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.107463 21996 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:11:59.108405 21996 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:59.109622 21996 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.105790 27504 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:59.116426 27572 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:59.088574 21745 catalog_manager.cc:5697] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 12, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:59.123318 21996 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:59.123853 21745 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 11 to 12, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 12 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:59.126163 21745 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 10 to 11, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:59.117717 21921 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 14.
I20260709 12:11:59.083982 21918 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 11.
I20260709 12:11:59.121296 21998 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 17.
I20260709 12:11:59.131989 21815 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:11:59.151701 27614 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:59.152259 27614 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:59.153162 27614 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:11:59.172914 27504 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:11:59.132262 27527 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:11:59.176643 27504 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:11:59.181689 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 49799.8us
I20260709 12:11:59.276620 22584 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:59.280231 27527 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:59.345795 21745 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 16 to 17, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 17 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:59.350693 21745 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 13 to 14, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 14 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:59.502125 21918 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:59.504338 27614 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:59.535179 21921 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:59.539896 27614 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:59.567616 21996 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:59.569784 27614 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:59.581635 22000 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:59.589468 27614 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:11:59.621398 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:59.643280 21926 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:59.645620 27527 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:59.651203 22000 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:59.680034 27590 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:59.701983 22000 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:59.706854 27504 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:11:59.728147 21921 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:59.733223 27527 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:59.915573 21996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:59.916167 21996 raft_consensus.cc:606] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:59.935158 22000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:11:59.935941 22000 raft_consensus.cc:606] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:11:59.946095 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:11:59.948163 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:59.948907 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:00.021536 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 87831.3us
W20260709 12:12:00.028963 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 75769.1us
I20260709 12:12:00.096385 22584 consensus_queue.cc:237] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:00.124972 22000 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:00.127168 27583 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:00.127321 21921 raft_consensus.cc:1275] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:00.130591 27583 consensus_queue.cc:1048] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:00.158507 27635 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 5 to 10, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:00.175457 21921 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 5 to 10, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:00.176892 21737 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1238ec38c933498cadf6153a5554f6e0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 12:12:00.175124 22000 raft_consensus.cc:2955] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 5 to 10, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:00.196455 21749 catalog_manager.cc:5697] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 5 to 10, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 15 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:00.342607 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 1238ec38c933498cadf6153a5554f6e0 with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:39424
I20260709 12:12:00.520277 27645 tablet_replica.cc:333] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:00.530915 27645 raft_consensus.cc:2243] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:00.532107 27645 raft_consensus.cc:2272] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:00.537256 27645 ts_tablet_manager.cc:1916] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:00.556891 27645 ts_tablet_manager.cc:1929] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 12:12:00.557408 27645 log.cc:1199] T 1238ec38c933498cadf6153a5554f6e0 P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/1238ec38c933498cadf6153a5554f6e0
I20260709 12:12:00.559463 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 1238ec38c933498cadf6153a5554f6e0 (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:12:01.259575 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:01.365258 22549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.001s	sys 0.013s
W20260709 12:12:01.366173 22549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.003s	sys 0.015s
W20260709 12:12:01.366609 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 785212us
I20260709 12:12:01.450357 27657 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:01.502816 27657 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.505046 27657 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:01.556490 27527 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.557171 27527 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.561545 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:01.568405 27527 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.569973 27656 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
W20260709 12:12:01.595973 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080033a040 after lost signal to thread 20708
I20260709 12:12:01.667645 21749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58722 (request call id 293) took 1145 ms. Trace:
I20260709 12:12:01.676465 21749 rpcz_store.cc:276] 0709 12:12:00.522446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.522589 (+   143us) service_pool.cc:224] Handling call
0709 12:12:01.667577 (+1144988us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4}
W20260709 12:12:01.676944 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080028a3e0 after lost signal to thread 21784
W20260709 12:12:01.678718 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800112140 after lost signal to thread 21876
W20260709 12:12:01.679018 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080029cf60 after lost signal to thread 21877
W20260709 12:12:01.721699 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800352760 after lost signal to thread 21951
W20260709 12:12:01.722886 21873 debug-util.cc:398] Leaking SignalData structure 0x7b080035b7c0 after lost signal to thread 22025
I20260709 12:12:01.711827 27650 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.715904 27516 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:01.735605 27650 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.735916 27516 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.737674 27650 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.715528 27572 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.738211 27516 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.727830 27657 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:01.738579 27572 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.739337 27657 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.740708 27657 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.740960 27572 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.691300 27656 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.731565 27661 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.741838 27661 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.742717 27647 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.731688 27634 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.732321 27636 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:01.733420 27655 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.713817 27654 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.746524 27504 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.765676 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:01.767652 21996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:12:01.766496 21997 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 18.
I20260709 12:12:01.745421 27661 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:01.747835 21873 debug-util.cc:398] Leaking SignalData structure 0x7b0800367ea0 after lost signal to thread 22608
I20260709 12:12:01.743347 27656 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.743273 27647 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.743427 27658 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.783236 27638 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.783069 27658 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.783810 27638 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.785405 27658 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.748327 27653 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.786217 27653 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.788498 27653 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.757443 27635 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.789137 27635 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.790686 27657 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.791267 27635 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.757870 27655 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.791648 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:01.793345 27655 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.738185 27598 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.793962 27598 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.796109 27598 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.758658 27634 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.797993 27634 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.768452 21996 raft_consensus.cc:606] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:01.757529 27636 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.729722 27649 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.799569 27649 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.800648 27636 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.801668 27649 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.802773 27665 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:01.803097 27664 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.803395 27665 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.803664 27664 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.803435 27605 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.805140 27605 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.806337 27637 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:01.806902 27637 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.807914 27583 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:01.808115 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.808481 27583 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.808938 27637 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:01.810549 27583 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:01.811156 27647 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.812417 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:12:01.773500 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 46534.6us
I20260709 12:12:01.743783 27546 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:01.791230 27657 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.815958 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.821801 27657 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.813704 27546 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.767469 27572 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:01.833597 27653 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:01.833702 27572 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.835556 27653 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.837306 27572 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.837508 27653 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.838426 27634 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:01.838631 27668 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.838727 27598 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:01.839038 27634 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.839198 27668 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.839319 27598 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.841176 27668 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.841347 27598 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.842756 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.843338 27546 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.843813 27657 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:01.844377 27657 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.767174 27654 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.847471 21850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.848466 27654 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.841181 27634 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.849650 27634 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.850154 27634 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.850636 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.852156 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:01.854977 27665 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.856670 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.856370 21851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.860244 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.852279 27634 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.861682 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.860138 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:01.864468 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.863895 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:01.770627 27504 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.870374 27605 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.873152 27664 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.875999 27638 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.877676 27647 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:01.878085 27647 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.878472 27647 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:01.858551 27657 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.883675 21817 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:01.885095 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.886556 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.886858 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.892009 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.894265 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.884020 27504 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.895532 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.898203 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.899067 22584 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
I20260709 12:12:01.903630 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.904701 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.905251 27660 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:01.905927 27660 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.906258 27668 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:01.906877 27668 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.908178 27660 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.908779 27660 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.908974 27668 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.909262 27660 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.909575 27668 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:01.910550 27668 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.912910 27670 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:01.913674 27670 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.913968 27667 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.914755 27667 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.916071 27670 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:01.917030 27667 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.922334 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.895184 27634 raft_consensus.cc:493] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.923787 27634 raft_consensus.cc:515] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.925451 22579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.926090 27648 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.912985 27668 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.928606 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.892632 27598 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:01.926748 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.934140 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.937029 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.937064 27598 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:01.939726 27634 leader_election.cc:290] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.941285 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:01.918550 27656 raft_consensus.cc:493] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.941749 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.943005 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.945271 27647 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.927076 27667 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.949575 27656 raft_consensus.cc:515] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.951032 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:01.951675 21920 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
I20260709 12:12:01.950599 27667 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.952558 27656 leader_election.cc:290] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.952580 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:01.953650 27598 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.953701 27669 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:01.954573 27669 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:01.955698 27660 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:01.955091 27667 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.956722 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.958370 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:01.959012 21999 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 16.
I20260709 12:12:01.959947 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:01.960829 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.963414 27647 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.964259 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:01.969458 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:01.971378 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:01.973222 27669 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:01.974262 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:12:01.974612 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 78775.2us
I20260709 12:12:02.007553 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.007978 21967 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:01.975144 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.009933 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.010962 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:02.012090 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.984381 27637 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:02.013458 27638 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:02.013211 27637 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:02.013862 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.015472 27637 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:02.015515 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:02.013881 27638 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:02.016223 21993 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:02.016340 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:01.991472 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.016970 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:01.991758 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:01.992218 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:01.992626 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:01.993461 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:01.995910 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.001484 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.016363 27638 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.010300 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.001780 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:02.002003 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.004345 21852 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:02.025341 21993 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 19.
I20260709 12:12:02.026279 27670 consensus_queue.cc:1059] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:02.026680 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.027333 27670 raft_consensus.cc:3055] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:02.027694 27670 raft_consensus.cc:740] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:02.028601 27670 consensus_queue.cc:260] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.029912 27670 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:02.038082 27654 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:02.038192 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.038611 21993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:12:02.038730 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.039198 21993 raft_consensus.cc:606] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.039862 21817 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:02.040114 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.005769 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:12:02.044921 22547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.046444 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:02.047287 27647 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:02.047753 27647 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 19 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:12:02.048290 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:02.048600 27647 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.051005 27664 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:02.051522 27664 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.053061 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:02.071056 27614 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:02.071769 27614 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.074020 27504 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:02.074616 27504 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:02.038730 27654 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.078516 27648 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:02.079149 27651 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:02.079177 27648 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:02.079859 27651 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.082170 27650 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:02.082965 27650 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:02.082933 27648 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:02.013152 27674 raft_consensus.cc:993] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:12:02.087093 27665 raft_consensus.cc:1081] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:12:02.091203 27648 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:02.091786 27648 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:02.094151 27650 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:02.094619 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.095330 27504 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:02.096431 27614 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:02.097433 27651 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:02.099489 21920 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:02.102236 27654 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:02.103468 27648 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:02.103549 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:02.103888 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:02.104919 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:02.106263 27638 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.108563 27638 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:02.109568 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:02.111047 27664 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:02.111941 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:02.111946 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.115540 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.116145 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.116837 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.117333 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.118185 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.118474 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.119285 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.124809 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.129925 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.130147 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:12:02.130995 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 98755.3us
I20260709 12:12:02.132059 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:02.134281 27648 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:02.138530 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.144794 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.154798 21993 raft_consensus.cc:1240] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:02.169200 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.174017 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.177152 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f08cb5ae6d4138a6d803e9cf3c8f38" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.176231 21749 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 18 to 19, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 19 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.177708 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.180613 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f67b74a580421b99787adc89841d21" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.180974 22547 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.184813 27657 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:02.185216 27657 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:02.185565 27657 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.188733 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.189530 27504 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.189908 21815 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.190527 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.191234 21964 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.191682 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.192438 21964 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.193655 27654 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.163271 27651 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:02.195814 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.196878 21815 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.194337 27654 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.197949 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.193539 21964 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.198549 27614 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.199365 21964 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.201951 27664 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:02.202621 27664 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.200588 27614 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:02.207515 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.208153 21846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.209302 27614 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.210785 27504 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.217387 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:02.220350 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.220590 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.221560 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.206441 27657 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.223695 22583 raft_consensus.cc:1240] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Rejecting Update request from peer cffb5c192e144f7caa7b94271976ed42 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:02.223903 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:02.225183 27657 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:02.230703 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.200745 21892 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.233846 21892 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.235172 27669 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.235164 27614 consensus_queue.cc:1059] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:02.238049 27614 raft_consensus.cc:3055] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:02.238444 27614 raft_consensus.cc:740] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:12:02.239248 27614 consensus_queue.cc:260] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.240091 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.240640 27614 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.241750 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.242947 27598 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.244464 21892 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.244678 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42" is_pre_election: true
I20260709 12:12:02.262897 27598 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:02.264182 21892 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.255479 21964 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.265821 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.266669 27654 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.267374 27654 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.246589 21845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:12:02.272461 21845 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.272635 27637 raft_consensus.cc:993] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:12:02.272887 21845 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.273172 27637 raft_consensus.cc:1081] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:12:02.262446 21815 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.276969 27651 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:02.279192 27598 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.278215 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.285113 27651 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.282673 21845 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:02.283557 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.286510 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.287220 27659 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.287410 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:12:02.285688 21893 consensus_peers.cc:597] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11bd5972700f42709d3ebcb0a6d9b51c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.288532 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.288489 27659 raft_consensus.cc:2749] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:02.294147 27663 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:02.295298 22549 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.295835 21815 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.296348 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.296669 21993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.296955 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.297307 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1238ec38c933498cadf6153a5554f6e0" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.297420 27657 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.297518 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.298080 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d6c6b59b7b44f4b009fc6edfc800eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.304306 21966 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.296458 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.305326 27657 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:02.298722 22000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:02.306068 27671 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.300717 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:02.307039 21998 raft_consensus.cc:3055] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:02.307353 21998 raft_consensus.cc:740] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:02.308113 21998 consensus_queue.cc:260] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:02.309150 21998 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:02.289269 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.313359 21966 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.299774 21845 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:02.316424 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.316751 27614 raft_consensus.cc:2749] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:02.314913 27671 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.317451 27614 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.317906 21845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:12:02.320560 21921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:12:02.324720 21921 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.325066 21921 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.326929 21966 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.331295 21845 raft_consensus.cc:2468] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:12:02.331811 21998 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:12:02.333678 21817 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:12:02.333992 22549 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:12:02.334748 27651 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:02.335083 27657 raft_consensus.cc:2804] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:02.335386 27651 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:12:02.335672 27657 raft_consensus.cc:697] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:02.337386 27657 consensus_queue.cc:237] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.343276 21921 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.344604 21892 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.345185 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:02.345777 21892 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.345795 21923 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.348189 21966 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.347914 27634 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.342468 27665 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.350921 27651 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:02.353655 21852 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:02.351394 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.355516 22547 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.356383 27583 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.356627 22547 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:02.346977 27660 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:02.357515 27670 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.356770 27663 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.361064 21919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:02.364122 21923 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:12:02.365830 21921 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:02.367130 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:02.367784 22581 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.373344 21998 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:02.366725 27665 raft_consensus.cc:2749] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:02.379557 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.378170 21745 catalog_manager.cc:5697] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 11 to 12, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 12 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:02.381354 27598 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.383991 21892 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:02.385546 27656 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:02.403294 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:02.404827 27656 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:02.405812 27656 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting leader election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:02.406335 27656 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.410916 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.416512 21892 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.417629 21892 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.418800 27660 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:02.420192 27634 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.435195 27634 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.435195 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.435514 22581 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 16.
I20260709 12:12:02.438127 21893 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:02.439028 27634 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:02.439559 27634 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:02.440478 27634 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.443957 27660 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.450572 22581 raft_consensus.cc:1240] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:02.454592 27605 consensus_queue.cc:1059] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:02.456051 21892 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.457446 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.455662 27605 raft_consensus.cc:3055] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:02.459017 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.460865 27669 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.458596 27598 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.466511 27605 raft_consensus.cc:740] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:02.468159 27598 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.468652 27605 consensus_queue.cc:260] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.469411 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.470110 27605 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.470185 27598 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.476976 21892 leader_election.cc:304] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:02.480103 21892 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.481241 21892 leader_election.cc:304] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:02.482858 21892 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.482131 27656 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.483855 27660 raft_consensus.cc:2749] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.482512 27669 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:02.481899 27598 raft_consensus.cc:2749] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.490533 21998 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:02.492161 27651 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:02.495244 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:02.495604 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:02.495132 27598 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:02.498587 27598 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:02.499377 27598 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:02.504087 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:02.505025 21992 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Rejecting Update request from peer ecd8f47cd089480aa1f77728a400384a for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:02.505111 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:02.535181 21749 catalog_manager.cc:5697] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 12 to 13, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 13 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.547225 21994 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 16.
I20260709 12:12:02.495473 27656 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:02.589643 27634 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:02.614142 27634 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:02.615203 27634 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:02.614701 21745 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 15 to 16, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 16 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.615603 27634 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:02.616642 27634 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.618144 27634 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.635733 21892 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:02.663816 22581 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:02.676047 27648 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:12:02.666360 27688 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.685129 21921 raft_consensus.cc:1240] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:02.699626 27659 consensus_queue.cc:1059] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:02.700690 27659 raft_consensus.cc:3055] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:02.701025 27659 raft_consensus.cc:740] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:02.701876 27659 consensus_queue.cc:260] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:02.706636 27659 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.729072 27598 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:02.731209 21999 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:02.751171 21749 catalog_manager.cc:5697] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 10, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:02.771157 21921 raft_consensus.cc:3060] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.797411 21921 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:12:02.803967 27659 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:02.831106 21852 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:02.864769 21920 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:02.866562 27648 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:02.913667 27697 ts_tablet_manager.cc:933] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:02.967422 22583 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:02.968935 27689 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:02.975997 21852 raft_consensus.cc:1275] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:12:02.978252 21846 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:02.988984 21994 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:02.991664 27651 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:12:02.997308 27663 consensus_queue.cc:1048] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:12:03.013051 27697 tablet_copy_client.cc:323] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:12:03.015810 21937 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 11bd5972700f42709d3ebcb0a6d9b51c from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:12:03.016438 21937 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 11bd5972700f42709d3ebcb0a6d9b51c from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-11bd5972700f42709d3ebcb0a6d9b51c
I20260709 12:12:03.052697 21994 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:03.062209 27689 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:12:03.110730 21818 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6e5de589d8b434b87a0bf4f41fb63ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:03.112378 21999 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:12:03.114873 21937 tablet_copy_source_session.cc:215] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:03.119048 21920 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:12:03.124694 27504 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:03.127444 27614 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:03.129410 27697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd5972700f42709d3ebcb0a6d9b51c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:03.188889 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:03.259505 27614 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.267979 21920 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.271136 21923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
mode: GRACEFUL
new_leader_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:32862
I20260709 12:12:03.271847 21923 raft_consensus.cc:606] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Received request to transfer leadership to TS 73070a828b23480e9c3588e376bce2ab
I20260709 12:12:03.278752 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:03.280525 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:03.281373 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:03.277884 21999 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.296906 27697 tablet_copy_client.cc:806] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:03.297640 27697 tablet_copy_client.cc:670] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:03.316902 27697 tablet_copy_client.cc:538] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:03.321058 21749 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 9, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.377472 27697 tablet_bootstrap.cc:492] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:12:03.489326 21926 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:03.538297 21851 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:03.538611 21999 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:03.540755 27689 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:12:03.545735 27687 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:12:03.552443 21893 consensus_peers.cc:597] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d3beb28cf484708af67a4cafaaa657b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:03.570942 27634 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Committing config change with OpId 16.8: config changed from index -1 to 8, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.573254 21998 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Committing config change with OpId 16.8: config changed from index -1 to 8, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.591509 27687 raft_consensus.cc:993] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: : Instructing follower 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:12:03.592098 27687 raft_consensus.cc:1081] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Signalling peer 73070a828b23480e9c3588e376bce2ab to start an election
I20260709 12:12:03.593876 21994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
 from {username='slave'} at 127.0.0.1:35522
I20260709 12:12:03.594472 21994 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:03.594832 21994 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.602274 21994 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:03.612491 21852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:12:03.613162 21852 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.621927 21852 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:12:03.625537 21846 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:03.630270 21994 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:03.625952 21750 catalog_manager.cc:5697] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 8, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 16 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.631008 21966 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:12:03.632630 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:03.634716 21926 raft_consensus.cc:3055] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.635012 21926 raft_consensus.cc:740] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:03.635725 21926 consensus_queue.cc:260] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:03.636731 21926 raft_consensus.cc:3060] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.636062 21851 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Committing config change with OpId 16.8: config changed from index -1 to 8, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.639370 27671 raft_consensus.cc:2804] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:03.660676 27671 raft_consensus.cc:697] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:03.662721 21926 raft_consensus.cc:2468] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:12:03.662436 27671 consensus_queue.cc:237] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:03.672195 21994 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:12:03.674149 21818 consensus_peers.cc:597] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81e7a6bdd47e4ede8aa8580b9375a5aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:03.675719 27648 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:12:03.703143 21926 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:03.705734 27647 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:03.698055 21750 catalog_manager.cc:5697] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 14 to 15, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 15 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.835932 27697 tablet_bootstrap.cc:492] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:03.834946 27647 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.839159 21994 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.846467 21926 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:12:03.854066 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 53943.8us
I20260709 12:12:03.874989 27725 ts_tablet_manager.cc:933] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:12:03.885419 21750 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 15 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:03.908830 27697 tablet_bootstrap.cc:492] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:12:03.909940 27697 ts_tablet_manager.cc:1403] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.533s	user 0.050s	sys 0.035s
I20260709 12:12:03.923368 27725 tablet_copy_client.cc:323] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:12:03.923940 27663 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:03.924638 27663 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:03.925873 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet a6e5de589d8b434b87a0bf4f41fb63ba from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:12:03.925693 27697 raft_consensus.cc:359] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:03.926630 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet a6e5de589d8b434b87a0bf4f41fb63ba from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-a6e5de589d8b434b87a0bf4f41fb63ba
I20260709 12:12:03.950394 27697 raft_consensus.cc:740] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:12:03.959081 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:03.959793 21926 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 17.
I20260709 12:12:03.962356 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:03.967903 27702 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.968401 27702 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:03.968811 27702 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.976377 27663 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:03.983052 27697 consensus_queue.cc:260] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:03.991128 27702 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:03.993832 21862 tablet_copy_source_session.cc:215] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:03.986203 27697 ts_tablet_manager.cc:1434] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.003s
I20260709 12:12:03.997359 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:03.998090 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:03.998939 21994 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 17: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:12:04.016479 27703 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.017081 27703 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:04.021528 21926 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 17.
I20260709 12:12:04.026851 27725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e5de589d8b434b87a0bf4f41fb63ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:04.027251 27702 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:04.028010 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:04.028795 27702 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:04.029310 27702 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:04.030169 27702 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:04.035341 27703 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:04.036108 21937 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-11bd5972700f42709d3ebcb0a6d9b51c received from {username='slave'} at 127.0.0.1:46426
I20260709 12:12:04.036656 21937 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-11bd5972700f42709d3ebcb0a6d9b51c on tablet 11bd5972700f42709d3ebcb0a6d9b51c with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:04.038763 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:04.039423 21998 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
I20260709 12:12:04.039770 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:04.040428 21920 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 17.
I20260709 12:12:04.044214 22549 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:04.045908 27663 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:04.046324 27663 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.046707 27663 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.051827 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:04.053347 21994 raft_consensus.cc:2393] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 17: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:12:04.065584 27663 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:04.070312 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:04.071184 21926 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.079510 21926 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 18.
I20260709 12:12:04.081321 21920 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:04.080600 22547 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:04.088392 27697 ts_tablet_manager.cc:933] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:04.085462 27605 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:12:04.116595 27663 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:04.122081 27702 raft_consensus.cc:2804] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:04.124454 27702 raft_consensus.cc:697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:04.125336 27702 consensus_queue.cc:237] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:04.133425 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 52909.7us
I20260709 12:12:04.139899 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:04.140599 21994 raft_consensus.cc:3060] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.143996 21750 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 16 to 17, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 17 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.150197 21994 raft_consensus.cc:2468] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 18.
I20260709 12:12:04.187420 27697 tablet_copy_client.cc:323] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:12:04.208099 27739 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.234263 21937 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 4d3beb28cf484708af67a4cafaaa657b from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:12:04.235249 21937 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 4d3beb28cf484708af67a4cafaaa657b from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-4d3beb28cf484708af67a4cafaaa657b
I20260709 12:12:04.225785 27739 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:04.245253 27739 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:04.256887 27725 tablet_copy_client.cc:806] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:04.257854 27725 tablet_copy_client.cc:670] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:04.324636 21937 tablet_copy_source_session.cc:215] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:04.493433 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.594549 21847 raft_consensus.cc:1275] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:04.604441 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:04.515439 21926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:12:04.321548 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46409.5us
I20260709 12:12:04.629060 21926 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:12:04.682649 27697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3beb28cf484708af67a4cafaaa657b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:04.698562 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 48087.3us
I20260709 12:12:04.701323 27725 tablet_copy_client.cc:538] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:12:04.742480 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 47373.6us
I20260709 12:12:04.778354 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:04.785053 27740 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:04.785610 27740 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.786051 27740 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.794512 22583 raft_consensus.cc:1217] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 12:12:04.819660 21749 catalog_manager.cc:5697] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.932125 21920 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:04.933871 21998 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:04.926077 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 43742.4us
I20260709 12:12:04.958504 27726 consensus_queue.cc:1048] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:04.967643 27737 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:04.979378 27740 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:04.980659 21999 raft_consensus.cc:1240] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Rejecting Update request from peer ac07267c8cab47d4b59dc27d6fe9a386 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:04.961649 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 74483.8us
I20260709 12:12:05.003679 21926 raft_consensus.cc:1275] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:05.013098 27663 consensus_queue.cc:1059] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:05.014230 27663 raft_consensus.cc:3055] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:05.014638 27663 raft_consensus.cc:740] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:05.015915 27663 consensus_queue.cc:260] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:05.017266 27663 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.039181 27757 ts_tablet_manager.cc:933] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
I20260709 12:12:05.070533 27740 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:05.058617 27737 consensus_queue.cc:1048] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:12:05.087361 22580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:05.093655 27725 tablet_bootstrap.cc:492] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:12:05.107007 27697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58908 (request call id 1497) took 1019 ms. Trace:
I20260709 12:12:05.107582 27697 rpcz_store.cc:276] 0709 12:12:04.087702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.087849 (+   147us) service_pool.cc:224] Handling call
0709 12:12:04.088775 (+   926us) ts_tablet_manager.cc:934] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
0709 12:12:04.648337 (+559562us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:05.031872 (+383535us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:05.032009 (+   137us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:05.096247 (+ 64238us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:05.096606 (+   359us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:05.096906 (+   300us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:05.106911 (+ 10005us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":44381,"tablet-copy.queue_time_us":117,"thread_start_us":48547,"threads_started":1}
I20260709 12:12:05.109592 27697 tablet_copy_client.cc:806] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:05.110262 27697 tablet_copy_client.cc:670] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:05.142760 27757 tablet_copy_client.cc:323] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:12:05.165921 22580 raft_consensus.cc:2410] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 73070a828b23480e9c3588e376bce2ab for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:12:05.169715 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ed463cf25c4e46900f103087ec2300" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:05.176149 21921 raft_consensus.cc:3060] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.288277 21996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:12:05.293478 21996 raft_consensus.cc:606] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Received request to transfer leadership to TS ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:05.307480 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 135255us
I20260709 12:12:05.305902 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:05.312906 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:05.341564 21921 raft_consensus.cc:2468] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 18.
W20260709 12:12:05.342911 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 141821us
I20260709 12:12:05.373749 21862 tablet_copy_service.cc:140] P cffb5c192e144f7caa7b94271976ed42: Received BeginTabletCopySession request for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:39640)
I20260709 12:12:05.374531 21862 tablet_copy_service.cc:161] P cffb5c192e144f7caa7b94271976ed42: Beginning new tablet copy session on tablet 81e7a6bdd47e4ede8aa8580b9375a5aa from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:39640: session id = ac07267c8cab47d4b59dc27d6fe9a386-81e7a6bdd47e4ede8aa8580b9375a5aa
W20260709 12:12:05.385978 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 107709us
W20260709 12:12:05.408475 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 60890.3us
I20260709 12:12:05.390256 21862 tablet_copy_source_session.cc:215] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:05.430325 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:05.438108 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 92656.8us
I20260709 12:12:05.446776 21964 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:05.460366 27757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:05.434558 27697 tablet_copy_client.cc:538] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:05.477952 27671 raft_consensus.cc:2804] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:05.491851 27756 raft_consensus.cc:993] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:12:05.492522 27756 raft_consensus.cc:1081] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:12:05.483032 27671 raft_consensus.cc:697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:05.503383 27671 consensus_queue.cc:237] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:05.537797 27697 tablet_bootstrap.cc:492] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:12:05.602298 21921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:12:05.655221 21921 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.656158 21921 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.705734 27687 raft_consensus.cc:1064] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:12:05.714247 21921 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:05.685171 21745 catalog_manager.cc:5697] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 17 to 18, leader changed from ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 18 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.768597 27687 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:05.774525 21847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:12:05.775207 21847 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.781522 21921 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:05.779575 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 106221us
I20260709 12:12:05.787101 27757 tablet_copy_client.cc:806] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:05.787801 27757 tablet_copy_client.cc:670] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:05.791105 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:05.791852 21994 raft_consensus.cc:3055] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:05.792133 21994 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:05.809439 21847 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:12:05.818946 21922 raft_consensus.cc:1240] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Rejecting Update request from peer 73070a828b23480e9c3588e376bce2ab for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:05.821748 21892 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:05.840041 27757 tablet_copy_client.cc:538] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:05.841217 21994 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:05.842473 21994 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.854269 27757 tablet_bootstrap.cc:492] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:12:05.862509 27719 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.863152 27719 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:05.864048 27719 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:05.865341 21994 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:12:05.936647 22577 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:05.938445 27769 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:05.941699 21994 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:05.943815 27687 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:05.945650 21852 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:05.950202 27769 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:05.953030 27725 tablet_bootstrap.cc:492] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:05.954070 27725 tablet_bootstrap.cc:492] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:12:05.959379 27725 ts_tablet_manager.cc:1403] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.866s	user 0.039s	sys 0.013s
I20260709 12:12:05.971402 27725 raft_consensus.cc:359] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:05.972324 27725 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:12:05.973028 27725 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:05.988996 27725 ts_tablet_manager.cc:1434] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 12:12:05.993147 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-a6e5de589d8b434b87a0bf4f41fb63ba received from {username='slave'} at 127.0.0.1:39640
I20260709 12:12:05.993716 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-a6e5de589d8b434b87a0bf4f41fb63ba on tablet a6e5de589d8b434b87a0bf4f41fb63ba with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:06.072382 22584 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:12:06.072819 22584 pending_rounds.cc:85] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting all ops after (but not including) 13
I20260709 12:12:06.073042 22584 pending_rounds.cc:107] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:12:06.073318 22584 raft_consensus.cc:2889] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:06.127892 27697 tablet_bootstrap.cc:492] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:06.130672 27605 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:12:06.133838 27697 tablet_bootstrap.cc:492] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:12:06.135166 27697 ts_tablet_manager.cc:1403] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.598s	user 0.047s	sys 0.019s
W20260709 12:12:06.152866 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 58661.8us
I20260709 12:12:06.167832 22577 raft_consensus.cc:1217] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:12:06.181474 21746 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 13 to 14, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.189584 27792 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:06.244338 21994 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:06.246986 27697 raft_consensus.cc:359] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:06.257440 27697 raft_consensus.cc:740] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:12:06.258104 27697 consensus_queue.cc:260] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:06.294593 21922 raft_consensus.cc:1275] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:06.299054 21852 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:06.317585 21992 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:06.322579 27786 consensus_queue.cc:1048] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:06.352715 27697 ts_tablet_manager.cc:1434] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.217s	user 0.008s	sys 0.000s
I20260709 12:12:06.370307 27768 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:06.380443 21937 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-4d3beb28cf484708af67a4cafaaa657b received from {username='slave'} at 127.0.0.1:46426
I20260709 12:12:06.380923 21937 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-4d3beb28cf484708af67a4cafaaa657b on tablet 4d3beb28cf484708af67a4cafaaa657b with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:06.383423 22584 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:06.383805 21749 catalog_manager.cc:5697] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 10 to 11, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:06.535490 21847 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:06.546823 27755 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:06.569285 22577 raft_consensus.cc:1217] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.7->[16.8-16.8]   Dedup: 16.8->[]
W20260709 12:12:06.638917 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 43826.2us
I20260709 12:12:06.704778 27757 tablet_bootstrap.cc:492] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:06.705868 27757 tablet_bootstrap.cc:492] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:12:06.708611 27757 ts_tablet_manager.cc:1403] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.855s	user 0.039s	sys 0.025s
I20260709 12:12:06.719614 27794 raft_consensus.cc:1064] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:12:06.731694 27757 raft_consensus.cc:359] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:06.732605 27757 raft_consensus.cc:740] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:12:06.733395 27757 consensus_queue.cc:260] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:06.743742 21920 consensus_queue.cc:237] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:06.747344 27757 ts_tablet_manager.cc:1434] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.005s
I20260709 12:12:06.750855 22577 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:06.750988 21862 tablet_copy_service.cc:342] P cffb5c192e144f7caa7b94271976ed42: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-81e7a6bdd47e4ede8aa8580b9375a5aa received from {username='slave'} at 127.0.0.1:39640
I20260709 12:12:06.751550 21862 tablet_copy_service.cc:434] P cffb5c192e144f7caa7b94271976ed42: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-81e7a6bdd47e4ede8aa8580b9375a5aa on tablet 81e7a6bdd47e4ede8aa8580b9375a5aa with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:06.755137 27768 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:06.739749 27794 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:06.760313 21846 raft_consensus.cc:1275] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:06.763756 27768 consensus_queue.cc:1048] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:06.772111 27687 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:06.774197 22577 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:06.779247 21846 raft_consensus.cc:2955] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:06.783499 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:06.818872 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11bd5972700f42709d3ebcb0a6d9b51c with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:06.853868 21750 catalog_manager.cc:5697] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 11 to 12, VOTER 73070a828b23480e9c3588e376bce2ab (127.20.56.67) evicted. New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:06.858798 21996 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:06.859360 22584 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:06.860927 27651 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:06.862138 21920 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:06.865638 27771 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:06.867573 27771 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:06.878988 21991 tablet_service.cc:1558] Processing DeleteTablet for tablet 11bd5972700f42709d3ebcb0a6d9b51c with delete_type TABLET_DATA_TOMBSTONED (TS 73070a828b23480e9c3588e376bce2ab not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:32960
W20260709 12:12:06.882526 21734 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 11bd5972700f42709d3ebcb0a6d9b51c with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER failed with leader ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 11 but the committed config has opid_index of 12
I20260709 12:12:07.026857 27651 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.043301 27815 tablet_replica.cc:333] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:07.044664 27815 raft_consensus.cc:2243] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:07.045634 27815 raft_consensus.cc:2272] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:07.032297 22584 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.052744 27815 ts_tablet_manager.cc:1916] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:07.086819 21992 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.128619 27798 raft_consensus.cc:1064] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:12:07.132366 27798 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 6, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:07.173663 21923 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.179180 21747 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 9 to 10, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.200392 22584 raft_consensus.cc:1217] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 12:12:07.218735 21992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
new_leader_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:48214
I20260709 12:12:07.224723 21992 raft_consensus.cc:606] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Received request to transfer leadership to TS cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:07.251708 27815 ts_tablet_manager.cc:1929] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:12:07.288215 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:07.290126 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:07.329051 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:07.324468 27815 log.cc:1199] T 11bd5972700f42709d3ebcb0a6d9b51c P 73070a828b23480e9c3588e376bce2ab: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/wals/11bd5972700f42709d3ebcb0a6d9b51c
I20260709 12:12:07.379043 21992 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:07.379437 21846 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:07.365602 21847 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:07.415792 22584 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:07.423614 27807 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:12:07.430595 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 88452.8us
I20260709 12:12:07.435223 21736 catalog_manager.cc:5028] TS 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): tablet 11bd5972700f42709d3ebcb0a6d9b51c (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:12:07.441779 22583 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:07.448649 27769 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:07.453392 21994 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:07.458600 27651 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:07.459848 27798 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:07.465574 27795 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:07.467304 27794 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.481952 22584 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.489144 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6e5de589d8b434b87a0bf4f41fb63ba with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:07.492208 21998 raft_consensus.cc:2955] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.518033 21750 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 10 to 11, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 11 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:07.523923 27741 raft_consensus.cc:993] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:12:07.524523 27741 raft_consensus.cc:1081] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Signalling peer cffb5c192e144f7caa7b94271976ed42 to start an election
I20260709 12:12:07.539469 27807 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Committing config change with OpId 16.9: config changed from index 8 to 9, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.547457 22577 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index 8 to 9, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.555167 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet a6e5de589d8b434b87a0bf4f41fb63ba with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:52136
I20260709 12:12:07.568228 21846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
 from {username='slave'} at 127.0.0.1:56610
I20260709 12:12:07.568850 21846 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:07.569211 21846 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:07.590309 27795 raft_consensus.cc:1064] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:12:07.592896 27795 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:07.632987 21992 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index 8 to 9, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:12:07.645725 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 67080.6us
I20260709 12:12:07.653122 21846 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:07.734135 21846 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Requested vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:07.736303 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:07.737038 21992 raft_consensus.cc:3055] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:07.737401 21992 raft_consensus.cc:740] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:07.739032 22584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:07.739684 22584 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:07.739714 21992 consensus_queue.cc:260] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:07.741204 21992 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:07.749506 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 88774.5us
I20260709 12:12:07.755395 21992 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:12:07.757534 21817 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42; no voters: 
I20260709 12:12:07.758737 27651 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:07.759279 27651 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Becoming Leader. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:12:07.760136 27651 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:07.711199 21747 catalog_manager.cc:5697] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 8 to 9, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.771374 22584 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cffb5c192e144f7caa7b94271976ed42 in term 13.
I20260709 12:12:07.778090 21992 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:07.780731 27824 tablet_replica.cc:333] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:07.781898 27824 raft_consensus.cc:2243] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:07.784054 22577 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEARNER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:07.806993 27824 raft_consensus.cc:2272] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:07.798199 27820 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:12:07.821866 27795 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:12:07.846915 27824 ts_tablet_manager.cc:1916] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:07.846704 21846 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index 8 to 9, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.885960 21923 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:07.890507 27794 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:07.901079 21920 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:07.902845 21747 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 reported cstate change: term changed from 12 to 13, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to cffb5c192e144f7caa7b94271976ed42 (127.20.56.65). New cstate: current_term: 13 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:07.929128 22583 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:07.936568 27755 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:07.943148 21994 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:07.949991 27818 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:07.968340 27755 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index 9 to 10, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:07.969794 22583 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:12:07.999941 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 50223.3us
I20260709 12:12:08.009052 21994 raft_consensus.cc:2955] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:08.101267 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d3beb28cf484708af67a4cafaaa657b with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:12:08.109604 27832 log.cc:927] Time spent T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.094s	user 0.003s	sys 0.000s
I20260709 12:12:08.113157 27824 ts_tablet_manager.cc:1929] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 12:12:08.128023 27824 log.cc:1199] T a6e5de589d8b434b87a0bf4f41fb63ba P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/a6e5de589d8b434b87a0bf4f41fb63ba
I20260709 12:12:08.115262 27795 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:08.125985 21747 catalog_manager.cc:5697] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 9 to 10, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 16 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:08.132239 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet a6e5de589d8b434b87a0bf4f41fb63ba (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:12:08.152946 21922 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:08.155524 21750 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 reported cstate change: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:08.187412 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 61125.4us
W20260709 12:12:08.217053 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 94924.5us
I20260709 12:12:08.240062 21841 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d3beb28cf484708af67a4cafaaa657b with delete_type TABLET_DATA_TOMBSTONED (TS cffb5c192e144f7caa7b94271976ed42 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:39424
I20260709 12:12:08.264108 22577 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:08.235030 22583 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:08.278174 21846 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:08.294624 27651 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:08.317261 21996 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:08.329861 22584 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:08.324360 21996 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:08.342489 27795 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:08.354394 27795 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:08.356776 21994 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:12:08.361364 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 246353us
W20260709 12:12:08.389045 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 95771.5us
I20260709 12:12:08.398340 27836 tablet_replica.cc:333] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:08.399566 27836 raft_consensus.cc:2243] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.400382 27836 raft_consensus.cc:2272] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.386878 27749 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:12:08.425783 27836 ts_tablet_manager.cc:1916] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:08.483814 27651 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:12:08.539065 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 61590.4us
I20260709 12:12:08.542461 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:08.548904 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 80854.4us
I20260709 12:12:08.542029 22577 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:08.600073 21747 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: config changed from index 12 to 13, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New cstate: current_term: 15 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:08.604665 21736 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:08.617759 27836 ts_tablet_manager.cc:1929] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.9
I20260709 12:12:08.621181 27836 log.cc:1199] T 4d3beb28cf484708af67a4cafaaa657b P cffb5c192e144f7caa7b94271976ed42: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/wals/4d3beb28cf484708af67a4cafaaa657b
I20260709 12:12:08.627213 21736 catalog_manager.cc:5028] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): tablet 4d3beb28cf484708af67a4cafaaa657b (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
I20260709 12:12:08.697220 21914 tablet_service.cc:1558] Processing DeleteTablet for tablet 81e7a6bdd47e4ede8aa8580b9375a5aa with delete_type TABLET_DATA_TOMBSTONED (TS ecd8f47cd089480aa1f77728a400384a not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:52136
W20260709 12:12:08.718700 21817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 127276us
I20260709 12:12:08.755664 21994 raft_consensus.cc:2955] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ecd8f47cd089480aa1f77728a400384a (127.20.56.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:08.793414 21847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba"
dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
mode: GRACEFUL
new_leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:55856
I20260709 12:12:08.794015 21847 raft_consensus.cc:606] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Received request to transfer leadership to TS ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:08.803747 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:12:08.805576 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:08.806667 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:08.815133 27853 tablet_replica.cc:333] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:08.818843 27853 raft_consensus.cc:2243] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:08.819861 27853 raft_consensus.cc:2272] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:08.825326 27853 ts_tablet_manager.cc:1916] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:08.866753 27853 ts_tablet_manager.cc:1929] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 12:12:08.867233 27853 log.cc:1199] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ecd8f47cd089480aa1f77728a400384a: Deleting WAL directory at /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/wals/81e7a6bdd47e4ede8aa8580b9375a5aa
I20260709 12:12:09.037382 21734 catalog_manager.cc:5028] TS ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): tablet 81e7a6bdd47e4ede8aa8580b9375a5aa (table test-workload [id=972f15b6d1324875aea51ac58b88c06c]) successfully deleted
W20260709 12:12:09.104830 21734 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 67477.4us
W20260709 12:12:09.241294 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 191802us
I20260709 12:12:09.330087 27841 raft_consensus.cc:993] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: : Instructing follower ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:12:09.331297 27841 raft_consensus.cc:1081] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Signalling peer ac07267c8cab47d4b59dc27d6fe9a386 to start an election
I20260709 12:12:09.358191 22581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba"
dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
 from {username='slave'} at 127.0.0.1:33654
I20260709 12:12:09.358868 22581 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.359258 22581 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.368140 22581 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:09.376942 22581 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:09.378068 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "cffb5c192e144f7caa7b94271976ed42"
I20260709 12:12:09.411636 21849 raft_consensus.cc:3055] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:09.412055 21849 raft_consensus.cc:740] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cffb5c192e144f7caa7b94271976ed42, State: Running, Role: LEADER
I20260709 12:12:09.386096 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:09.413612 21997 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:09.403527 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 54964.8us
I20260709 12:12:09.421897 21997 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:12:09.412886 21849 consensus_queue.cc:260] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:09.423756 21849 raft_consensus.cc:3060] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.432029 21849 raft_consensus.cc:2468] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:12:09.434917 22549 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:09.438625 27845 raft_consensus.cc:2804] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:09.439250 27845 raft_consensus.cc:697] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:09.440202 27845 consensus_queue.cc:237] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:09.473289 21750 catalog_manager.cc:5697] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 11 to 12, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 12 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.871582 21927 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:12:09.894168 21893 consensus_peers.cc:597] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f7597e7938d4462a3e662f6b63d059a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:09.901037 21992 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:09.904748 27856 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:09.914877 21849 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:09.917076 27856 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:09.920288 27768 raft_consensus.cc:2955] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:09.921473 21992 raft_consensus.cc:2955] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:09.926343 21994 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:09.927990 27742 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:09.980368 21847 raft_consensus.cc:1275] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:09.990731 27742 consensus_queue.cc:1048] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:10.018844 21948 debug-util.cc:398] Leaking SignalData structure 0x7b080022bc00 after lost signal to thread 20708
W20260709 12:12:10.020470 21948 debug-util.cc:398] Leaking SignalData structure 0x7b0800167e60 after lost signal to thread 21784
W20260709 12:12:10.022843 21948 debug-util.cc:398] Leaking SignalData structure 0x7b0800357380 after lost signal to thread 21876
W20260709 12:12:10.024854 21948 debug-util.cc:398] Leaking SignalData structure 0x7b08001677c0 after lost signal to thread 21951
W20260709 12:12:10.026325 21948 debug-util.cc:398] Leaking SignalData structure 0x7b080031f0a0 after lost signal to thread 22025
W20260709 12:12:10.028632 21948 debug-util.cc:398] Leaking SignalData structure 0x7b080033b660 after lost signal to thread 22608
W20260709 12:12:10.029536 21948 debug-util.cc:398] Leaking SignalData structure 0x7b08002e89a0 after lost signal to thread 27835
I20260709 12:12:10.034536 21750 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:10.076254 21849 raft_consensus.cc:2955] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:12:10.278590 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 165352us
I20260709 12:12:10.345655 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:10.350637 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 51878.3us
W20260709 12:12:10.350696 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 231817us
I20260709 12:12:10.375514 21849 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:12:10.445978 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 59837.7us
W20260709 12:12:10.449564 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 57378.6us
I20260709 12:12:10.461562 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:10.463351 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.464095 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:10.441879 27877 log.cc:927] Time spent T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:12:10.499377 21893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 107665us
W20260709 12:12:10.512768 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 73091.5us
I20260709 12:12:10.524979 27888 ts_tablet_manager.cc:933] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:10.538375 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:10.610461 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 97449.1us
W20260709 12:12:10.642208 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 116890us
W20260709 12:12:10.747547 21818 consensus_peers.cc:597] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3804cba5d43c4079bb7bb28082798098. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.804670 20705 tablet_server.cc:179] TabletServer@127.20.56.65:0 shutting down...
W20260709 12:12:10.809161 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 55117.3us
I20260709 12:12:10.825273 21996 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:12:10.826776 21892 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 12:12:10.920810 27888 tablet_copy_client.cc:323] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
W20260709 12:12:10.928700 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 101965us
W20260709 12:12:10.968782 21892 consensus_peers.cc:597] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.973201 21937 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 9f7597e7938d4462a3e662f6b63d059a from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:12:10.973860 21937 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 9f7597e7938d4462a3e662f6b63d059a from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-9f7597e7938d4462a3e662f6b63d059a
W20260709 12:12:10.971305 21892 consensus_peers.cc:597] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.980157 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 129335us
W20260709 12:12:10.982306 21892 consensus_peers.cc:597] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.982704 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 47862.9us
I20260709 12:12:10.995946 27912 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
W20260709 12:12:11.016959 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 402950us
I20260709 12:12:11.032260 21927 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Refusing update from remote peer cffb5c192e144f7caa7b94271976ed42: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:12:11.040220 21892 consensus_peers.cc:597] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.043104 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 93380us
W20260709 12:12:11.045459 21892 consensus_peers.cc:597] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.060132 21937 tablet_copy_source_session.cc:215] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:11.082042 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7597e7938d4462a3e662f6b63d059a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:11.087117 21892 consensus_peers.cc:597] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.090693 27895 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:11.097240 21892 consensus_peers.cc:597] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.143735 27931 ts_tablet_manager.cc:933] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
W20260709 12:12:11.155253 21966 consensus_peers.cc:597] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.157534 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 62301.3us
W20260709 12:12:11.160921 21966 consensus_peers.cc:597] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.162488 21966 consensus_peers.cc:597] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.164325 21966 consensus_peers.cc:597] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.176477 21892 consensus_peers.cc:597] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.181170 21892 consensus_peers.cc:597] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.184018 21966 consensus_peers.cc:597] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.195487 27911 raft_consensus.cc:2955] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:11.200941 21992 raft_consensus.cc:2955] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:12:11.189673 21966 consensus_peers.cc:597] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.186069 21892 consensus_peers.cc:597] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.204720 21966 consensus_peers.cc:597] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.214730 21966 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.211499 22549 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.215394 21966 consensus_peers.cc:597] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.215618 22549 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.217650 22549 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.216535 21966 consensus_peers.cc:597] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.218366 22549 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.221228 21966 consensus_peers.cc:597] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.225746 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.236155 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.237692 27895 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:11.239132 27895 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.241398 27895 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.242033 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.244024 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47334283cbf402c8d1c42ff7264f7e7" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.246590 27907 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:12:11.247956 22549 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.247231 21927 raft_consensus.cc:2955] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:12:11.251607 22549 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.245697 27931 tablet_copy_client.cc:323] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.65:42093
I20260709 12:12:11.252249 21818 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:11.253475 27908 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.248329 27907 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.256085 27907 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.258985 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.260133 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7076f768c74a41bc54edd6bcaaaf83" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.260382 21750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58738 (request call id 328) took 1255 ms. Trace:
I20260709 12:12:11.265739 21745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58722 (request call id 325) took 1079 ms. Trace:
I20260709 12:12:11.260722 21750 rpcz_store.cc:276] 0709 12:12:10.004892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.017831 (+ 12939us) service_pool.cc:224] Handling call
0709 12:12:11.260301 (+1242470us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:10.614185 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:10.742264 (+128079us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:10.743172 (+   908us) write_op.cc:435] Acquired schema lock
0709 12:12:10.745089 (+  1917us) tablet.cc:662] Decoding operations
0709 12:12:10.814635 (+ 69546us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:10.824401 (+  9766us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:10.830868 (+  6467us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:10.840408 (+  9540us) tablet.cc:701] Row locks acquired
0709 12:12:10.840427 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:12:10.840590 (+   163us) write_op.cc:270] Start()
0709 12:12:10.840707 (+   117us) write_op.cc:276] Timestamp: P: 1783599130840538 usec, L: 0
0709 12:12:10.840731 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:12:10.841434 (+   703us) log.cc:844] Serialized 595 byte log entry
0709 12:12:11.152231 (+310797us) op_driver.cc:464] REPLICATION: finished
0709 12:12:11.208648 (+ 56417us) write_op.cc:301] APPLY: starting
0709 12:12:11.208733 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:11.215745 (+  7012us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:11.219399 (+  3654us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:11.249050 (+ 29651us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:11.252959 (+  3909us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:12:11.253023 (+    64us) write_op.cc:312] APPLY: finished
0709 12:12:11.253236 (+   213us) log.cc:844] Serialized 25 byte log entry
0709 12:12:11.253395 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:11.253476 (+    81us) write_op.cc:454] Released schema lock
0709 12:12:11.253512 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:11.254784 (+  1272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:11.254818 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":56190,"apply.run_cpu_time_us":3871,"apply.run_wall_time_us":46108,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":398294,"prepare.run_cpu_time_us":33296,"prepare.run_wall_time_us":396203,"raft.queue_time_us":182689,"raft.run_cpu_time_us":32078,"raft.run_wall_time_us":66991,"replication_time_us":311308,"thread_start_us":431934,"threads_started":4,"wal-append.queue_time_us":102630}]]}
I20260709 12:12:11.266131 21745 rpcz_store.cc:276] 0709 12:12:10.186783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.186956 (+   173us) service_pool.cc:224] Handling call
0709 12:12:11.265663 (+1078707us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:12:11.273450 21818 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:11.274968 22549 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.276736 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:11.277937 27907 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.274585 27888 tablet_copy_client.cc:806] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:11.302938 27888 tablet_copy_client.cc:670] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:11.305189 21747 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 16 leader_uuid: "cffb5c192e144f7caa7b94271976ed42" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:11.308764 27908 raft_consensus.cc:493] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:11.309378 27908 raft_consensus.cc:515] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:11.311518 27908 leader_election.cc:290] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:11.312523 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.313745 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372e433359ec4224868a6883dfc642e3" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.315639 21815 leader_election.cc:304] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:11.316435 27851 raft_consensus.cc:2749] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.327203 27888 tablet_copy_client.cc:538] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:11.382552 27851 raft_consensus.cc:493] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:11.383116 27851 raft_consensus.cc:515] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:11.385231 27851 leader_election.cc:290] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:11.386304 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.390998 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e031f17c4d400c9fe7c2c101148ff0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.392918 21817 leader_election.cc:304] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:11.403671 27908 raft_consensus.cc:2749] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.408545 27911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53356 (request call id 2) took 1035 ms. Trace:
I20260709 12:12:11.409067 27911 rpcz_store.cc:276] 0709 12:12:10.373184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.373597 (+   413us) service_pool.cc:224] Handling call
0709 12:12:10.390702 (+ 17105us) log.cc:844] Serialized 499 byte log entry
0709 12:12:10.791104 (+400402us) spinlock_profiling.cc:243] Waited 8.79 ms on lock 0x7b54002277a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d14142 00007f3be4cf4eaa 00007f3be4cfbd53 00007f3be4cfbcd9 00007f3be4cfbc69 00007f3be4cfbc31 00007f3be4cfadfd 0000000000388634 0000000000388479 00007f3be1cae475
0709 12:12:10.791742 (+   638us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b54002277a0. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be4d04571 00007f3be4d1bb26 00007f3be4d1549a 00007f3be4d14714 00007f3be4cf4eaa 00007f3be4cfbd53 00007f3be4cfbcd9 00007f3be4cfbc69 00007f3be4cfbc31 00007f3be4cfadfd 0000000000388634
0709 12:12:10.795532 (+  3790us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b2c00014b88. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be3694a11 00007f3be36a3a0a 00007f3be36a3693 00007f3be36a3631 00007f3be4dd7b52 00007f3be4dd7cf5 00007f3be4d14691 00007f3be4cf4eaa 00007f3be4cfbd53 00007f3be4cfbcd9 00007f3be4cfbc69
0709 12:12:11.408423 (+612891us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2689,"raft.queue_time_us":85873,"raft.run_cpu_time_us":14251,"raft.run_wall_time_us":680434,"spinlock_wait_cycles":36503424,"thread_start_us":228946,"threads_started":2,"wal-append.queue_time_us":340597}
W20260709 12:12:11.414402 21798 auto_rebalancer.cc:629] Failed to schedule move for tablet 207491536b034836987ee3a520d08ff6: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:11.419617 21798 auto_rebalancer.cc:629] Failed to schedule move for tablet 01221e34ce744d078265a58313d176a5: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:11.484721 27851 raft_consensus.cc:493] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:11.490607 27851 raft_consensus.cc:515] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.492830 27851 leader_election.cc:290] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.493808 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.507654 27911 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:11.514118 27851 raft_consensus.cc:493] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:11.508271 27911 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.566560 27907 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:11.567214 27907 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.569995 27907 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.571768 27922 raft_consensus.cc:493] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:11.572373 27922 raft_consensus.cc:515] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:11.577512 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.575273 27922 leader_election.cc:290] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:11.602293 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "279111025ee54aba83c27bba63339332" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.607779 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.540915 27851 raft_consensus.cc:515] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.582636 27908 raft_consensus.cc:493] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:11.592077 27888 tablet_bootstrap.cc:492] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:12:11.629163 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a9143d931e458e9c5824195395a69b" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:12:11.626993 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 81207.6us
I20260709 12:12:11.662259 27851 leader_election.cc:290] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.622476 27908 raft_consensus.cc:515] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:11.673524 27908 leader_election.cc:290] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:11.677130 27911 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.678122 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.680737 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.700567 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e7b85a6bcce421ebd09faebda5437e0" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.713352 21815 leader_election.cc:304] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:11.719015 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "209865ca9a104769a09f3a5f4a1e8b79" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.718940 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.722990 27922 raft_consensus.cc:2749] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:11.722347 27908 raft_consensus.cc:493] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:11.729053 27908 raft_consensus.cc:515] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.731253 27908 leader_election.cc:290] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.714315 27924 raft_consensus.cc:493] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:11.733219 27924 raft_consensus.cc:515] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.735338 27924 leader_election.cc:290] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.741634 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.743785 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.757608 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7beebb504f4966b0b73ec1fd85c8d1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.750145 27922 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:11.758473 21817 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:11.760972 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edcbe9f33b9434baee189a40cf203b1" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.770927 27907 raft_consensus.cc:493] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:11.771474 27907 raft_consensus.cc:515] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:11.773554 27907 leader_election.cc:290] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:11.770582 27922 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.775434 27922 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.790267 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.792857 21817 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:11.793640 27911 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:11.797806 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28906331f4545a29562f950eacb999e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.799700 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.788841 27922 raft_consensus.cc:493] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:11.802824 27922 raft_consensus.cc:515] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.804908 27922 leader_election.cc:290] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.796386 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b662199918843a1a8139ac42424d3f6" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.816532 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.821565 21815 leader_election.cc:304] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:11.822779 21815 leader_election.cc:304] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:11.830792 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:11.832734 20705 tablet_replica.cc:333] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:11.833756 20705 raft_consensus.cc:2243] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.838189 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e5283f63d24660b50b74440e20aef8" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.838519 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e6f0a66904748bff04fe46aed7685" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.841476 21815 leader_election.cc:304] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:11.828223 27851 raft_consensus.cc:2749] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:11.844066 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff3fa17120b9481fbb27a63e11e13340" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:11.835927 27924 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.857376 20705 raft_consensus.cc:2272] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.824576 27908 raft_consensus.cc:493] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:11.865638 27941 raft_consensus.cc:2749] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:11.849054 27895 raft_consensus.cc:2749] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:11.880375 20705 tablet_replica.cc:333] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:11.881309 20705 raft_consensus.cc:2243] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.882330 20705 raft_consensus.cc:2272] T f1837f1c346048738233aa4a75fc384d P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.875276 27908 raft_consensus.cc:515] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.892532 27908 leader_election.cc:290] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:11.900066 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 73408.1us
I20260709 12:12:11.903376 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.916347 20705 tablet_replica.cc:333] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:11.917389 20705 raft_consensus.cc:2243] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:11.911187 27908 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:11.923755 27908 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.930617 20705 raft_consensus.cc:2272] T 207491536b034836987ee3a520d08ff6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.933974 20705 tablet_replica.cc:333] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:11.935211 20705 raft_consensus.cc:2243] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:11.935971 20705 raft_consensus.cc:2272] T 1e7b85a6bcce421ebd09faebda5437e0 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.949647 27908 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.964574 27908 raft_consensus.cc:493] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:11.965199 27908 raft_consensus.cc:515] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:11.978453 21818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 48680.3us
I20260709 12:12:11.980343 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.967484 27908 leader_election.cc:290] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:11.982488 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:11.984444 27948 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:11.985080 27948 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:11.987187 27948 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:11.984669 20705 tablet_replica.cc:333] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:11.991278 20705 raft_consensus.cc:2243] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:11.991714 21815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 149291us
I20260709 12:12:11.991963 20705 raft_consensus.cc:2272] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:11.994385 21815 leader_election.cc:304] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:11.995250 27922 raft_consensus.cc:2749] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.996006 27922 raft_consensus.cc:493] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:11.996486 27922 raft_consensus.cc:515] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:11.998729 27922 leader_election.cc:290] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:12.000134 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5de589d8b434b87a0bf4f41fb63ba" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:12.001142 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:12.001487 21815 leader_election.cc:304] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.002238 27922 raft_consensus.cc:2749] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.003271 27922 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:12.003716 27922 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:12.004985 27946 raft_consensus.cc:493] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:12.005622 27922 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:12.005510 27946 raft_consensus.cc:515] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:12.006835 27922 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:12.007316 27922 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:12.007632 27946 leader_election.cc:290] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:12.010344 21927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b43b3517064c3b81e50b88c21938ce" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.011096 27922 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:12.011380 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11bd5972700f42709d3ebcb0a6d9b51c" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:11.996484 27908 raft_consensus.cc:493] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:12.014178 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba6603cbc59405eabb68cb5355bb01e" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.018137 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:12.018559 27948 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:12.028244 27908 raft_consensus.cc:515] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:12.028671 27948 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:12.040297 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:12.017581 21817 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:12.022850 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:12.027422 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc81c27d5d3424db1dfbfc977e0369d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.042304 27948 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:12.042898 27948 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:12.042986 21817 leader_election.cc:304] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.043409 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:12:12.043867 21817 raft_consensus.cc:2686] T f2e5283f63d24660b50b74440e20aef8 P cffb5c192e144f7caa7b94271976ed42: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:12.036280 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.044667 21817 leader_election.cc:304] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:12:12.045265 21817 raft_consensus.cc:2686] T ff3fa17120b9481fbb27a63e11e13340 P cffb5c192e144f7caa7b94271976ed42: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:12.031453 27908 leader_election.cc:290] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:12.021485 20705 tablet_replica.cc:333] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.047158 20705 raft_consensus.cc:2243] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.051188 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d50c36e857cb4e33997aee7e5dd39447" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.058836 21817 leader_election.cc:304] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:12.064755 27946 raft_consensus.cc:2749] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.071632 20705 raft_consensus.cc:2272] T 6edcbe9f33b9434baee189a40cf203b1 P cffb5c192e144f7caa7b94271976ed42 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.075353 20705 tablet_replica.cc:333] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.075232 27908 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:12.077564 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5937d593814d4b568742fc86c954922d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:12.077708 27908 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:12.079677 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f4600c62493468899ff64fcf08d4fbe" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:12.076295 20705 raft_consensus.cc:2243] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.082739 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:12.083452 20705 raft_consensus.cc:2272] T a6e5de589d8b434b87a0bf4f41fb63ba P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.084178 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9858619e3a4ae383caadbb133747bc" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.086166 27908 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:12.093288 20705 tablet_replica.cc:333] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.094201 20705 raft_consensus.cc:2243] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.094770 20705 raft_consensus.cc:2272] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.098496 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:12.100402 27908 raft_consensus.cc:493] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:12.100950 27908 raft_consensus.cc:515] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:12.102989 27908 leader_election.cc:290] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:12.103960 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:12.105857 27946 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:12.106688 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae741cd77e441b281f9ed48a672f87d" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:12.106467 27946 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:12.108057 21817 leader_election.cc:304] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:12.108623 27946 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:12.109086 27948 raft_consensus.cc:2749] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.109534 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:12.111474 21815 leader_election.cc:304] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.112270 27911 raft_consensus.cc:2749] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.119801 27888 tablet_bootstrap.cc:492] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:12.126540 21815 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.126888 20705 tablet_replica.cc:333] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.127420 27911 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.127813 21815 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.128582 27911 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.129027 21815 leader_election.cc:304] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.131392 27911 raft_consensus.cc:2749] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.132628 21815 leader_election.cc:304] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.133352 27911 raft_consensus.cc:2749] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:12.134668 20705 raft_consensus.cc:2243] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.134584 21815 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:12.135761 21815 raft_consensus.cc:2686] T 5937d593814d4b568742fc86c954922d P cffb5c192e144f7caa7b94271976ed42: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:12.136590 21815 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.135419 27888 tablet_bootstrap.cc:492] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:12:12.137956 27888 ts_tablet_manager.cc:1403] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.590s	user 0.043s	sys 0.028s
I20260709 12:12:12.135394 20705 raft_consensus.cc:2272] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.138852 27911 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:12.140232 21815 leader_election.cc:304] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.140961 27908 raft_consensus.cc:2749] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.142998 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.150652 27888 raft_consensus.cc:359] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:12.151568 27888 raft_consensus.cc:740] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:12:12.157146 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ec2fd4639346c6b0a138de0c31852f" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.162277 20705 tablet_replica.cc:333] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.163192 20705 raft_consensus.cc:2243] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.182539 20705 raft_consensus.cc:2272] T 032f8014213a49d395c150ebc9f55752 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.152292 27888 consensus_queue.cc:260] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:12.185734 27888 ts_tablet_manager.cc:1434] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:12:12.193867 21937 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-9f7597e7938d4462a3e662f6b63d059a received from {username='slave'} at 127.0.0.1:46426
I20260709 12:12:12.194330 21937 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-9f7597e7938d4462a3e662f6b63d059a on tablet 9f7597e7938d4462a3e662f6b63d059a with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:12.194756 20705 tablet_replica.cc:333] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.195748 20705 raft_consensus.cc:2243] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.196739 20705 raft_consensus.cc:2272] T 1d3f324c9e584d26829ebc2cadc84629 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.197824 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2003af45914197b88e4cc3389271af" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.222668 20705 tablet_replica.cc:333] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.225416 20705 raft_consensus.cc:2243] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.236553 20705 raft_consensus.cc:2272] T 3804cba5d43c4079bb7bb28082798098 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.248443 21815 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.245095 27908 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:12.250788 27908 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:12.251026 21815 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:12.251904 21815 raft_consensus.cc:2686] T 87ec2fd4639346c6b0a138de0c31852f P cffb5c192e144f7caa7b94271976ed42: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:12.254117 27946 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.254068 21815 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.255899 27946 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:12.256273 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:12.248642 27911 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:12.257915 27911 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:12.259375 21925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3732a691799e4f2abfe58158cddce045" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.260094 27911 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:12.264555 21815 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.252943 27908 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:12.266635 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.269356 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93911a59a2c46bb9745487e082af441" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:12.271241 27908 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.275274 20705 tablet_replica.cc:333] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.279767 20705 raft_consensus.cc:2243] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.282717 27908 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:12.283362 20705 raft_consensus.cc:2272] T d28906331f4545a29562f950eacb999e P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.285149 21815 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.283430 27908 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:12.286888 27911 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.289525 27908 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:12.289709 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:12.291039 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947619c833644483a9745291e5d8ba38" candidate_uuid: "cffb5c192e144f7caa7b94271976ed42" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:12.294384 20705 tablet_replica.cc:333] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.295776 21815 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cffb5c192e144f7caa7b94271976ed42; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.298343 27908 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.300020 20705 raft_consensus.cc:2243] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.300689 20705 raft_consensus.cc:2272] T dae741cd77e441b281f9ed48a672f87d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.303608 20705 tablet_replica.cc:333] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.305377 20705 raft_consensus.cc:2243] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.311723 20705 raft_consensus.cc:2272] T 11bd5972700f42709d3ebcb0a6d9b51c P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.326851 20705 tablet_replica.cc:333] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.327679 20705 raft_consensus.cc:2243] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.328327 20705 raft_consensus.cc:2272] T 947619c833644483a9745291e5d8ba38 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.330830 20705 tablet_replica.cc:333] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.331816 20705 raft_consensus.cc:2243] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.332423 20705 raft_consensus.cc:2272] T cba6603cbc59405eabb68cb5355bb01e P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.336853 20705 tablet_replica.cc:333] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.337639 20705 raft_consensus.cc:2243] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.338605 20705 raft_consensus.cc:2272] T c2526f3581f34316a1eb1e329b5d5af9 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.340998 20705 tablet_replica.cc:333] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.343835 20705 raft_consensus.cc:2243] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.346016 20705 raft_consensus.cc:2272] T 81e7a6bdd47e4ede8aa8580b9375a5aa P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.348753 20705 tablet_replica.cc:333] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.349560 20705 raft_consensus.cc:2243] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.350255 20705 raft_consensus.cc:2272] T 68b43b3517064c3b81e50b88c21938ce P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.356273 20705 tablet_replica.cc:333] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.357053 20705 raft_consensus.cc:2243] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.357652 20705 raft_consensus.cc:2272] T 372e433359ec4224868a6883dfc642e3 P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.360387 20705 tablet_replica.cc:333] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.361146 20705 raft_consensus.cc:2243] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.362195 20705 raft_consensus.cc:2272] T 8145e629270b44a298b6e1c1b249989f P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.367522 20705 tablet_replica.cc:333] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.369516 20705 raft_consensus.cc:2243] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.370106 20705 raft_consensus.cc:2272] T e47334283cbf402c8d1c42ff7264f7e7 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.387916 20705 tablet_replica.cc:333] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.388774 20705 raft_consensus.cc:2243] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.389385 20705 raft_consensus.cc:2272] T 2e7beebb504f4966b0b73ec1fd85c8d1 P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.395372 22581 raft_consensus.cc:1217] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 12:12:12.438694 20705 tablet_replica.cc:333] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.439587 20705 raft_consensus.cc:2243] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.440182 20705 raft_consensus.cc:2272] T 5e2003af45914197b88e4cc3389271af P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.443068 20705 tablet_replica.cc:333] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.443871 20705 raft_consensus.cc:2243] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.445101 20705 raft_consensus.cc:2272] T 8fce2d558023440ebf41a6f0ed6a062b P cffb5c192e144f7caa7b94271976ed42 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.455358 20705 tablet_replica.cc:333] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.456136 20705 raft_consensus.cc:2243] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.456701 20705 raft_consensus.cc:2272] T 3732a691799e4f2abfe58158cddce045 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.459314 20705 tablet_replica.cc:333] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.460041 20705 raft_consensus.cc:2243] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.460630 20705 raft_consensus.cc:2272] T d50c36e857cb4e33997aee7e5dd39447 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.463363 20705 tablet_replica.cc:333] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.464085 20705 raft_consensus.cc:2243] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.464577 20705 raft_consensus.cc:2272] T 279111025ee54aba83c27bba63339332 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.467070 20705 tablet_replica.cc:333] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.467775 20705 raft_consensus.cc:2243] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.468789 20705 raft_consensus.cc:2272] T ae7bfef0e495480e843989cbb71b4330 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.477540 20705 tablet_replica.cc:333] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.478261 20705 raft_consensus.cc:2243] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.483027 20705 raft_consensus.cc:2272] T fe6b96986b574ee88589e15157b5260b P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.485782 20705 tablet_replica.cc:333] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.486591 20705 raft_consensus.cc:2243] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.487118 20705 raft_consensus.cc:2272] T f74e6f0a66904748bff04fe46aed7685 P cffb5c192e144f7caa7b94271976ed42 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.489589 20705 tablet_replica.cc:333] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.490283 20705 raft_consensus.cc:2243] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.490933 20705 raft_consensus.cc:2272] T c93911a59a2c46bb9745487e082af441 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.493402 20705 tablet_replica.cc:333] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.494112 20705 raft_consensus.cc:2243] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.495071 20705 raft_consensus.cc:2272] T 01221e34ce744d078265a58313d176a5 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.499584 20705 tablet_replica.cc:333] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.500385 20705 raft_consensus.cc:2243] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.500986 20705 raft_consensus.cc:2272] T 3a7076f768c74a41bc54edd6bcaaaf83 P cffb5c192e144f7caa7b94271976ed42 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.503691 20705 tablet_replica.cc:333] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.504422 20705 raft_consensus.cc:2243] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.504961 20705 raft_consensus.cc:2272] T 03e031f17c4d400c9fe7c2c101148ff0 P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.507815 20705 tablet_replica.cc:333] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.508564 20705 raft_consensus.cc:2243] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.509176 20705 raft_consensus.cc:2272] T 1cc81c27d5d3424db1dfbfc977e0369d P cffb5c192e144f7caa7b94271976ed42 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.511999 20705 tablet_replica.cc:333] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.512732 20705 raft_consensus.cc:2243] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.513787 20705 raft_consensus.cc:2272] T fbfd595fdbf3470193f7cd91b4969857 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.516499 20705 tablet_replica.cc:333] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.517267 20705 raft_consensus.cc:2243] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.517844 20705 raft_consensus.cc:2272] T 3b662199918843a1a8139ac42424d3f6 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.525069 20705 tablet_replica.cc:333] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.525787 20705 raft_consensus.cc:2243] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.526329 20705 raft_consensus.cc:2272] T 2f4600c62493468899ff64fcf08d4fbe P cffb5c192e144f7caa7b94271976ed42 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.530937 20705 tablet_replica.cc:333] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.531697 20705 raft_consensus.cc:2243] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.532774 20705 raft_consensus.cc:2272] T 3849f2f975df439d82d57276c716d6b8 P cffb5c192e144f7caa7b94271976ed42 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.535775 20705 tablet_replica.cc:333] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.536562 20705 raft_consensus.cc:2243] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.537218 20705 raft_consensus.cc:2272] T 9f7597e7938d4462a3e662f6b63d059a P cffb5c192e144f7caa7b94271976ed42 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.540159 20705 tablet_replica.cc:333] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.540884 20705 raft_consensus.cc:2243] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.541561 20705 raft_consensus.cc:2272] T 209865ca9a104769a09f3a5f4a1e8b79 P cffb5c192e144f7caa7b94271976ed42 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.544049 20705 tablet_replica.cc:333] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.544664 20705 raft_consensus.cc:2243] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.545195 20705 raft_consensus.cc:2272] T 3e9858619e3a4ae383caadbb133747bc P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.547693 20705 tablet_replica.cc:333] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.548293 20705 raft_consensus.cc:2243] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:12.551616 20705 raft_consensus.cc:2272] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.554381 20705 tablet_replica.cc:333] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42: stopping tablet replica
I20260709 12:12:12.555066 20705 raft_consensus.cc:2243] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:12.555648 20705 raft_consensus.cc:2272] T 77a9143d931e458e9c5824195395a69b P cffb5c192e144f7caa7b94271976ed42 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:12.754125 27931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33654 (request call id 1400) took 1687 ms. Trace:
I20260709 12:12:12.754581 27931 rpcz_store.cc:276] 0709 12:12:11.066232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.066358 (+   126us) service_pool.cc:224] Handling call
0709 12:12:11.144290 (+ 77932us) ts_tablet_manager.cc:934] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093)
0709 12:12:11.167014 (+ 22724us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f3be1c7c343 00007f3be1c7c240 00007f3be160b1d4 00007f3beb349304 00007f3beb349299 00007f3be1b36db1 00007f3be1bd4c85 00007f3be1bd56a2 00007f3be49471db 00007f3be4942aaf 00007f3be1c910ac 00007f3beaaeb9a9 00007f3be1cad69b 00007f3be1caacaa 00007f3be1caabd2 00007f3be9d0f131
0709 12:12:12.754027 (+1587013us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":18093,"spinlock_wait_cycles":8377600,"tablet-copy.queue_time_us":76743,"thread_start_us":156300,"threads_started":2}
W20260709 12:12:12.756258 22548 connection.cc:466] server connection from 127.0.0.1:33654 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33654 (request call id 1400) could send its response
I20260709 12:12:12.832962 27936 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:12.833515 27936 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:12.835592 27936 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:12.841559 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:12:12.857482 21892 leader_election.cc:336] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:12.858007 21892 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:12.860014 27936 raft_consensus.cc:2749] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.957827 27936 raft_consensus.cc:1064] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:12:12.963452 27936 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:12.993245 27843 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:12.993839 27843 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:12.997419 22581 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:13.001505 21994 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:13.002710 27936 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:13.003644 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:12:13.005080 21892 consensus_peers.cc:597] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.006117 27936 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:13.016686 21966 leader_election.cc:336] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.017207 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:12.996165 27843 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:13.026607 27843 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:13.074936 27936 raft_consensus.cc:2955] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:13.082345 22581 raft_consensus.cc:2955] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:13.106750 27837 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.106101 21994 raft_consensus.cc:2955] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:13.107345 27837 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.111676 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:13.112304 27837 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:13.114872 21966 leader_election.cc:336] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.115551 21966 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.117342 27837 raft_consensus.cc:2749] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:13.119370 21892 consensus_peers.cc:597] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.124106 21746 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.145880 27936 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.146575 27936 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.148741 27936 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.152181 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.152848 21994 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
W20260709 12:12:13.157330 21892 leader_election.cc:336] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.158186 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.159216 27936 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:13.159610 27936 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.159966 27936 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:13.166144 21966 consensus_peers.cc:597] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.183928 27936 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.189908 27936 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.195732 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207491536b034836987ee3a520d08ff6" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:13.196503 21994 raft_consensus.cc:3060] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:13.216156 21892 leader_election.cc:336] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.217134 21994 raft_consensus.cc:2468] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:12:13.218483 21892 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.222616 27936 raft_consensus.cc:2804] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:13.223376 27936 raft_consensus.cc:697] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:13.224901 27837 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.225449 27837 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.229470 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:12:13.229800 21966 consensus_peers.cc:597] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.230113 21920 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:12:13.227192 27936 consensus_queue.cc:237] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.232367 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:13.233151 27957 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:13.233527 27957 raft_consensus.cc:493] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.234699 27957 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:13.238317 22549 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.239850 21966 leader_election.cc:336] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.240834 27837 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:13.248637 27957 raft_consensus.cc:515] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:12:13.261575 21966 consensus_peers.cc:597] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.263989 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1837f1c346048738233aa4a75fc384d" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:13.264878 21920 raft_consensus.cc:3060] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:13.267915 21966 leader_election.cc:336] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.266710 27957 leader_election.cc:290] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:13.274729 21966 consensus_peers.cc:597] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.295503 21920 raft_consensus.cc:2468] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 18.
I20260709 12:12:13.296868 21964 leader_election.cc:304] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.298256 27957 raft_consensus.cc:2804] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:13.299232 27957 raft_consensus.cc:697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:13.300105 27957 consensus_queue.cc:237] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:12:13.318445 21892 consensus_peers.cc:597] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.360343 21892 consensus_peers.cc:597] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.388067 22549 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.402920 21892 consensus_peers.cc:597] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.403380 21920 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:13.416416 21966 consensus_peers.cc:597] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.417013 21966 consensus_peers.cc:597] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.418681 21994 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:13.425472 27875 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:13.413583 21747 catalog_manager.cc:5697] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 17 to 18, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 18 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.440896 27875 raft_consensus.cc:2955] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:13.464488 21994 raft_consensus.cc:2955] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:12:13.435444 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.467101 22549 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.472455 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.476603 21892 consensus_peers.cc:597] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.465559 21746 catalog_manager.cc:5697] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 12 to 13, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 13 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:13.490566 21966 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.494531 22549 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.502833 27843 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.505906 21745 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 12 to 13, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:13.507671 27957 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.507710 27843 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.508436 27957 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.510003 27843 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:13.511453 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
W20260709 12:12:13.521600 21966 consensus_peers.cc:597] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.511173 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:12:13.528528 21966 leader_election.cc:336] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.510380 27957 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:13.516183 27936 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.530745 21967 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.530604 27936 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.532526 27957 raft_consensus.cc:2749] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:13.533327 27936 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:13.534329 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 52670.4us
I20260709 12:12:13.539672 27936 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.540221 27936 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:12:13.541635 22549 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.542129 22549 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.542968 21734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f7597e7938d4462a3e662f6b63d059a with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:13.542353 27936 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:13.542553 22549 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.554250 21892 leader_election.cc:336] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:13.558013 21892 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.562592 22581 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:13.566468 27928 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.567067 27928 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.569172 27928 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.571841 27875 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:13.577597 21892 consensus_peers.cc:597] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.529088 21966 leader_election.cc:336] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.578817 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:13.579406 22549 leader_election.cc:336] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:13.579653 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50584.9us
I20260709 12:12:13.580435 27957 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:13.581775 27843 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.582302 27843 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.583120 27957 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.585315 27957 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.587641 27957 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:13.591185 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:13.591955 21920 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:12:13.594255 21964 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:13.595079 27837 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:13.595499 27837 raft_consensus.cc:493] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.595885 27837 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:13.610074 21736 catalog_manager.cc:4755] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9f7597e7938d4462a3e662f6b63d059a: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.611258 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.611699 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:13.611899 21994 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 19.
I20260709 12:12:13.615178 27843 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:13.591161 22581 raft_consensus.cc:2955] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:12:13.620141 21892 consensus_peers.cc:597] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.624822 27837 raft_consensus.cc:515] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:12:13.625294 21892 consensus_peers.cc:597] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.626241 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.627269 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.633648 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.635686 27957 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.638218 27957 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.638809 21994 raft_consensus.cc:2393] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd8f47cd089480aa1f77728a400384a in current term 14: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:12:13.640489 27957 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:13.635865 27843 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.642303 27892 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:13.642027 27843 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.642766 27892 raft_consensus.cc:493] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.643193 27892 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.645342 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:13.646453 27957 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.648663 27968 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.648818 27957 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.649227 27968 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.651378 27968 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:13.648269 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.646703 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:13.651854 27892 raft_consensus.cc:515] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:13.636088 21966 consensus_peers.cc:597] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.657109 27837 leader_election.cc:290] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:13.662322 27936 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.672092 27936 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.674142 27837 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.674966 27837 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.654695 27843 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:13.674221 27936 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:13.675328 22549 leader_election.cc:336] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:13.676873 22549 leader_election.cc:336] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.670161 22581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:13.663466 27957 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:13.677799 20705 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21873)
I20260709 12:12:13.678284 27837 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:13.684930 21892 consensus_peers.cc:597] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.689438 27892 leader_election.cc:290] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.693853 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8145e629270b44a298b6e1c1b249989f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:13.694489 21920 raft_consensus.cc:3060] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:13.694506 21892 leader_election.cc:336] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.695734 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.697333 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.698158 21994 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:12:13.699052 27936 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.700475 21892 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd8f47cd089480aa1f77728a400384a; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.701363 21920 raft_consensus.cc:2468] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:12:13.701496 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.701894 27936 raft_consensus.cc:2749] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:13.702145 21996 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:12:13.705485 27970 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.706140 27970 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:13.707279 27837 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.708418 27970 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:13.709920 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:13.711643 27837 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.714331 27837 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:13.714879 27892 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.714883 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:13.715550 27892 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.716686 22577 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:12:13.718181 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a" is_pre_election: true
I20260709 12:12:13.718786 21924 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
I20260709 12:12:13.722923 27892 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.723325 21967 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:12:13.725569 22549 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.726322 27892 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.727238 27957 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.727588 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3f324c9e584d26829ebc2cadc84629" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:13.728014 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.728271 21994 raft_consensus.cc:3060] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:13.728993 21966 consensus_peers.cc:597] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.729487 21966 leader_election.cc:336] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.729933 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.730666 27837 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:13.731825 21966 leader_election.cc:336] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:13.732504 21966 consensus_peers.cc:597] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.733152 21964 leader_election.cc:304] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:13.734328 27837 raft_consensus.cc:2804] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:13.735051 21994 raft_consensus.cc:2468] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 20.
I20260709 12:12:13.727654 27957 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.735492 27837 raft_consensus.cc:697] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:13.735894 27957 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.736593 27837 consensus_queue.cc:237] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.737123 27936 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.737682 27936 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.740389 27875 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.740947 27875 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.742486 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:13.742956 27875 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.743185 27843 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:13.743615 27843 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.743960 27843 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.744874 27936 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.726869 27892 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.754351 27843 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:13.759095 27843 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:13.775882 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.776791 27968 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:13.777184 27968 raft_consensus.cc:493] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.777545 27968 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:13.780776 22549 leader_election.cc:336] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:13.782539 21966 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.785713 27968 raft_consensus.cc:515] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.785389 21745 catalog_manager.cc:5697] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 13 to 14, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 14 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.786274 27957 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.789317 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e7a6bdd47e4ede8aa8580b9375a5aa" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:13.789578 27968 leader_election.cc:290] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.789865 22577 raft_consensus.cc:3060] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.790727 21996 raft_consensus.cc:2393] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac07267c8cab47d4b59dc27d6fe9a386 in current term 16: Already voted for candidate 73070a828b23480e9c3588e376bce2ab in this term.
I20260709 12:12:13.796957 22577 raft_consensus.cc:2468] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
I20260709 12:12:13.798089 21967 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:13.799050 27837 raft_consensus.cc:2804] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:13.799469 21964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 43508us
I20260709 12:12:13.799685 27837 raft_consensus.cc:697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 16 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:13.801126 21920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
I20260709 12:12:13.800806 27837 consensus_queue.cc:237] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.801707 21920 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.803701 27892 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.810259 21920 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:12:13.810680 22549 leader_election.cc:304] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.813812 27968 raft_consensus.cc:2804] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:13.817121 27968 raft_consensus.cc:697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:13.783025 21966 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:13.818909 27970 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:13.820017 21966 leader_election.cc:336] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:13.820729 21966 leader_election.cc:336] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.821080 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:13.821727 27972 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.827659 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.817979 27968 consensus_queue.cc:237] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:13.829190 21966 leader_election.cc:336] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.829656 21966 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.830299 27936 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:13.830730 27936 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.831086 27936 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:13.836642 21892 leader_election.cc:336] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:13.838510 21892 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.838903 27957 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:13.847687 27936 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.850147 27966 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.850592 27970 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.850744 27966 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.852101 21964 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:13.852758 27966 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.854563 27843 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:13.854671 22549 leader_election.cc:336] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.855106 27843 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:13.855958 27843 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:13.856981 27936 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.862618 21745 catalog_manager.cc:5697] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 19 to 20, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 20 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:13.869494 21966 leader_election.cc:336] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.870087 21966 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:13.882387 21892 consensus_peers.cc:597] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.882628 27843 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:13.887185 21996 raft_consensus.cc:1275] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:13.887867 27968 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.888443 27968 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.888698 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.889334 21996 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 12.
I20260709 12:12:13.890515 27968 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.890553 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.891280 21996 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
W20260709 12:12:13.897673 22549 leader_election.cc:336] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.897850 21920 raft_consensus.cc:1275] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:13.901499 27976 consensus_queue.cc:1048] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:13.908933 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.909777 21996 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:12:13.912947 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032f8014213a49d395c150ebc9f55752" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:13.913611 21996 raft_consensus.cc:3060] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.922255 27976 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.922883 27976 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.925077 27976 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:13.926630 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:13.928089 22549 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:12:13.931031 21892 leader_election.cc:336] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.932301 27968 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:13.931559 21892 leader_election.cc:336] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.934928 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3849f2f975df439d82d57276c716d6b8" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:13.935590 21994 raft_consensus.cc:3060] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.937758 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.938400 21997 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:12:13.939090 27966 consensus_queue.cc:1048] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:13.940104 27968 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.940668 27968 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.940902 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.942322 27966 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:13.942708 27966 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.943063 27966 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:13.943590 27968 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.944108 21994 raft_consensus.cc:2468] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
W20260709 12:12:13.950664 22549 leader_election.cc:336] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.951722 21996 raft_consensus.cc:2468] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
I20260709 12:12:13.952396 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:13.953893 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.954478 21994 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 17.
I20260709 12:12:13.955284 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:13.955847 21996 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 19.
I20260709 12:12:13.956888 27936 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:13.957278 27936 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.958343 27936 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.961866 27892 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:13.962401 27892 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:13.964524 27892 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:13.974195 22549 leader_election.cc:336] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:13.976321 27966 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.984916 27966 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:13.997417 27936 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:13.999372 27936 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:14.001415 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 44848.6us
W20260709 12:12:14.002019 21966 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:14.002840 21966 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:14.003788 21966 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:14.005296 21966 consensus_peers.cc:597] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.032394 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:14.033341 27968 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:14.033761 27968 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:14.034166 27968 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.034197 22549 leader_election.cc:304] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:14.035322 27892 raft_consensus.cc:2804] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:14.035794 27892 raft_consensus.cc:697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:14.036645 27892 consensus_queue.cc:237] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:14.037598 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 80477.9us
I20260709 12:12:14.041114 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:14.042348 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
W20260709 12:12:14.042969 21966 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:14.044036 27965 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:14.044799 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:14.044932 21892 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:14.044454 27965 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:14.045734 27965 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.045220 21745 catalog_manager.cc:5697] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 15 to 16, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 16 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.047019 21745 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 16 to 17, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 17 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.049034 27981 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:14.049463 27981 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
W20260709 12:12:14.048965 21966 leader_election.cc:336] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:14.050258 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:14.053223 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:14.051513 27981 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.053076 27976 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:14.061021 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01221e34ce744d078265a58313d176a5" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:14.061612 21992 raft_consensus.cc:3060] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:14.051644 27928 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:14.062666 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:14.058147 27897 raft_consensus.cc:2804] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:14.066715 21999 raft_consensus.cc:3060] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:14.072813 21996 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:12:14.065168 27928 raft_consensus.cc:493] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:14.077571 27928 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:14.080331 27965 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:14.102586 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 46983.5us
I20260709 12:12:14.088379 27897 raft_consensus.cc:697] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:14.114066 21992 raft_consensus.cc:2468] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 13.
I20260709 12:12:14.131924 27968 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:14.136696 27897 consensus_queue.cc:237] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:14.156594 27981 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:14.159526 27981 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:14.171104 27968 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:14.173557 21992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:12:14.174350 21992 raft_consensus.cc:606] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Received request to transfer leadership
I20260709 12:12:14.175858 27965 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:14.178958 21992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:12:14.179669 21992 raft_consensus.cc:606] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Received request to transfer leadership
I20260709 12:12:14.183317 21992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098"
dest_uuid: "73070a828b23480e9c3588e376bce2ab"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:12:14.183936 21992 raft_consensus.cc:606] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Received request to transfer leadership
I20260709 12:12:14.184932 21999 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 15.
I20260709 12:12:14.162249 27928 raft_consensus.cc:515] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:14.188658 27928 leader_election.cc:290] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:14.261169 21992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:14.261883 21992 raft_consensus.cc:3060] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.262676 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:14.264431 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:14.265252 21999 raft_consensus.cc:3060] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:14.265311 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 178620us
I20260709 12:12:14.269003 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fce2d558023440ebf41a6f0ed6a062b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:14.269785 21996 raft_consensus.cc:3060] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:14.258440 21745 catalog_manager.cc:5697] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 13 to 14, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 14 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.281584 21996 raft_consensus.cc:2468] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 20.
I20260709 12:12:14.281808 21992 raft_consensus.cc:2468] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 14.
I20260709 12:12:14.283861 27965 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:14.287313 27965 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cffb5c192e144f7caa7b94271976ed42)
I20260709 12:12:14.287734 27965 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:14.295879 27965 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:14.290287 22547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:34757, user_credentials={real_user=slave}} blocked reactor thread for 186234us
I20260709 12:12:14.298512 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bfef0e495480e843989cbb71b4330" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:14.301868 21996 raft_consensus.cc:3060] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.312302 21999 raft_consensus.cc:2468] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 18.
I20260709 12:12:14.322274 22549 leader_election.cc:304] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:14.325773 21892 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:14.328483 21996 raft_consensus.cc:2468] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 14.
I20260709 12:12:14.332026 27875 raft_consensus.cc:2804] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:14.332829 27875 raft_consensus.cc:697] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:14.333959 27875 consensus_queue.cc:237] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:14.335971 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:14.336684 21994 raft_consensus.cc:3060] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:14.337507 21925 raft_consensus.cc:1275] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:14.329375 22549 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:14.330186 27983 raft_consensus.cc:2804] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:14.340416 27983 raft_consensus.cc:697] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:14.341293 27983 consensus_queue.cc:237] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:14.342725 27986 raft_consensus.cc:2804] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:14.343276 27986 raft_consensus.cc:697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:14.344130 27986 consensus_queue.cc:237] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:14.338755 21892 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:14.350095 27993 raft_consensus.cc:2804] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:14.339097 22549 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:14.351805 22577 raft_consensus.cc:1275] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:14.353156 21994 raft_consensus.cc:2468] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:12:14.352384 21892 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: 
I20260709 12:12:14.360638 27897 raft_consensus.cc:2804] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:14.360713 27976 consensus_queue.cc:1048] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:14.361593 27897 raft_consensus.cc:697] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:14.363070 27892 raft_consensus.cc:2804] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:14.362675 27897 consensus_queue.cc:237] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:14.363647 27892 raft_consensus.cc:697] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:14.364622 27892 consensus_queue.cc:237] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:14.298390 27965 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:14.350894 27993 raft_consensus.cc:697] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:14.381237 22549 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:12:14.387941 22549 leader_election.cc:336] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:14.388756 22549 leader_election.cc:336] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:14.390775 22549 leader_election.cc:336] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:14.395522 21892 leader_election.cc:336] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:14.396238 21892 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:14.402940 22549 leader_election.cc:336] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:14.391170 21745 catalog_manager.cc:5697] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 14 to 15, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 15 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.402184 27990 raft_consensus.cc:2804] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:12:14.420467 21967 consensus_peers.cc:597] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3804cba5d43c4079bb7bb28082798098. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.384092 27976 consensus_queue.cc:1048] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:12:14.443867 27993 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:12:14.555565 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.531240 27990 raft_consensus.cc:697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
W20260709 12:12:14.580585 21798 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:12:14.580976 21798 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 3804cba5d43c4079bb7bb28082798098 already in progress
W20260709 12:12:14.581254 21798 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 3804cba5d43c4079bb7bb28082798098 already in progress
W20260709 12:12:14.582175 28001 log.cc:927] Time spent T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: Append to log took a long time: real 0.191s	user 0.003s	sys 0.002s
I20260709 12:12:14.590582 21925 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:14.595242 27970 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:14.599068 21892 leader_election.cc:336] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:14.599660 27990 consensus_queue.cc:237] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:14.611114 21966 consensus_peers.cc:597] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:14.612210 21966 consensus_peers.cc:597] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.635905 21999 raft_consensus.cc:1275] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 20 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:12:14.636488 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.639820 21747 catalog_manager.cc:5697] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 13 to 14, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 14 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.643592 21747 catalog_manager.cc:5697] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 19 to 20, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 20 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.641238 21746 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 14 to 15, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 15 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.645831 21746 catalog_manager.cc:5697] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 12 to 13, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 13 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.647989 21746 catalog_manager.cc:5697] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 13 to 14, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 14 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:14.654531 21966 consensus_peers.cc:597] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.649681 21747 catalog_manager.cc:5697] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 17 to 18, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 18 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.665230 27970 raft_consensus.cc:993] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: : Instructing follower ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:12:14.665784 27970 raft_consensus.cc:1081] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Signalling peer ecd8f47cd089480aa1f77728a400384a to start an election
I20260709 12:12:14.667891 21924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098"
dest_uuid: "ecd8f47cd089480aa1f77728a400384a"
 from {username='slave'} at 127.0.0.1:60634
I20260709 12:12:14.667728 27984 consensus_queue.cc:1048] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:14.675144 21924 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:14.675630 21924 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.682438 21924 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:12:14.691054 21892 consensus_peers.cc:597] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.700778 21924 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 election: Requested vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:14.702093 21999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ecd8f47cd089480aa1f77728a400384a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:14.702863 21999 raft_consensus.cc:3055] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:14.703055 21892 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:14.703195 21999 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:14.704381 21999 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:14.706051 21999 raft_consensus.cc:3060] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.713165 21999 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd8f47cd089480aa1f77728a400384a in term 18.
I20260709 12:12:14.714285 21892 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a; no voters: cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:14.715179 27897 raft_consensus.cc:2804] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:14.715656 27897 raft_consensus.cc:697] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 18 LEADER]: Becoming Leader. State: Replica: ecd8f47cd089480aa1f77728a400384a, State: Running, Role: LEADER
I20260709 12:12:14.716586 27897 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
W20260709 12:12:14.753043 20705 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21873)
I20260709 12:12:14.827189 21994 raft_consensus.cc:1275] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:12:14.846917 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:14.850255 21892 consensus_peers.cc:597] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.858186 27983 consensus_queue.cc:1048] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:14.866593 21996 raft_consensus.cc:1275] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:14.866842 21994 raft_consensus.cc:1275] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:14.894374 27992 consensus_queue.cc:1048] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:14.905651 27992 consensus_queue.cc:1048] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:14.961122 21746 catalog_manager.cc:5697] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 12 to 13, leader changed from cffb5c192e144f7caa7b94271976ed42 (127.20.56.65) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 13 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.976781 21996 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:14.982563 21996 raft_consensus.cc:1275] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:15.007184 21892 consensus_peers.cc:597] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:14.995142 21736 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 68964.1us
I20260709 12:12:15.014700 27936 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 12:12:15.023494 21736 catalog_manager.cc:4755] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9f7597e7938d4462a3e662f6b63d059a: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:15.049044 21745 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a reported cstate change: term changed from 17 to 18, leader changed from 73070a828b23480e9c3588e376bce2ab (127.20.56.67) to ecd8f47cd089480aa1f77728a400384a (127.20.56.66). New cstate: current_term: 18 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:15.089495 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:15.090034 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 80746.2us
W20260709 12:12:15.100101 21892 consensus_peers.cc:597] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:15.106985 28023 log.cc:927] Time spent T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: Append to log took a long time: real 0.103s	user 0.004s	sys 0.000s
I20260709 12:12:15.113648 27928 consensus_queue.cc:1048] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:15.184243 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:15.204908 21994 raft_consensus.cc:1275] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:15.231356 21994 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:12:15.239997 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:15.241462 21994 raft_consensus.cc:1275] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:15.244333 21994 raft_consensus.cc:1275] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 20 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:15.278798 21996 raft_consensus.cc:1275] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:12:15.284040 21892 consensus_peers.cc:597] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:15.312517 27928 consensus_queue.cc:1048] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:15.314901 27928 consensus_queue.cc:1048] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:15.316876 27993 consensus_queue.cc:1048] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:15.328625 27981 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:15.340190 21893 consensus_peers.cc:597] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3804cba5d43c4079bb7bb28082798098. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:15.341790 27928 consensus_queue.cc:1048] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:15.513422 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 53799.2us
W20260709 12:12:15.653295 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 73715.9us
W20260709 12:12:15.754094 20705 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 21873)
W20260709 12:12:15.764734 21966 consensus_peers.cc:597] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.806080 21892 consensus_peers.cc:597] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.822283 21966 consensus_peers.cc:597] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.844010 21966 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111) [suppressed 401 similar messages]
W20260709 12:12:15.867625 21892 consensus_peers.cc:597] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.869640 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:15.867954 28045 ts_tablet_manager.cc:933] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:15.871830 21966 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.900743 22549 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.901285 22549 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.937057 21892 consensus_peers.cc:597] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:15.938900 28045 tablet_copy_client.cc:323] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
W20260709 12:12:15.945706 21892 consensus_peers.cc:597] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:15.948577 21937 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet 3804cba5d43c4079bb7bb28082798098 from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:12:15.949213 21937 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet 3804cba5d43c4079bb7bb28082798098 from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-3804cba5d43c4079bb7bb28082798098
W20260709 12:12:15.956430 21892 consensus_peers.cc:597] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:15.970942 21937 tablet_copy_source_session.cc:215] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:15.975008 28045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3804cba5d43c4079bb7bb28082798098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.976619 21924 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:15.986883 21996 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:12:15.988287 21893 consensus_peers.cc:597] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe6b96986b574ee88589e15157b5260b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:15.990023 27936 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:15.990557 22549 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:15.992209 21892 consensus_peers.cc:597] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.018074 27989 raft_consensus.cc:2955] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:16.021081 21996 raft_consensus.cc:2955] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:12:16.043658 21966 consensus_peers.cc:597] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:16.058499 28045 tablet_copy_client.cc:806] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:16.058207 21997 consensus_queue.cc:237] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:16.059288 28045 tablet_copy_client.cc:670] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
W20260709 12:12:16.067446 21892 consensus_peers.cc:597] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.068938 22549 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.070597 22549 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:16.081153 21746 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 11, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 15 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:16.100791 21966 consensus_peers.cc:597] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:16.125142 28045 tablet_copy_client.cc:538] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:16.125936 21924 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:12:16.129297 27957 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:12:16.131981 21967 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043): Couldn't send request to peer ac07267c8cab47d4b59dc27d6fe9a386. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5937d593814d4b568742fc86c954922d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.137302 28045 tablet_bootstrap.cc:492] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
W20260709 12:12:16.141005 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.146137 22549 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.145358 21966 consensus_peers.cc:597] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.173208 21966 consensus_peers.cc:597] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:16.175993 21966 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:16.176884 21966 consensus_peers.cc:597] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.183694 21892 consensus_peers.cc:597] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:16.195293 27970 raft_consensus.cc:2955] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
I20260709 12:12:16.197057 21924 raft_consensus.cc:2955] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:12:16.218040 21966 consensus_peers.cc:597] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.224037 21966 consensus_peers.cc:597] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.232712 22549 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.235591 21736 catalog_manager.cc:4755] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9f7597e7938d4462a3e662f6b63d059a: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:16.244656 21798 auto_rebalancer.cc:629] Failed to schedule move for tablet 3804cba5d43c4079bb7bb28082798098: Invalid argument: must modify a field when calling MODIFY_PEER
W20260709 12:12:16.298885 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:16.375977 21746 catalog_manager.cc:5697] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a reported cstate change: config changed from index -1 to 7, NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) added. New cstate: current_term: 9 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } } }
W20260709 12:12:16.410236 21966 consensus_peers.cc:597] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.418238 21966 consensus_peers.cc:597] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:16.457702 21892 consensus_peers.cc:597] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:16.467578 28045 tablet_bootstrap.cc:492] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:16.477614 28045 tablet_bootstrap.cc:492] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:12:16.488029 28045 ts_tablet_manager.cc:1403] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.351s	user 0.046s	sys 0.008s
I20260709 12:12:16.491760 28045 raft_consensus.cc:359] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:16.492657 28045 raft_consensus.cc:740] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:12:16.493395 28045 consensus_queue.cc:260] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:16.502015 28045 ts_tablet_manager.cc:1434] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:12:16.512465 21937 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3804cba5d43c4079bb7bb28082798098 received from {username='slave'} at 127.0.0.1:46426
I20260709 12:12:16.512995 21937 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-3804cba5d43c4079bb7bb28082798098 on tablet 3804cba5d43c4079bb7bb28082798098 with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:16.517047 28045 ts_tablet_manager.cc:933] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:16.561230 28045 tablet_copy_client.cc:323] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.67:39721
I20260709 12:12:16.563550 22010 tablet_copy_service.cc:140] P 73070a828b23480e9c3588e376bce2ab: Received BeginTabletCopySession request for tablet 5937d593814d4b568742fc86c954922d from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:56824)
I20260709 12:12:16.564152 22010 tablet_copy_service.cc:161] P 73070a828b23480e9c3588e376bce2ab: Beginning new tablet copy session on tablet 5937d593814d4b568742fc86c954922d from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:56824: session id = ac07267c8cab47d4b59dc27d6fe9a386-5937d593814d4b568742fc86c954922d
I20260709 12:12:16.577852 22010 tablet_copy_source_session.cc:215] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:16.588546 28057 ts_tablet_manager.cc:933] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: Initiating tablet copy from peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:16.589674 21892 consensus_peers.cc:597] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:16.615124 28045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5937d593814d4b568742fc86c954922d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:16.664706 21892 consensus_peers.cc:597] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:16.640383 28057 tablet_copy_client.cc:323] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Beginning tablet copy session from remote peer at address 127.20.56.66:34757
I20260709 12:12:16.682703 21937 tablet_copy_service.cc:140] P ecd8f47cd089480aa1f77728a400384a: Received BeginTabletCopySession request for tablet fe6b96986b574ee88589e15157b5260b from peer ac07267c8cab47d4b59dc27d6fe9a386 ({username='slave'} at 127.0.0.1:46426)
I20260709 12:12:16.683274 21937 tablet_copy_service.cc:161] P ecd8f47cd089480aa1f77728a400384a: Beginning new tablet copy session on tablet fe6b96986b574ee88589e15157b5260b from peer ac07267c8cab47d4b59dc27d6fe9a386 at {username='slave'} at 127.0.0.1:46426: session id = ac07267c8cab47d4b59dc27d6fe9a386-fe6b96986b574ee88589e15157b5260b
I20260709 12:12:16.692790 21937 tablet_copy_source_session.cc:215] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:16.700245 28057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6b96986b574ee88589e15157b5260b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.724349 28045 tablet_copy_client.cc:806] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:16.725075 28045 tablet_copy_client.cc:670] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:16.732144 22583 raft_consensus.cc:1217] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEARNER]: Deduplicated request from leader. Original: 17.12->[18.13-18.13]   Dedup: 18.13->[]
W20260709 12:12:16.754808 20705 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 21873)
I20260709 12:12:16.772637 28045 tablet_copy_client.cc:538] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:16.785012 28057 tablet_copy_client.cc:806] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:16.785804 28057 tablet_copy_client.cc:670] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:16.794301 28057 tablet_copy_client.cc:538] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:16.807377 28057 tablet_bootstrap.cc:492] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
I20260709 12:12:16.818222 28045 tablet_bootstrap.cc:492] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap starting.
W20260709 12:12:16.946000 21966 consensus_peers.cc:597] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:17.037170 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:17.087708 21892 consensus_peers.cc:597] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:17.105479 21966 consensus_peers.cc:597] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:17.119701 28045 tablet_bootstrap.cc:492] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.128325 28045 tablet_bootstrap.cc:492] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:12:17.132299 28045 ts_tablet_manager.cc:1403] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.314s	user 0.040s	sys 0.012s
I20260709 12:12:17.135798 28045 raft_consensus.cc:359] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:17.151821 28045 raft_consensus.cc:740] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:12:17.152607 28045 consensus_queue.cc:260] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:17.142305 28057 tablet_bootstrap.cc:492] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.164213 28057 tablet_bootstrap.cc:492] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: Bootstrap complete.
I20260709 12:12:17.167189 28057 ts_tablet_manager.cc:1403] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent bootstrapping tablet: real 0.360s	user 0.039s	sys 0.020s
I20260709 12:12:17.166313 28045 ts_tablet_manager.cc:1434] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 12:12:17.173939 28057 raft_consensus.cc:359] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:17.174885 28057 raft_consensus.cc:740] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Initialized, Role: LEARNER
I20260709 12:12:17.175586 28057 consensus_queue.cc:260] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: NON_VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: true } }
I20260709 12:12:17.178670 22010 tablet_copy_service.cc:342] P 73070a828b23480e9c3588e376bce2ab: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-5937d593814d4b568742fc86c954922d received from {username='slave'} at 127.0.0.1:56824
I20260709 12:12:17.179152 22010 tablet_copy_service.cc:434] P 73070a828b23480e9c3588e376bce2ab: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-5937d593814d4b568742fc86c954922d on tablet 5937d593814d4b568742fc86c954922d with peer ac07267c8cab47d4b59dc27d6fe9a386
I20260709 12:12:17.180968 28057 ts_tablet_manager.cc:1434] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 12:12:17.189924 21937 tablet_copy_service.cc:342] P ecd8f47cd089480aa1f77728a400384a: Request end of tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-fe6b96986b574ee88589e15157b5260b received from {username='slave'} at 127.0.0.1:46426
I20260709 12:12:17.190402 21937 tablet_copy_service.cc:434] P ecd8f47cd089480aa1f77728a400384a: ending tablet copy session ac07267c8cab47d4b59dc27d6fe9a386-fe6b96986b574ee88589e15157b5260b on tablet fe6b96986b574ee88589e15157b5260b with peer ac07267c8cab47d4b59dc27d6fe9a386
W20260709 12:12:17.227599 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:17.253693 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:17.322794 28060 raft_consensus.cc:1064] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:12:17.325574 28060 consensus_queue.cc:237] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:17.330101 22583 raft_consensus.cc:1217] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:12:17.360810 22583 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:17.362586 28037 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:17.369428 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:17.380601 21892 consensus_peers.cc:597] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:17.382529 21996 raft_consensus.cc:1275] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:17.383852 27936 consensus_queue.cc:1048] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:12:17.410215 21892 consensus_peers.cc:597] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:17.422111 28060 raft_consensus.cc:2955] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 11 to 14, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:17.429548 21996 raft_consensus.cc:2955] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 11 to 14, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:17.455240 21745 catalog_manager.cc:5697] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 11 to 14, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:17.463220 22577 raft_consensus.cc:2955] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 11 to 14, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:17.474476 22581 raft_consensus.cc:1217] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
W20260709 12:12:17.521082 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:17.660805 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:17.755430 20705 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 21873)
W20260709 12:12:17.812817 21892 consensus_peers.cc:597] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:17.861452 27936 raft_consensus.cc:1064] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:12:17.864697 27936 consensus_queue.cc:237] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:17.886241 27957 raft_consensus.cc:1064] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: attempting to promote NON_VOTER ac07267c8cab47d4b59dc27d6fe9a386 to VOTER
I20260709 12:12:17.894219 22577 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEARNER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:17.897540 21997 raft_consensus.cc:1275] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Refusing update from remote peer ecd8f47cd089480aa1f77728a400384a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:17.897583 27989 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:17.905189 28060 consensus_queue.cc:1048] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:17.891297 27957 consensus_queue.cc:237] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:17.917603 21892 consensus_peers.cc:597] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.920857 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:17.953727 27936 raft_consensus.cc:2955] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:17.956284 21996 raft_consensus.cc:2955] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
W20260709 12:12:17.971401 21892 consensus_peers.cc:597] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:17.984491 21924 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:12:17.986645 27970 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:17.977252 22577 raft_consensus.cc:1275] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 LEARNER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:12:17.989588 21966 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:17.992794 28050 consensus_queue.cc:1048] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:18.031486 21746 catalog_manager.cc:5697] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "ecd8f47cd089480aa1f77728a400384a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:18.040274 28050 raft_consensus.cc:2955] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:18.053556 21924 raft_consensus.cc:2955] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:18.068993 22583 raft_consensus.cc:2955] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:18.079461 22577 raft_consensus.cc:2955] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } } }
I20260709 12:12:18.179281 21747 catalog_manager.cc:5697] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab reported cstate change: config changed from index 7 to 8, ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:18.263821 21966 consensus_peers.cc:597] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.337015 22549 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.362955 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.377764 21736 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 50365.4us
W20260709 12:12:18.381551 22549 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.382721 21736 catalog_manager.cc:4755] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9f7597e7938d4462a3e662f6b63d059a: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:18.406847 21966 consensus_peers.cc:597] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.425611 21892 consensus_peers.cc:597] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.452127 21892 consensus_peers.cc:597] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.486581 21892 consensus_peers.cc:597] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.510155 21966 consensus_peers.cc:597] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.516017 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.537017 22549 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.541832 21892 consensus_peers.cc:597] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.560454 21966 consensus_peers.cc:597] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.586066 21966 consensus_peers.cc:597] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:18.595963 21892 consensus_peers.cc:597] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.614528 22549 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.684343 21966 consensus_peers.cc:597] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.718924 22549 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.719734 22549 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.718245 21966 consensus_peers.cc:597] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.723142 22549 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.758565 21892 consensus_peers.cc:597] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.819474 21966 consensus_peers.cc:597] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.853780 21966 consensus_peers.cc:597] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.873606 21892 consensus_peers.cc:597] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.901229 21966 consensus_peers.cc:597] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:18.915153 21966 consensus_peers.cc:597] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:19.076475 21892 consensus_peers.cc:597] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:19.245996 21892 consensus_peers.cc:597] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.258468 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.346280 21892 consensus_peers.cc:597] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.453299 21966 consensus_peers.cc:597] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.614776 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.626606 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.640952 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.719138 21966 consensus_peers.cc:597] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.851817 21892 consensus_peers.cc:597] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:19.901404 21892 consensus_peers.cc:597] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:20.011209 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:20.118602 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:20.334909 21892 consensus_peers.cc:597] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:20.476617 22549 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:20.495487 20705 tablet_server.cc:196] TabletServer@127.20.56.65:0 shutdown complete.
W20260709 12:12:20.518252 21966 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:20.539140 21892 consensus_peers.cc:597] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:20.551673 21966 consensus_peers.cc:597] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.556628 21892 consensus_peers.cc:597] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.677376 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 56416.8us
W20260709 12:12:20.698137 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.717800 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.775552 21966 consensus_peers.cc:597] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.778673 21892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 57339.7us
W20260709 12:12:20.802096 22549 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.848214 22549 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111) [suppressed 456 similar messages]
W20260709 12:12:20.872851 21892 consensus_peers.cc:597] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:20.881172 20705 tablet_server.cc:179] TabletServer@127.20.56.66:0 shutting down...
W20260709 12:12:20.883253 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.908118 21964 consensus_peers.cc:597] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:20.943806 21966 consensus_peers.cc:597] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:20.951900 22547 consensus_peers.cc:597] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:20.957868 22547 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:20.961592 22549 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.962363 21892 consensus_peers.cc:597] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:20.970702 21964 consensus_peers.cc:597] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:20.994585 21964 consensus_peers.cc:597] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:20.994585 22547 consensus_peers.cc:597] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.004026 21964 consensus_peers.cc:597] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.006713 21964 consensus_peers.cc:597] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.019771 21892 consensus_peers.cc:597] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:21.051230 21966 consensus_peers.cc:597] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:21.083482 22549 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:21.095805 21966 consensus_peers.cc:597] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:21.110183 21964 consensus_peers.cc:597] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.115041 21966 consensus_peers.cc:597] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:21.116600 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:21.118461 20705 tablet_replica.cc:333] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.119485 20705 raft_consensus.cc:2243] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.120342 20705 raft_consensus.cc:2272] T 6edcbe9f33b9434baee189a40cf203b1 P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.123427 20705 tablet_replica.cc:333] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.135109 20705 raft_consensus.cc:2243] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.136224 20705 raft_consensus.cc:2272] T 1238ec38c933498cadf6153a5554f6e0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.140105 20705 tablet_replica.cc:333] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.140964 20705 raft_consensus.cc:2243] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.141623 20705 raft_consensus.cc:2272] T f2e5283f63d24660b50b74440e20aef8 P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.144551 20705 tablet_replica.cc:333] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.145598 20705 raft_consensus.cc:2243] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:21.149281 21964 consensus_peers.cc:597] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.150032 21964 consensus_peers.cc:597] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:21.154611 20705 raft_consensus.cc:2272] T f1837f1c346048738233aa4a75fc384d P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.157464 20705 tablet_replica.cc:333] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.158380 20705 raft_consensus.cc:2243] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:12:21.159266 22549 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:21.159399 20705 raft_consensus.cc:2272] T 207491536b034836987ee3a520d08ff6 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.162169 20705 tablet_replica.cc:333] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.163195 20705 raft_consensus.cc:2243] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:12:21.164040 22547 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.168998 21892 consensus_peers.cc:597] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:21.171422 20705 raft_consensus.cc:2272] T 4d3beb28cf484708af67a4cafaaa657b P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:21.174126 22549 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:21.174479 20705 tablet_replica.cc:333] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.175333 20705 raft_consensus.cc:2243] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:21.175887 22547 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:21.176116 20705 raft_consensus.cc:2272] T 1e7b85a6bcce421ebd09faebda5437e0 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:21.176586 22547 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:21.183068 20705 tablet_replica.cc:333] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.184118 20705 raft_consensus.cc:2243] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.185263 20705 raft_consensus.cc:2272] T abcd87e902c445c5b3c3a383d5f1b3eb P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:21.188323 22549 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:21.189458 22547 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.192637 21964 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.193336 22547 consensus_peers.cc:597] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:21.193481 20705 tablet_replica.cc:333] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
W20260709 12:12:21.195701 21964 consensus_peers.cc:597] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:21.195998 20705 raft_consensus.cc:2243] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.198087 20705 raft_consensus.cc:2272] T cba6603cbc59405eabb68cb5355bb01e P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.201366 20705 tablet_replica.cc:333] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
W20260709 12:12:21.196372 22547 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.206485 21966 consensus_peers.cc:597] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:21.211257 20705 raft_consensus.cc:2243] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.219434 20705 raft_consensus.cc:2272] T 5937d593814d4b568742fc86c954922d P ecd8f47cd089480aa1f77728a400384a [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:21.223963 21964 consensus_peers.cc:597] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.224771 21966 consensus_peers.cc:597] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:21.225310 21964 consensus_peers.cc:597] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:21.227864 20705 tablet_replica.cc:333] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.233651 20705 raft_consensus.cc:2243] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.234967 20705 raft_consensus.cc:2272] T 87ec2fd4639346c6b0a138de0c31852f P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.238258 20705 tablet_replica.cc:333] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.239058 20705 raft_consensus.cc:2243] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.245865 20705 raft_consensus.cc:2272] T 032f8014213a49d395c150ebc9f55752 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.248811 20705 tablet_replica.cc:333] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.251204 20705 raft_consensus.cc:2243] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.254923 20705 raft_consensus.cc:2272] T 3804cba5d43c4079bb7bb28082798098 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:21.260780 22547 consensus_peers.cc:597] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.276275 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:21.278255 20705 tablet_replica.cc:333] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.287335 20705 raft_consensus.cc:2243] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.288738 20705 raft_consensus.cc:2272] T 574068a837ce42d6a654b65aa3b4a614 P ecd8f47cd089480aa1f77728a400384a [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:21.290767 21966 consensus_peers.cc:597] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:21.303936 20705 tablet_replica.cc:333] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.307915 20705 raft_consensus.cc:2243] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.308746 20705 raft_consensus.cc:2272] T 68b43b3517064c3b81e50b88c21938ce P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:21.315363 21964 consensus_peers.cc:597] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:21.317727 20705 tablet_replica.cc:333] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.320294 20705 raft_consensus.cc:2243] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.327615 20705 raft_consensus.cc:2272] T 372e433359ec4224868a6883dfc642e3 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.333876 20705 tablet_replica.cc:333] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.334900 20705 raft_consensus.cc:2243] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.336467 20705 raft_consensus.cc:2272] T d28906331f4545a29562f950eacb999e P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.339581 20705 tablet_replica.cc:333] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.347007 20705 raft_consensus.cc:2243] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.348142 20705 raft_consensus.cc:2272] T 11bd5972700f42709d3ebcb0a6d9b51c P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.355434 20705 tablet_replica.cc:333] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
W20260709 12:12:21.355686 22547 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:21.357203 21966 consensus_peers.cc:597] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:21.363876 20705 raft_consensus.cc:2243] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.365135 20705 raft_consensus.cc:2272] T 947619c833644483a9745291e5d8ba38 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.377864 20705 tablet_replica.cc:333] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.378777 20705 raft_consensus.cc:2243] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.379405 20705 raft_consensus.cc:2272] T f127c5582f284fbd97aa877ecdd4d4f4 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.382201 20705 tablet_replica.cc:333] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.383104 20705 raft_consensus.cc:2243] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:12:21.386139 21966 consensus_peers.cc:597] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:21.387637 20705 raft_consensus.cc:2272] T 28c070f8afb4493ca787ffc8b1482e7a P ecd8f47cd089480aa1f77728a400384a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.390137 20705 tablet_replica.cc:333] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.390935 20705 raft_consensus.cc:2243] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.391566 20705 raft_consensus.cc:2272] T 77a9143d931e458e9c5824195395a69b P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.394441 20705 tablet_replica.cc:333] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.400907 20705 raft_consensus.cc:2243] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.404891 20705 raft_consensus.cc:2272] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ecd8f47cd089480aa1f77728a400384a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.409662 20705 tablet_replica.cc:333] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.411655 20705 raft_consensus.cc:2243] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.419677 20705 raft_consensus.cc:2272] T 5e2003af45914197b88e4cc3389271af P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.426435 20705 tablet_replica.cc:333] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.427412 20705 raft_consensus.cc:2243] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.431587 20705 raft_consensus.cc:2272] T 8145e629270b44a298b6e1c1b249989f P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.439749 20705 tablet_replica.cc:333] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.440779 20705 raft_consensus.cc:2243] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.445485 20705 raft_consensus.cc:2272] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.448365 20705 tablet_replica.cc:333] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.455706 20705 raft_consensus.cc:2243] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.459424 20705 raft_consensus.cc:2272] T 02f67b74a580421b99787adc89841d21 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.472079 20705 tablet_replica.cc:333] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.472925 20705 raft_consensus.cc:2243] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.473902 20705 raft_consensus.cc:2272] T ae7bfef0e495480e843989cbb71b4330 P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.476632 20705 tablet_replica.cc:333] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.479923 20705 raft_consensus.cc:2243] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.484673 20705 raft_consensus.cc:2272] T fe6b96986b574ee88589e15157b5260b P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.487509 20705 tablet_replica.cc:333] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.491918 20705 raft_consensus.cc:2243] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.494812 20705 raft_consensus.cc:2272] T 3a7076f768c74a41bc54edd6bcaaaf83 P ecd8f47cd089480aa1f77728a400384a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.511698 20705 tablet_replica.cc:333] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.512583 20705 raft_consensus.cc:2243] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.513598 20705 raft_consensus.cc:2272] T c93911a59a2c46bb9745487e082af441 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.517608 20705 tablet_replica.cc:333] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.522174 20705 raft_consensus.cc:2243] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.532044 20705 raft_consensus.cc:2272] T 01221e34ce744d078265a58313d176a5 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.562892 20705 tablet_replica.cc:333] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.588197 20705 raft_consensus.cc:2243] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.599654 20705 raft_consensus.cc:2272] T 03e031f17c4d400c9fe7c2c101148ff0 P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.610672 20705 tablet_replica.cc:333] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.614172 20705 raft_consensus.cc:2243] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.618378 20705 raft_consensus.cc:2272] T 1634cc7afa814a3889101c2be1c108ad P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.621502 20705 tablet_replica.cc:333] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.628314 20705 raft_consensus.cc:2243] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.631542 20705 raft_consensus.cc:2272] T 1cc81c27d5d3424db1dfbfc977e0369d P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.650892 20705 tablet_replica.cc:333] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.651810 20705 raft_consensus.cc:2243] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.652501 20705 raft_consensus.cc:2272] T 52d6c6b59b7b44f4b009fc6edfc800eb P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.655686 20705 tablet_replica.cc:333] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.656512 20705 raft_consensus.cc:2243] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.657580 20705 raft_consensus.cc:2272] T 3732a691799e4f2abfe58158cddce045 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.679142 20705 tablet_replica.cc:333] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.679956 20705 raft_consensus.cc:2243] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.685598 20705 raft_consensus.cc:2272] T d50c36e857cb4e33997aee7e5dd39447 P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.706614 20705 tablet_replica.cc:333] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.709120 20705 raft_consensus.cc:2243] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.726814 20705 raft_consensus.cc:2272] T 3e9858619e3a4ae383caadbb133747bc P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.731608 20705 tablet_replica.cc:333] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.737869 20705 raft_consensus.cc:2243] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.748052 20705 raft_consensus.cc:2272] T 9f7597e7938d4462a3e662f6b63d059a P ecd8f47cd089480aa1f77728a400384a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.761559 20705 tablet_replica.cc:333] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.762322 20705 raft_consensus.cc:2243] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.763069 20705 raft_consensus.cc:2272] T 3b662199918843a1a8139ac42424d3f6 P ecd8f47cd089480aa1f77728a400384a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.765897 20705 tablet_replica.cc:333] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
W20260709 12:12:21.781598 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.809712 20705 raft_consensus.cc:2243] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.833873 20705 raft_consensus.cc:2272] T 74ed463cf25c4e46900f103087ec2300 P ecd8f47cd089480aa1f77728a400384a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.843500 20705 tablet_replica.cc:333] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
W20260709 12:12:21.843684 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:21.844269 20705 raft_consensus.cc:2243] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.845510 20705 raft_consensus.cc:2272] T 265f2ffa166449ee9bfd498dacfcc48f P ecd8f47cd089480aa1f77728a400384a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.869791 20705 tablet_replica.cc:333] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.870543 20705 raft_consensus.cc:2243] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:21.872081 20705 raft_consensus.cc:2272] T d194e05a662143ea99bad3093bf3e0dd P ecd8f47cd089480aa1f77728a400384a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:21.875792 20705 tablet_replica.cc:333] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a: stopping tablet replica
I20260709 12:12:21.876426 20705 raft_consensus.cc:2243] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:21.878027 20705 raft_consensus.cc:2272] T 2f4600c62493468899ff64fcf08d4fbe P ecd8f47cd089480aa1f77728a400384a [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:21.932505 21890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:21.964658 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.001536 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.005203 21893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.161578 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:22.169668 21966 consensus_peers.cc:597] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:22.212688 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.403138 28103 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.403704 28103 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.405925 28103 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:22.411407 27990 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.412523 27990 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:22.412760 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:22.419575 27990 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:22.422118 27990 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:12:22.422439 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:22.422636 27990 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.424916 27990 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.431020 28099 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.432238 28099 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.435770 28099 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:22.455803 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.456327 21892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.519606 22549 leader_election.cc:336] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:22.528887 21736 catalog_manager.cc:4755] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9f7597e7938d4462a3e662f6b63d059a: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:22.561576 28101 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.562484 28101 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.565021 28101 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:22.565917 21964 connection.cc:769] client connection to 127.20.56.66:34757 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:12:22.573410 22547 connection.cc:769] client connection to 127.20.56.66:34757 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:12:22.585037 28093 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.585630 28093 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.587092 28108 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.588029 28093 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:22.587637 28108 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:22.604183 22547 leader_election.cc:336] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.604344 28108 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:22.604774 22547 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.607035 28109 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:12:22.613174 22547 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.607736 28108 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.608093 28110 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:12:22.609175 21964 leader_election.cc:336] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.607254 28093 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.613956 28110 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:22.614374 28093 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:22.616750 28110 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.612898 28109 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:12:22.618625 21964 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.613737 28099 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:22.619272 28109 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.613852 28108 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:22.619585 21964 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.622448 28108 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:22.624953 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:22.625676 21997 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
W20260709 12:12:22.638656 21964 leader_election.cc:336] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.641021 28108 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.641597 28108 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:22.643618 28108 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.621027 28093 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.646488 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:22.647396 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:22.648036 22583 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
W20260709 12:12:22.646454 22549 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:22.646813 21964 leader_election.cc:336] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.649922 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:12:22.620800 22547 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.653863 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:22.658607 28093 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.656491 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:22.655261 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:22.659489 21996 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 18.
I20260709 12:12:22.659567 22583 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 16.
W20260709 12:12:22.659732 21964 leader_election.cc:336] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.658601 21997 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 16.
W20260709 12:12:22.660279 21964 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.658841 22577 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 18.
I20260709 12:12:22.648627 22549 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.661841 28099 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:22.660352 28093 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:12:22.663589 21964 leader_election.cc:336] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:22.664284 22547 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.664597 28093 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.668848 28099 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.669390 28099 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.671655 28099 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.673847 21967 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.674937 28111 raft_consensus.cc:2749] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:22.675032 21967 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.675781 28111 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:22.676201 28111 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.676548 28111 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:22.678221 21964 leader_election.cc:336] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.680372 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.681190 28093 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:22.681537 28093 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.681890 28099 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.681906 28093 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.683931 28099 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.686101 28099 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:22.696574 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
W20260709 12:12:22.699048 21966 consensus_peers.cc:597] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:22.701505 28093 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:22.702695 22547 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.703305 28111 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:22.717157 22549 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:22.721407 28111 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:22.721975 22547 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.722404 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3beb28cf484708af67a4cafaaa657b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:22.723017 22577 raft_consensus.cc:3060] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:22.725234 21964 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:22.725752 21964 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.726488 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.729574 22577 raft_consensus.cc:2468] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:12:22.732177 28093 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:22.733206 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcd87e902c445c5b3c3a383d5f1b3eb" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:22.734043 22583 raft_consensus.cc:3060] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.734166 21967 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.736145 28111 raft_consensus.cc:2804] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:22.736678 28111 raft_consensus.cc:697] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:22.737488 28111 consensus_queue.cc:237] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.741875 22583 raft_consensus.cc:2468] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 17.
I20260709 12:12:22.742946 21967 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.743530 28099 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:22.744011 28093 raft_consensus.cc:2804] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:22.744586 28093 raft_consensus.cc:697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:22.745487 28093 consensus_queue.cc:237] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.749397 28099 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.749989 28099 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.752198 28099 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:22.757474 21966 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:22.772866 21966 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.780651 28111 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:22.769999 22547 leader_election.cc:336] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.779685 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.785983 28099 raft_consensus.cc:2764] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:22.787640 28111 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.788216 28111 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:22.790668 28111 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.793543 28099 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.796695 28099 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.797816 28111 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.798611 28111 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:22.801002 28093 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.799108 28099 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.801666 28093 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:22.803843 21964 leader_election.cc:336] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.804682 28093 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:22.805758 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:12:22.809999 21964 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.810489 21964 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.811395 28093 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.811772 28111 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.814599 22549 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:22.818295 22547 leader_election.cc:336] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:22.824288 21964 leader_election.cc:336] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.826663 27990 raft_consensus.cc:2764] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:22.830818 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.839350 21745 catalog_manager.cc:5697] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 16 to 17, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 17 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.841336 21745 catalog_manager.cc:5697] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 16 to 17, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 17 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:22.847962 21966 leader_election.cc:336] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:22.848652 27990 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.854202 21966 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.857113 28111 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:22.857298 21966 leader_election.cc:336] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:22.861330 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.871919 28111 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:22.873098 21966 leader_election.cc:336] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:22.874608 27990 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.876785 27990 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.879328 27990 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:22.882144 27990 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.882728 27990 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.884882 27990 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:22.885775 21966 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:22.891372 22547 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:22.901034 22547 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.901767 28111 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.903046 28093 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.906884 28093 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.909578 28093 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:22.912580 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:22.913313 22583 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:12:22.914713 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:12:22.915598 21964 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:22.916699 28093 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:22.917201 28093 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.917665 28093 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:22.904053 21966 leader_election.cc:336] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:22.923597 21966 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.946630 28111 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:22.947863 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 43838.5us
W20260709 12:12:22.958393 21966 leader_election.cc:336] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:22.958971 21966 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.960978 28111 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.971911 27990 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:22.972604 27990 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.975008 27990 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:22.980976 22549 leader_election.cc:336] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:22.986713 22549 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:22.993191 27990 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.928112 28093 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:22.997987 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:22.998752 21997 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 11.
W20260709 12:12:23.018302 21964 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:23.030021 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1634cc7afa814a3889101c2be1c108ad" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:23.030798 22583 raft_consensus.cc:3060] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.041446 22583 raft_consensus.cc:2468] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:12:23.051380 21967 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:23.052397 28111 raft_consensus.cc:2804] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:23.053018 28111 raft_consensus.cc:697] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:23.054068 28111 consensus_queue.cc:237] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:23.041970 28093 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:23.049075 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:23.062242 28102 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:23.062897 28102 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:23.065253 28102 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:23.095295 27990 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:23.095983 27990 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:23.098960 27990 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:23.100615 27990 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:23.101249 27990 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:23.107976 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:23.119501 22549 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:23.121894 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:23.118839 28093 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:23.132073 28093 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:23.135643 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:23.136384 22583 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:12:23.138960 21967 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:23.140259 28111 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:23.140709 28111 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:23.141126 28111 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.146524 28093 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:23.148437 27990 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:23.150906 28102 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.171403 28093 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:23.172515 28093 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:23.182694 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:23.186514 21998 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 13.
I20260709 12:12:23.187868 22549 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:23.191285 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:23.200664 22583 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 13.
I20260709 12:12:23.202399 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
W20260709 12:12:23.184381 21966 leader_election.cc:336] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:23.203699 21966 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:23.205480 28102 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:23.208117 28108 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:23.213624 28108 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:23.214174 28108 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:23.218703 28102 raft_consensus.cc:493] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:23.219334 28102 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:23.230829 28108 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:23.245759 22583 raft_consensus.cc:1275] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:23.260350 28122 consensus_queue.cc:1048] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:23.246696 21966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 62349.1us
W20260709 12:12:23.263394 21966 leader_election.cc:336] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:23.263891 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:23.264884 21966 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:23.247236 28109 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:23.266912 28109 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:23.247700 28093 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:23.253594 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39721, user_credentials={real_user=slave}} blocked reactor thread for 48505.7us
W20260709 12:12:23.255563 21964 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:23.286939 22549 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:23.288506 28111 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:23.292829 28102 raft_consensus.cc:515] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:23.297006 28099 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:23.300760 28108 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:23.316056 21964 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:23.315833 21745 catalog_manager.cc:5697] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 14 to 15, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 15 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.323119 28111 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:23.331261 21967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:40043, user_credentials={real_user=slave}} blocked reactor thread for 71593.8us
I20260709 12:12:23.334367 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d194e05a662143ea99bad3093bf3e0dd" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:23.335041 22583 raft_consensus.cc:3060] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:23.338913 21964 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:23.344967 21964 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:23.345495 21964 consensus_peers.cc:597] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:23.345969 21964 consensus_peers.cc:597] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:23.345920 22577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7597e7938d4462a3e662f6b63d059a" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386"
I20260709 12:12:23.346776 22577 raft_consensus.cc:3060] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:23.358537 21964 consensus_peers.cc:597] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:23.360412 22577 raft_consensus.cc:2468] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 15.
I20260709 12:12:23.377076 21967 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:23.377960 28123 raft_consensus.cc:2804] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:23.378489 28123 raft_consensus.cc:697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:23.379297 28123 consensus_queue.cc:237] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:23.388197 22584 raft_consensus.cc:1275] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:23.391184 28102 leader_election.cc:290] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Requested vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:23.393018 28122 consensus_queue.cc:1048] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:12:23.393826 22549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:42093, user_credentials={real_user=slave}} blocked reactor thread for 78913.4us
W20260709 12:12:23.394497 22549 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:23.403865 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6b96986b574ee88589e15157b5260b" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:23.404719 21998 raft_consensus.cc:2468] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 15.
I20260709 12:12:23.415094 22583 raft_consensus.cc:2468] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73070a828b23480e9c3588e376bce2ab in term 14.
I20260709 12:12:23.433679 21967 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:23.434509 28122 raft_consensus.cc:2804] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:23.435003 28122 raft_consensus.cc:697] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Becoming Leader. State: Replica: 73070a828b23480e9c3588e376bce2ab, State: Running, Role: LEADER
I20260709 12:12:23.435837 28122 consensus_queue.cc:237] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:23.439829 21964 consensus_peers.cc:597] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:23.445586 22549 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:23.446317 22549 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:23.446803 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.447316 22022 debug-util.cc:398] Leaking SignalData structure 0x7b080035a8c0 after lost signal to thread 20708
W20260709 12:12:23.447515 21966 consensus_peers.cc:597] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.448218 21966 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:23.448426 22022 debug-util.cc:398] Leaking SignalData structure 0x7b0800237c20 after lost signal to thread 21784
W20260709 12:12:23.448649 21966 consensus_peers.cc:597] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.449872 22022 debug-util.cc:398] Leaking SignalData structure 0x7b08002127c0 after lost signal to thread 22025
W20260709 12:12:23.451026 22022 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0500 after lost signal to thread 22608
I20260709 12:12:23.451138 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c070f8afb4493ca787ffc8b1482e7a" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab"
I20260709 12:12:23.451757 21996 raft_consensus.cc:3060] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:23.457950 21964 consensus_peers.cc:597] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:23.461263 21996 raft_consensus.cc:2468] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 12.
I20260709 12:12:23.474100 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:23.475782 28102 raft_consensus.cc:2764] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:23.479635 22549 leader_election.cc:304] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: 
I20260709 12:12:23.480432 28102 raft_consensus.cc:2804] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:23.486279 21745 catalog_manager.cc:5697] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 14 to 15, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 15 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.488359 21745 catalog_manager.cc:5697] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab reported cstate change: term changed from 13 to 14, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to 73070a828b23480e9c3588e376bce2ab (127.20.56.67). New cstate: current_term: 14 leader_uuid: "73070a828b23480e9c3588e376bce2ab" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.490471 28102 raft_consensus.cc:697] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Becoming Leader. State: Replica: ac07267c8cab47d4b59dc27d6fe9a386, State: Running, Role: LEADER
I20260709 12:12:23.491529 28102 consensus_queue.cc:237] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:23.514055 22549 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.514667 22549 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.515120 22549 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.520462 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.521112 22549 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.521620 21964 consensus_peers.cc:597] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:23.542604 21745 catalog_manager.cc:5697] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 reported cstate change: term changed from 11 to 12, leader changed from ecd8f47cd089480aa1f77728a400384a (127.20.56.66) to ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68). New cstate: current_term: 12 leader_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:23.553424 21964 consensus_peers.cc:597] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:23.566589 21964 consensus_peers.cc:597] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:23.564356 21966 consensus_peers.cc:597] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:23.585325 22549 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:23.591475 22584 raft_consensus.cc:1275] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:23.592154 21966 consensus_peers.cc:597] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.594173 22549 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:23.594080 28122 consensus_queue.cc:1048] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:23.605964 22549 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.607544 21966 consensus_peers.cc:597] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.615754 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:23.621989 21964 consensus_peers.cc:597] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:23.629688 21964 consensus_peers.cc:597] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:23.643772 21964 consensus_peers.cc:597] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:23.679570 21964 consensus_peers.cc:597] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:23.718111 21966 consensus_peers.cc:597] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.776212 21964 consensus_peers.cc:597] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:23.802476 21964 consensus_peers.cc:597] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:23.832288 21966 consensus_peers.cc:597] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.855050 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.858932 21966 consensus_peers.cc:597] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:23.869410 21964 consensus_peers.cc:597] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:23.938198 21964 consensus_peers.cc:597] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:23.984397 22583 raft_consensus.cc:1275] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:23.990711 28108 consensus_queue.cc:1048] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:23.997524 22547 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.005007 22584 raft_consensus.cc:1275] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Refusing update from remote peer 73070a828b23480e9c3588e376bce2ab: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:23.998080 22547 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.006814 28123 consensus_queue.cc:1048] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:24.009236 27990 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:24.014372 21996 raft_consensus.cc:1275] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Refusing update from remote peer ac07267c8cab47d4b59dc27d6fe9a386: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:12:24.024685 21964 consensus_peers.cc:597] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.025269 22547 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.026687 28102 consensus_queue.cc:1048] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:24.026299 22547 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.035756 22547 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab, ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:24.036624 22547 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.036902 22547 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.038800 27990 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:24.039368 22547 leader_election.cc:336] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:24.040458 22547 consensus_peers.cc:597] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.038645 28102 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:24.163084 22547 consensus_peers.cc:597] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.165849 21966 consensus_peers.cc:597] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:24.167165 21964 consensus_peers.cc:597] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.176003 22547 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.192246 22547 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.193132 22547 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.211503 22547 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.220762 22547 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.230159 21966 consensus_peers.cc:597] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:24.246991 28139 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.247798 28139 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:24.255955 22549 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:24.257143 28139 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:24.258602 22547 consensus_peers.cc:597] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.263025 22547 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.263229 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3804cba5d43c4079bb7bb28082798098" candidate_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73070a828b23480e9c3588e376bce2ab" is_pre_election: true
I20260709 12:12:24.266052 21996 raft_consensus.cc:2468] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac07267c8cab47d4b59dc27d6fe9a386 in term 18.
I20260709 12:12:24.265859 22547 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.274205 28139 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:24.288204 20705 tablet_server.cc:196] TabletServer@127.20.56.66:0 shutdown complete.
W20260709 12:12:24.307322 22547 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.354241 21966 consensus_peers.cc:597] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:24.393914 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:24.453850 22547 consensus_peers.cc:597] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.454375 22547 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:24.455154 28137 raft_consensus.cc:493] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.455773 28137 raft_consensus.cc:515] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:12:24.468758 21966 leader_election.cc:336] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:24.471134 28137 leader_election.cc:290] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:24.477491 21964 leader_election.cc:336] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.478026 21964 leader_election.cc:304] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.479485 28137 raft_consensus.cc:2749] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:24.480700 28137 raft_consensus.cc:493] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.481575 28137 raft_consensus.cc:515] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:12:24.488224 21966 leader_election.cc:336] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:24.489436 28137 leader_election.cc:290] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:24.494544 21964 leader_election.cc:336] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.495347 21964 leader_election.cc:304] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.496613 28137 raft_consensus.cc:2749] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:24.540123 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:24.573967 28123 raft_consensus.cc:493] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.574584 28123 raft_consensus.cc:515] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:24.576928 28123 leader_election.cc:290] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:24.581449 20705 tablet_server.cc:179] TabletServer@127.20.56.67:0 shutting down...
W20260709 12:12:24.583369 22547 consensus_peers.cc:597] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:24.588105 21966 leader_election.cc:336] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:24.593459 28123 raft_consensus.cc:493] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.594069 28123 raft_consensus.cc:515] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
W20260709 12:12:24.596160 21964 leader_election.cc:336] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.596724 21964 leader_election.cc:304] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.599931 28122 raft_consensus.cc:2749] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:24.603017 28123 leader_election.cc:290] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:24.637742 21964 leader_election.cc:336] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:24.639799 22549 consensus_peers.cc:597] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.641697 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:24.642735 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.647377 21966 leader_election.cc:336] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:24.647867 21966 leader_election.cc:304] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.649649 28136 raft_consensus.cc:2749] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:24.658007 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.676090 28123 raft_consensus.cc:493] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.676654 28123 raft_consensus.cc:515] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:24.694628 28123 leader_election.cc:290] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:24.700451 21966 leader_election.cc:336] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:24.702692 22549 consensus_peers.cc:597] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.711990 21964 leader_election.cc:336] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.712488 21964 leader_election.cc:304] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.714123 28136 raft_consensus.cc:2749] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:24.720517 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.727226 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:24.730468 20705 tablet_replica.cc:333] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.731592 20705 raft_consensus.cc:2243] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.732347 20705 raft_consensus.cc:2272] T ff3fa17120b9481fbb27a63e11e13340 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:24.732795 21966 consensus_peers.cc:597] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:24.735172 20705 tablet_replica.cc:333] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.736122 20705 raft_consensus.cc:2243] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.737160 20705 raft_consensus.cc:2272] T f1837f1c346048738233aa4a75fc384d P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.749186 20705 tablet_replica.cc:333] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.750914 20705 raft_consensus.cc:2243] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:24.751411 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.751663 20705 raft_consensus.cc:2272] T 207491536b034836987ee3a520d08ff6 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.752995 28139 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.753468 28139 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:24.755541 28139 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:24.761855 22549 leader_election.cc:336] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:24.764097 22547 leader_election.cc:336] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.764664 22547 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.765550 28139 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:24.773537 28139 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.774147 28139 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:24.776638 28139 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:24.786137 22549 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:24.791327 22547 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.791934 22547 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.794242 28139 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:24.796123 20705 tablet_replica.cc:333] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.802048 28122 raft_consensus.cc:493] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.805424 28122 raft_consensus.cc:515] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:24.806303 20705 raft_consensus.cc:2243] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.807631 28122 leader_election.cc:290] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:24.811857 21966 leader_election.cc:336] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:24.814756 21964 leader_election.cc:336] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:24.815308 21964 leader_election.cc:304] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.816174 28122 raft_consensus.cc:2749] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.817309 20705 raft_consensus.cc:2272] T f2e5283f63d24660b50b74440e20aef8 P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:24.820386 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.825901 20705 tablet_replica.cc:333] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.827057 20705 raft_consensus.cc:2243] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.830623 20705 raft_consensus.cc:2272] T 4d3beb28cf484708af67a4cafaaa657b P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.843196 28122 raft_consensus.cc:493] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.843698 28122 raft_consensus.cc:515] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } }
I20260709 12:12:24.845764 28122 leader_election.cc:290] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:24.852100 21964 leader_election.cc:336] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:24.852689 21966 leader_election.cc:336] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:24.853137 21966 leader_election.cc:304] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:24.853892 28122 raft_consensus.cc:2749] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:24.866690 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.876264 20705 tablet_replica.cc:333] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.877446 20705 raft_consensus.cc:2243] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.878742 20705 raft_consensus.cc:2272] T 1e7b85a6bcce421ebd09faebda5437e0 P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.882022 20705 tablet_replica.cc:333] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.883356 20705 raft_consensus.cc:2243] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:12:24.892678 22549 consensus_peers.cc:597] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.895073 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:24.895165 20705 raft_consensus.cc:2272] T 6edcbe9f33b9434baee189a40cf203b1 P 73070a828b23480e9c3588e376bce2ab [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.947154 20705 tablet_replica.cc:333] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.951290 20705 raft_consensus.cc:2243] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.954067 20705 raft_consensus.cc:2272] T 1238ec38c933498cadf6153a5554f6e0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.960376 20705 tablet_replica.cc:333] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.962738 20705 raft_consensus.cc:2243] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.966564 20705 raft_consensus.cc:2272] T a6e5de589d8b434b87a0bf4f41fb63ba P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.968017 28143 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:24.971727 28143 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:24.980908 20705 tablet_replica.cc:333] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:24.982111 20705 raft_consensus.cc:2243] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.978121 28143 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:24.994320 22547 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:25.015555 20705 raft_consensus.cc:2272] T abcd87e902c445c5b3c3a383d5f1b3eb P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.019552 20705 tablet_replica.cc:333] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.020864 20705 raft_consensus.cc:2243] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.022221 20705 raft_consensus.cc:2272] T cba6603cbc59405eabb68cb5355bb01e P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:25.035058 22549 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:25.035555 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:25.038826 27990 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.050071 20705 tablet_replica.cc:333] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.051903 20705 raft_consensus.cc:2243] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:12:25.054840 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.056016 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.056600 22549 consensus_peers.cc:597] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.058751 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.078259 27990 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:25.081722 27990 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:25.085664 27990 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:25.088596 20705 raft_consensus.cc:2272] T 5937d593814d4b568742fc86c954922d P 73070a828b23480e9c3588e376bce2ab [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:25.094198 22549 consensus_peers.cc:597] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.096486 22547 leader_election.cc:336] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:25.099393 22549 leader_election.cc:336] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:25.096383 20705 tablet_replica.cc:333] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.102726 20705 raft_consensus.cc:2243] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.107290 20705 raft_consensus.cc:2272] T 87ec2fd4639346c6b0a138de0c31852f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.110970 20705 tablet_replica.cc:333] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.105764 22549 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:25.111711 27990 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.145138 20705 raft_consensus.cc:2243] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.148149 20705 raft_consensus.cc:2272] T 372e433359ec4224868a6883dfc642e3 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.155793 20705 tablet_replica.cc:333] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.156890 20705 raft_consensus.cc:2243] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.160413 20705 raft_consensus.cc:2272] T dae741cd77e441b281f9ed48a672f87d P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.167999 20705 tablet_replica.cc:333] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.169363 20705 raft_consensus.cc:2243] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.174590 20705 raft_consensus.cc:2272] T 81e7a6bdd47e4ede8aa8580b9375a5aa P 73070a828b23480e9c3588e376bce2ab [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.178885 20705 tablet_replica.cc:333] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.179944 20705 raft_consensus.cc:2243] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.181559 20705 raft_consensus.cc:2272] T 574068a837ce42d6a654b65aa3b4a614 P 73070a828b23480e9c3588e376bce2ab [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:25.198484 21966 consensus_peers.cc:597] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:25.203447 20705 tablet_replica.cc:333] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.204725 20705 raft_consensus.cc:2243] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.206316 20705 raft_consensus.cc:2272] T 1d3f324c9e584d26829ebc2cadc84629 P 73070a828b23480e9c3588e376bce2ab [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.216035 20705 tablet_replica.cc:333] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.225315 20705 raft_consensus.cc:2243] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.226450 20705 raft_consensus.cc:2272] T 032f8014213a49d395c150ebc9f55752 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.230155 20705 tablet_replica.cc:333] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.234346 20705 raft_consensus.cc:2243] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.236846 20705 raft_consensus.cc:2272] T 3804cba5d43c4079bb7bb28082798098 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.268193 20705 tablet_replica.cc:333] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.269260 20705 raft_consensus.cc:2243] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.271896 20705 raft_consensus.cc:2272] T 28c070f8afb4493ca787ffc8b1482e7a P 73070a828b23480e9c3588e376bce2ab [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.283190 20705 tablet_replica.cc:333] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.284163 20705 raft_consensus.cc:2243] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.295275 20705 raft_consensus.cc:2272] T 8145e629270b44a298b6e1c1b249989f P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.304352 20705 tablet_replica.cc:333] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.307307 20705 raft_consensus.cc:2243] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.319336 20705 raft_consensus.cc:2272] T e47334283cbf402c8d1c42ff7264f7e7 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.334571 20705 tablet_replica.cc:333] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
W20260709 12:12:25.375922 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:25.379220 20705 raft_consensus.cc:2243] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.381031 20705 raft_consensus.cc:2272] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.385126 20705 tablet_replica.cc:333] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.386370 20705 raft_consensus.cc:2243] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.392455 20705 raft_consensus.cc:2272] T 02f67b74a580421b99787adc89841d21 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.395632 20705 tablet_replica.cc:333] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.396705 20705 raft_consensus.cc:2243] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.410203 20705 raft_consensus.cc:2272] T 279111025ee54aba83c27bba63339332 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.413326 20705 tablet_replica.cc:333] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.414312 20705 raft_consensus.cc:2243] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.415117 20705 raft_consensus.cc:2272] T 947619c833644483a9745291e5d8ba38 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:25.440619 22549 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:25.425547 20705 tablet_replica.cc:333] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.451089 20705 raft_consensus.cc:2243] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:25.457707 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:25.476392 20705 raft_consensus.cc:2272] T ae7bfef0e495480e843989cbb71b4330 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.481846 20705 tablet_replica.cc:333] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.515470 28122 raft_consensus.cc:493] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:25.516245 28122 raft_consensus.cc:515] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:25.483656 20705 raft_consensus.cc:2243] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.518983 28123 raft_consensus.cc:493] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:25.519632 28123 raft_consensus.cc:515] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:25.521989 28123 leader_election.cc:290] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:25.524569 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265f2ffa166449ee9bfd498dacfcc48f" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:12:25.528959 21964 leader_election.cc:336] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:25.530333 21967 leader_election.cc:304] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:25.532613 28136 raft_consensus.cc:2749] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:25.538074 28122 leader_election.cc:290] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
I20260709 12:12:25.539707 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbfd595fdbf3470193f7cd91b4969857" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:12:25.553166 21966 leader_election.cc:336] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:25.553655 21966 leader_election.cc:304] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:25.554738 28122 raft_consensus.cc:2749] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.519107 20705 raft_consensus.cc:2272] T fe6b96986b574ee88589e15157b5260b P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.583771 20705 tablet_replica.cc:333] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.584712 20705 raft_consensus.cc:2243] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.632915 20705 raft_consensus.cc:2272] T 8fce2d558023440ebf41a6f0ed6a062b P 73070a828b23480e9c3588e376bce2ab [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.660053 28143 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:25.660830 28143 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:25.664125 28143 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:25.669596 22547 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:25.672864 20705 tablet_replica.cc:333] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.688868 28122 raft_consensus.cc:493] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:25.689618 28122 raft_consensus.cc:515] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:25.693167 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817b6d8ff1d5425b9fdaf0cef3daa8c2" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:25.695073 28122 leader_election.cc:290] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:25.702785 21966 leader_election.cc:336] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:25.703260 21966 leader_election.cc:304] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:25.707864 28122 raft_consensus.cc:2749] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:25.716948 20705 raft_consensus.cc:2243] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:12:25.720652 22549 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:25.733451 20705 raft_consensus.cc:2272] T f74e6f0a66904748bff04fe46aed7685 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.736950 20705 tablet_replica.cc:333] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.737847 20705 raft_consensus.cc:2243] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.760035 20705 raft_consensus.cc:2272] T 01221e34ce744d078265a58313d176a5 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:25.766121 22549 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:25.766685 22549 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:25.773926 28143 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:25.778550 28122 raft_consensus.cc:493] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:25.779294 28122 raft_consensus.cc:515] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:25.782606 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2526f3581f34316a1eb1e329b5d5af9" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
I20260709 12:12:25.784341 28122 leader_election.cc:290] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:25.789599 21966 leader_election.cc:336] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:25.790064 21966 leader_election.cc:304] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:25.791181 28122 raft_consensus.cc:2749] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:25.796723 22549 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:25.799078 20705 tablet_replica.cc:333] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.799930 20705 raft_consensus.cc:2243] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.801623 20705 raft_consensus.cc:2272] T 03e031f17c4d400c9fe7c2c101148ff0 P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.804607 20705 tablet_replica.cc:333] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.805421 20705 raft_consensus.cc:2243] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.806916 20705 raft_consensus.cc:2272] T 74ed463cf25c4e46900f103087ec2300 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.810460 20705 tablet_replica.cc:333] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.817911 20705 raft_consensus.cc:2243] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.819332 20705 raft_consensus.cc:2272] T 1634cc7afa814a3889101c2be1c108ad P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.822189 20705 tablet_replica.cc:333] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.823036 20705 raft_consensus.cc:2243] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.823921 20705 raft_consensus.cc:2272] T 52d6c6b59b7b44f4b009fc6edfc800eb P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:25.851265 22549 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:25.852161 22549 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 649 similar messages]
I20260709 12:12:25.860306 20705 tablet_replica.cc:333] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.872711 20705 raft_consensus.cc:2243] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.884580 20705 raft_consensus.cc:2272] T 2f4600c62493468899ff64fcf08d4fbe P 73070a828b23480e9c3588e376bce2ab [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.892892 20705 tablet_replica.cc:333] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.893900 20705 raft_consensus.cc:2243] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.895238 20705 raft_consensus.cc:2272] T d194e05a662143ea99bad3093bf3e0dd P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.898319 20705 tablet_replica.cc:333] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.899222 20705 raft_consensus.cc:2243] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.901520 20705 raft_consensus.cc:2272] T 9f7597e7938d4462a3e662f6b63d059a P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.905220 20705 tablet_replica.cc:333] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.906188 20705 raft_consensus.cc:2243] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.907035 20705 raft_consensus.cc:2272] T 3849f2f975df439d82d57276c716d6b8 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.910614 20705 tablet_replica.cc:333] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.911347 20705 raft_consensus.cc:2243] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.912676 20705 raft_consensus.cc:2272] T 209865ca9a104769a09f3a5f4a1e8b79 P 73070a828b23480e9c3588e376bce2ab [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.915542 20705 tablet_replica.cc:333] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.916209 20705 raft_consensus.cc:2243] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.932466 28143 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:25.933270 28143 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:25.937139 28143 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:25.939520 28122 raft_consensus.cc:493] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ac07267c8cab47d4b59dc27d6fe9a386)
I20260709 12:12:25.940267 28122 raft_consensus.cc:515] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:25.947997 22583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127c5582f284fbd97aa877ecdd4d4f4" candidate_uuid: "73070a828b23480e9c3588e376bce2ab" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" is_pre_election: true
W20260709 12:12:25.952814 21964 leader_election.cc:336] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:25.953336 21964 leader_election.cc:304] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73070a828b23480e9c3588e376bce2ab; no voters: ac07267c8cab47d4b59dc27d6fe9a386, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:25.962805 28123 raft_consensus.cc:2749] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.963595 28122 leader_election.cc:290] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), ac07267c8cab47d4b59dc27d6fe9a386 (127.20.56.68:40043)
W20260709 12:12:25.969986 22547 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:25.974321 22549 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:25.974838 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:25.963696 20705 raft_consensus.cc:2272] T fbfd595fdbf3470193f7cd91b4969857 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.977787 20705 tablet_replica.cc:333] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.978525 20705 raft_consensus.cc:2243] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.979354 20705 raft_consensus.cc:2272] T 265f2ffa166449ee9bfd498dacfcc48f P 73070a828b23480e9c3588e376bce2ab [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.982156 20705 tablet_replica.cc:333] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:25.982862 20705 raft_consensus.cc:2243] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.983752 20705 raft_consensus.cc:2272] T f127c5582f284fbd97aa877ecdd4d4f4 P 73070a828b23480e9c3588e376bce2ab [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.986193 20705 tablet_replica.cc:333] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
W20260709 12:12:25.986855 22549 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:25.987529 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:25.988255 28143 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.997306 20705 raft_consensus.cc:2243] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.998096 20705 raft_consensus.cc:2272] T c2526f3581f34316a1eb1e329b5d5af9 P 73070a828b23480e9c3588e376bce2ab [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.000860 20705 tablet_replica.cc:333] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab: stopping tablet replica
I20260709 12:12:26.001597 20705 raft_consensus.cc:2243] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.002298 20705 raft_consensus.cc:2272] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P 73070a828b23480e9c3588e376bce2ab [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.076866 28143 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:26.077499 28143 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.093545 28143 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:26.102226 22547 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:26.117650 22549 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:26.118162 22549 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:26.118541 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:26.123884 28143 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:26.139233 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:26.180437 22549 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:26.212234 28143 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:26.212922 28143 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:26.220000 22549 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:26.226471 22547 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:26.227748 22547 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:26.227236 28143 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:26.229488 28139 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:26.230340 22549 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:26.242726 28143 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:26.243399 28143 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:26.250945 22549 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:26.253558 22547 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:26.253976 22547 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:26.254877 28139 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:26.245579 28143 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:26.261591 22549 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:26.296051 28143 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:26.296630 28143 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.298882 28143 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:26.303934 22549 leader_election.cc:336] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:26.304881 22549 leader_election.cc:336] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:26.305362 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:26.306461 28139 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:26.307055 28139 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:26.313791 22547 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:26.314612 28143 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:26.315253 28143 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.321059 28139 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:26.322003 28139 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:26.322487 28143 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:26.326683 22547 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:26.348989 22549 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:26.349591 22549 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:26.350485 28151 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:26.352552 22549 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:26.353024 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:26.353859 28151 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:26.411399 28151 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:26.412026 28151 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.414189 28151 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:26.420379 22549 leader_election.cc:336] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:26.420857 22547 leader_election.cc:336] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:26.421271 22547 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:26.422430 28151 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:26.463470 22547 consensus_peers.cc:597] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:26.472733 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:26.477355 22547 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:26.564702 22547 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:26.570325 28151 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:26.570933 28151 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.573120 28151 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:26.575794 28151 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:12:26.578914 22549 leader_election.cc:336] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:26.580129 22547 leader_election.cc:336] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:26.580518 22547 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:26.581576 28149 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:26.583986 28150 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:26.584483 28150 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.586529 28150 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:26.576400 28151 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.589130 28151 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:26.591888 22547 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:26.594466 22549 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:26.595355 22549 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:26.595778 22549 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:26.597060 28150 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:26.597944 22549 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:26.606215 22547 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:26.607185 22547 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:26.610054 22547 consensus_peers.cc:597] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:26.610739 22549 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:26.611071 28151 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:26.616360 22547 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:26.622859 28150 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:26.623425 28150 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.625805 28150 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:26.633510 22547 leader_election.cc:336] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:26.634297 22549 leader_election.cc:336] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:26.634696 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:26.635411 28150 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:26.711611 22547 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:26.725857 22547 consensus_peers.cc:597] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:26.753610 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:26.811146 22547 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:26.878396 22547 consensus_peers.cc:597] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:26.879256 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:26.891309 28150 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:26.891978 28150 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.894335 28150 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:26.905905 22547 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:26.910364 22549 leader_election.cc:336] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:26.912035 22549 leader_election.cc:336] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:26.912528 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:26.913358 28150 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:26.935319 28151 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:26.935885 28151 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:26.938086 28151 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:26.956463 22547 leader_election.cc:336] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:26.963804 28151 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:26.964776 28151 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:26.967619 22549 leader_election.cc:336] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:26.967855 28151 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:26.968127 22549 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:26.968969 28151 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:26.974262 22549 consensus_peers.cc:597] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:26.984447 22549 leader_election.cc:336] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:26.985246 22549 leader_election.cc:336] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:26.985687 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:26.986455 28150 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.014609 28150 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:27.015223 28150 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:27.017608 28150 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:27.029670 22547 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:27.035449 22549 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:27.039162 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:27.041221 28150 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.064013 28150 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:27.066893 28150 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:27.070727 28150 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:27.075546 22547 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:27.089670 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.107666 22549 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:27.108263 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:27.109109 28150 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:27.113358 22549 consensus_peers.cc:597] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:27.122047 28151 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:27.122633 28151 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:27.133948 28151 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:27.136976 28151 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:27.137513 28151 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:27.139671 28151 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:27.140304 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:27.145147 22549 leader_election.cc:336] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:27.144578 22547 leader_election.cc:336] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:27.148654 22549 leader_election.cc:336] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:27.149184 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:27.153030 28151 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:27.156309 22549 leader_election.cc:336] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:27.164198 22549 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:27.165045 28151 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:27.178218 22547 consensus_peers.cc:597] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:27.180949 28151 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:27.181527 28151 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:27.183765 28151 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:27.187883 22547 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:27.192684 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.205303 22549 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:27.205896 22549 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:27.206781 28151 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:27.313452 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.331353 20705 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22022)
W20260709 12:12:27.333892 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.355595 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.359220 22549 consensus_peers.cc:597] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.439103 22549 consensus_peers.cc:597] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.466938 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:27.467813 28151 raft_consensus.cc:493] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:27.468372 28151 raft_consensus.cc:515] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:27.471086 28151 leader_election.cc:290] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:27.476374 22547 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:27.487664 22549 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:27.488220 22549 leader_election.cc:304] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:27.489001 28151 raft_consensus.cc:2749] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:27.489104 22549 leader_election.cc:336] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:27.491453 22549 consensus_peers.cc:597] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.516434 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:27.541587 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.596251 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:27.736769 28150 raft_consensus.cc:493] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:27.737439 28150 raft_consensus.cc:515] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:27.739691 28150 leader_election.cc:290] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:27.750147 22547 leader_election.cc:336] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:27.751051 22549 leader_election.cc:336] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:27.751499 22549 leader_election.cc:304] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:27.752676 28151 raft_consensus.cc:2749] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:27.770151 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.783757 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:28.020339 22549 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:28.035418 28150 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.035993 28150 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:28.038267 28150 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.053174 22547 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:28.055562 28154 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
W20260709 12:12:28.055889 22549 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:28.056149 28154 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:28.058349 22549 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.061298 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:28.060006 28154 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
I20260709 12:12:28.062713 28154 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:28.070588 22547 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:28.084657 22549 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:28.085126 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:28.085839 28154 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:28.243201 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:28.279387 28150 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.279925 28150 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:28.282073 28150 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.288069 22549 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:28.288961 22547 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:28.289397 22547 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:28.292492 28150 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.296929 28150 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.297416 28150 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:28.302932 28154 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.303471 28154 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:28.305029 22547 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:28.305555 28154 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.309376 22549 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:28.310041 22549 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:28.311203 22549 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.311652 28154 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:28.300217 28150 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.316597 22549 leader_election.cc:336] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:28.317286 22549 leader_election.cc:336] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.319152 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:28.324613 28150 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:28.331835 20705 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22022)
W20260709 12:12:28.371784 22549 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:28.459759 22549 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:28.460724 28150 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:28.461369 28150 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:28.470211 22547 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:28.474092 28150 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:28.474673 22549 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:28.475418 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:28.476720 28150 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:28.520511 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:28.537108 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:28.618212 28154 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.618851 28154 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:28.628976 28154 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.638386 22547 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:28.653751 22549 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.654618 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:28.655521 28154 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.671401 28154 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.672019 28154 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:28.674599 28154 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.680300 22547 leader_election.cc:336] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:28.683743 22549 leader_election.cc:336] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.684194 22549 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:28.684947 28154 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:28.688529 22549 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:28.702203 22549 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:28.737982 22547 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:28.739205 28150 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.739753 28150 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:28.741883 28150 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:28.743423 28150 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.744433 28150 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:28.746322 22549 leader_election.cc:336] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.748683 28150 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.748749 22547 leader_election.cc:336] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:28.749220 22547 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
W20260709 12:12:28.754323 22549 leader_election.cc:336] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.754729 28150 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:28.755182 22547 leader_election.cc:336] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:28.756021 22547 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:28.756839 28154 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:28.766801 28150 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.767385 28150 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:28.774081 22549 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:28.775166 28150 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.778898 22549 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.779316 22549 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:28.780057 28154 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.791289 28154 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.791882 28154 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:28.794214 28154 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.799597 22547 leader_election.cc:336] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:28.808022 22549 leader_election.cc:336] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.808591 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:28.809890 28150 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.929517 28155 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.930094 28155 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:28.932480 28155 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.939615 22549 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:28.941063 22547 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:28.944442 22547 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:28.947088 28155 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:28.947549 22549 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:28.972980 28150 raft_consensus.cc:493] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:28.973544 28150 raft_consensus.cc:515] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:28.975708 28150 leader_election.cc:290] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:28.985095 22549 leader_election.cc:336] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:28.985859 22549 leader_election.cc:336] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:28.987491 22549 leader_election.cc:304] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:28.996160 28150 raft_consensus.cc:2749] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:29.001698 28150 raft_consensus.cc:493] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:29.002220 28150 raft_consensus.cc:515] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:29.004264 28150 leader_election.cc:290] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:29.028048 22549 leader_election.cc:336] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:29.029011 22549 leader_election.cc:336] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:29.029450 22549 leader_election.cc:304] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:29.030252 28155 raft_consensus.cc:2749] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:29.040283 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:29.083432 22547 consensus_peers.cc:597] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:29.140724 22547 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:29.180599 22547 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:29.181438 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:29.212270 28155 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:29.212833 28155 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:29.215237 28155 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:29.224676 22547 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:29.225644 22547 consensus_peers.cc:597] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:29.231878 22549 leader_election.cc:336] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:29.233806 22549 leader_election.cc:336] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:29.247211 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:29.255205 28155 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:29.265843 22547 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:29.285925 28150 raft_consensus.cc:493] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:29.286530 28150 raft_consensus.cc:515] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:29.288914 28150 leader_election.cc:290] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:29.294453 22547 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:29.301271 22549 leader_election.cc:336] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:29.301848 22549 leader_election.cc:304] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:29.303339 28150 raft_consensus.cc:2749] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:29.313182 22547 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:29.350354 28150 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:29.350998 28150 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:29.355268 28150 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:29.362604 22547 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:29.363802 22549 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:29.364183 22549 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:29.365906 28150 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:29.370401 22549 consensus_peers.cc:597] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:29.454768 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:29.470201 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:29.480841 28150 raft_consensus.cc:493] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:29.486443 28150 raft_consensus.cc:515] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:29.488727 28150 leader_election.cc:290] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:29.485491 22547 consensus_peers.cc:597] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:29.494374 22547 leader_election.cc:336] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:29.503167 22547 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:29.508343 22549 leader_election.cc:336] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:29.508917 22549 leader_election.cc:304] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:29.509757 28150 raft_consensus.cc:2749] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:29.525714 28150 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:29.526284 28150 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:29.538311 22549 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:29.539224 22547 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:29.539672 22547 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:29.540439 28155 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:29.540668 28150 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:29.660254 22547 consensus_peers.cc:597] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:29.670842 22549 consensus_peers.cc:597] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:29.731186 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:29.797602 22547 consensus_peers.cc:597] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:29.828338 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:29.859099 22549 consensus_peers.cc:597] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:29.884373 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:29.888331 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:29.976989 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:29.977591 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:30.011264 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:30.067986 22549 consensus_peers.cc:597] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:30.072795 22549 consensus_peers.cc:597] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:30.100373 22549 consensus_peers.cc:597] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:30.168246 22549 consensus_peers.cc:597] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:30.326506 22549 consensus_peers.cc:597] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:30.358294 22549 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:30.375705 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:30.656598 22549 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:30.713200 22549 consensus_peers.cc:597] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:12:30.728662 28155 raft_consensus.cc:493] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:30.729254 28155 raft_consensus.cc:515] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:30.731348 28155 leader_election.cc:290] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:30.737648 22547 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:30.739216 22549 leader_election.cc:336] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:30.739640 22549 leader_election.cc:304] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:30.740305 28155 raft_consensus.cc:2749] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:30.758319 21736 catalog_manager.cc:4755] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9f7597e7938d4462a3e662f6b63d059a: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:30.799909 22549 consensus_peers.cc:597] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:30.867760 28155 raft_consensus.cc:493] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:30.868305 28155 raft_consensus.cc:515] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:30.869808 22549 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111) [suppressed 510 similar messages]
I20260709 12:12:30.870455 28155 leader_election.cc:290] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:30.877076 22547 leader_election.cc:336] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:30.880651 22549 leader_election.cc:336] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:30.881183 22549 leader_election.cc:304] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:30.881978 28155 raft_consensus.cc:2749] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.906121 22549 consensus_peers.cc:597] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:30.908499 22549 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:31.001830 20705 tablet_server.cc:196] TabletServer@127.20.56.67:0 shutdown complete.
I20260709 12:12:31.014585 28150 raft_consensus.cc:493] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:31.015147 28150 raft_consensus.cc:515] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.016990 28150 leader_election.cc:290] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:31.021420 22547 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:31.023445 22549 leader_election.cc:336] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:31.023840 22549 leader_election.cc:304] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.024997 28150 raft_consensus.cc:2749] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:31.047055 28155 raft_consensus.cc:493] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.047577 28155 raft_consensus.cc:515] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.049500 28155 leader_election.cc:290] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:31.057672 22547 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:31.063773 22549 consensus_peers.cc:597] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:31.066017 22549 leader_election.cc:336] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:31.073063 22549 leader_election.cc:304] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.074492 28155 raft_consensus.cc:2749] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.139003 28155 raft_consensus.cc:493] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.139561 28155 raft_consensus.cc:515] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.141717 28155 leader_election.cc:290] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:31.146052 28150 raft_consensus.cc:493] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.146553 28150 raft_consensus.cc:515] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.148521 28150 leader_election.cc:290] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:31.148962 28150 raft_consensus.cc:493] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:31.149349 28150 raft_consensus.cc:515] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } attrs { replace: true } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:31.162431 22549 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:31.172801 28150 leader_election.cc:290] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:31.176945 22549 leader_election.cc:336] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:31.177995 22549 leader_election.cc:304] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
W20260709 12:12:31.178599 22547 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:31.182452 28160 raft_consensus.cc:2749] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:31.187819 22547 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:31.197804 22549 leader_election.cc:336] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:31.200053 22549 leader_election.cc:304] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.200933 28160 raft_consensus.cc:2749] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:31.206153 28160 raft_consensus.cc:493] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:31.206734 28160 raft_consensus.cc:515] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:31.208483 22549 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:31.209060 28160 leader_election.cc:290] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:31.213498 22547 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:31.208930 22549 leader_election.cc:304] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.220227 28150 raft_consensus.cc:2749] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:31.221971 22549 leader_election.cc:336] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:31.228726 28150 raft_consensus.cc:493] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.229182 28150 raft_consensus.cc:515] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.231410 28150 leader_election.cc:290] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:31.236471 22547 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:31.237355 22549 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:31.253276 22549 leader_election.cc:336] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:31.253815 22549 leader_election.cc:304] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.254552 28160 raft_consensus.cc:493] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.263767 28150 raft_consensus.cc:2749] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:31.263651 28160 raft_consensus.cc:515] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:31.264765 22549 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:31.266176 28160 leader_election.cc:290] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:31.270174 22547 leader_election.cc:336] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:31.271320 28160 raft_consensus.cc:493] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ecd8f47cd089480aa1f77728a400384a)
I20260709 12:12:31.271894 28160 raft_consensus.cc:515] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.274081 28160 leader_election.cc:290] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757)
W20260709 12:12:31.279285 22547 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:31.282543 22549 leader_election.cc:336] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:31.283195 22549 leader_election.cc:304] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.283859 28160 raft_consensus.cc:2749] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:31.302510 22549 leader_election.cc:336] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:31.302970 22549 leader_election.cc:304] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.303715 28160 raft_consensus.cc:2749] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:31.317873 22549 leader_election.cc:336] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:31.318354 22549 leader_election.cc:304] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.319082 28160 raft_consensus.cc:2749] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:31.326479 28160 raft_consensus.cc:493] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.326979 28160 raft_consensus.cc:515] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.328833 28160 leader_election.cc:290] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:31.349505 22549 leader_election.cc:336] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:31.350940 22549 leader_election.cc:336] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:31.351358 22549 leader_election.cc:304] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:31.352051 28160 raft_consensus.cc:2749] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:31.367537 22549 consensus_peers.cc:597] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:31.426584 22547 consensus_peers.cc:597] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:31.429786 28160 raft_consensus.cc:493] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.430341 28160 raft_consensus.cc:515] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.432540 28160 leader_election.cc:290] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:31.441078 22549 leader_election.cc:336] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
W20260709 12:12:31.441769 22549 leader_election.cc:336] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:31.442165 22549 leader_election.cc:304] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, cffb5c192e144f7caa7b94271976ed42
I20260709 12:12:31.443499 28160 raft_consensus.cc:2749] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.482877 20705 tablet_server.cc:179] TabletServer@127.20.56.68:0 shutting down...
W20260709 12:12:31.535102 22547 consensus_peers.cc:597] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:31.556533 28160 raft_consensus.cc:493] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.557181 28160 raft_consensus.cc:515] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.564124 28160 leader_election.cc:290] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:31.568604 22547 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:31.570149 22549 leader_election.cc:336] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:31.570580 22549 leader_election.cc:304] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.571302 28160 raft_consensus.cc:2749] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:31.581765 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:31.582957 20705 tablet_replica.cc:333] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.584142 20705 raft_consensus.cc:2243] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.585116 20705 raft_consensus.cc:2272] T 3804cba5d43c4079bb7bb28082798098 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.589012 20705 tablet_replica.cc:333] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.590070 20705 raft_consensus.cc:2243] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.591248 20705 raft_consensus.cc:2272] T 9f7597e7938d4462a3e662f6b63d059a P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.594703 20705 tablet_replica.cc:333] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.598960 20705 raft_consensus.cc:2243] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.601542 20705 raft_consensus.cc:2272] T 4d3beb28cf484708af67a4cafaaa657b P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.605444 20705 tablet_replica.cc:333] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.606652 20705 raft_consensus.cc:2243] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.607895 20705 raft_consensus.cc:2272] T fe6b96986b574ee88589e15157b5260b P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.611292 20705 tablet_replica.cc:333] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.612350 20705 raft_consensus.cc:2243] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.613512 20705 raft_consensus.cc:2272] T 11bd5972700f42709d3ebcb0a6d9b51c P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.617121 20705 tablet_replica.cc:333] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.618083 20705 raft_consensus.cc:2243] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.618928 20705 raft_consensus.cc:2272] T 279111025ee54aba83c27bba63339332 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.622156 20705 tablet_replica.cc:333] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.623075 20705 raft_consensus.cc:2243] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.623852 20705 raft_consensus.cc:2272] T 3a7076f768c74a41bc54edd6bcaaaf83 P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.626950 20705 tablet_replica.cc:333] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.627954 20705 raft_consensus.cc:2243] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.629549 20705 raft_consensus.cc:2272] T 8fce2d558023440ebf41a6f0ed6a062b P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.632920 20705 tablet_replica.cc:333] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.633945 20705 raft_consensus.cc:2243] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.635296 20705 raft_consensus.cc:2272] T 1238ec38c933498cadf6153a5554f6e0 P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:31.648685 22547 consensus_peers.cc:597] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:31.649560 20705 tablet_replica.cc:333] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.650592 20705 raft_consensus.cc:2243] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.651322 20705 raft_consensus.cc:2272] T d194e05a662143ea99bad3093bf3e0dd P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:31.661257 22547 consensus_peers.cc:597] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:31.662452 20705 tablet_replica.cc:333] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.663594 20705 raft_consensus.cc:2243] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.665256 20705 raft_consensus.cc:2272] T 68b43b3517064c3b81e50b88c21938ce P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.668639 20705 tablet_replica.cc:333] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.670212 28160 raft_consensus.cc:493] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.670948 28160 raft_consensus.cc:515] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "cffb5c192e144f7caa7b94271976ed42" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42093 } } peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } attrs { replace: true } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
W20260709 12:12:31.687227 22547 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
W20260709 12:12:31.688270 22549 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:31.688714 22549 leader_election.cc:304] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: cffb5c192e144f7caa7b94271976ed42, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.692332 28150 raft_consensus.cc:2749] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:31.693594 28160 leader_election.cc:290] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093), ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:31.695348 28161 raft_consensus.cc:493] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.695820 28161 raft_consensus.cc:515] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.698113 28161 leader_election.cc:290] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
W20260709 12:12:31.702585 22547 leader_election.cc:336] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:31.713007 20705 raft_consensus.cc:2243] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.714461 20705 raft_consensus.cc:2272] T 3b662199918843a1a8139ac42424d3f6 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:31.718254 22549 consensus_peers.cc:597] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:31.721935 22549 leader_election.cc:336] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:31.722879 22549 leader_election.cc:336] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
I20260709 12:12:31.723340 22549 leader_election.cc:304] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.724207 28161 raft_consensus.cc:2749] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:31.721215 20705 tablet_replica.cc:333] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.727130 20705 raft_consensus.cc:2243] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.728302 20705 raft_consensus.cc:2272] T dae741cd77e441b281f9ed48a672f87d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.736675 20705 tablet_replica.cc:333] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.739513 20705 raft_consensus.cc:2243] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.740823 20705 raft_consensus.cc:2272] T d28906331f4545a29562f950eacb999e P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:31.738396 22549 consensus_peers.cc:597] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Couldn't send request to peer 73070a828b23480e9c3588e376bce2ab. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:31.750970 20705 tablet_replica.cc:333] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.751964 20705 raft_consensus.cc:2243] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.753238 20705 raft_consensus.cc:2272] T f127c5582f284fbd97aa877ecdd4d4f4 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.756484 20705 tablet_replica.cc:333] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.757385 20705 raft_consensus.cc:2243] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.758826 20705 raft_consensus.cc:2272] T c2526f3581f34316a1eb1e329b5d5af9 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:31.783241 22547 consensus_peers.cc:597] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:31.791067 22547 consensus_peers.cc:597] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Couldn't send request to peer ecd8f47cd089480aa1f77728a400384a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:31.791992 20705 tablet_replica.cc:333] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.793071 20705 raft_consensus.cc:2243] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.793920 20705 raft_consensus.cc:2272] T abcd87e902c445c5b3c3a383d5f1b3eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.797077 20705 tablet_replica.cc:333] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.798077 20705 raft_consensus.cc:2243] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.799176 20705 raft_consensus.cc:2272] T 5e2003af45914197b88e4cc3389271af P ac07267c8cab47d4b59dc27d6fe9a386 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.802191 20705 tablet_replica.cc:333] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.803208 20705 raft_consensus.cc:2243] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.804587 20705 raft_consensus.cc:2272] T 77a9143d931e458e9c5824195395a69b P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.813042 20705 tablet_replica.cc:333] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.813997 20705 raft_consensus.cc:2243] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.815332 20705 raft_consensus.cc:2272] T 28c070f8afb4493ca787ffc8b1482e7a P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.818655 20705 tablet_replica.cc:333] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.819593 20705 raft_consensus.cc:2243] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.820734 20705 raft_consensus.cc:2272] T c93911a59a2c46bb9745487e082af441 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.830497 20705 tablet_replica.cc:333] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
W20260709 12:12:31.836156 22549 consensus_peers.cc:597] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 -> Peer cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): Couldn't send request to peer cffb5c192e144f7caa7b94271976ed42. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:31.837754 20705 raft_consensus.cc:2243] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.839640 20705 raft_consensus.cc:2272] T 3849f2f975df439d82d57276c716d6b8 P ac07267c8cab47d4b59dc27d6fe9a386 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.849179 20705 tablet_replica.cc:333] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.850257 20705 raft_consensus.cc:2243] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.852321 20705 raft_consensus.cc:2272] T 1cc81c27d5d3424db1dfbfc977e0369d P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.855561 20705 tablet_replica.cc:333] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.856489 20705 raft_consensus.cc:2243] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.857833 20705 raft_consensus.cc:2272] T 1d3f324c9e584d26829ebc2cadc84629 P ac07267c8cab47d4b59dc27d6fe9a386 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.861105 20705 tablet_replica.cc:333] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.861990 20705 raft_consensus.cc:2243] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.862700 20705 raft_consensus.cc:2272] T 1634cc7afa814a3889101c2be1c108ad P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.865711 20705 tablet_replica.cc:333] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.866624 20705 raft_consensus.cc:2243] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.867978 20705 raft_consensus.cc:2272] T 52d6c6b59b7b44f4b009fc6edfc800eb P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.871205 20705 tablet_replica.cc:333] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.872140 20705 raft_consensus.cc:2243] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.873540 20705 raft_consensus.cc:2272] T ff3fa17120b9481fbb27a63e11e13340 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.877614 20705 tablet_replica.cc:333] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.878588 20705 raft_consensus.cc:2243] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.879609 20705 raft_consensus.cc:2272] T 3e9858619e3a4ae383caadbb133747bc P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.882923 20705 tablet_replica.cc:333] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.883993 20705 raft_consensus.cc:2243] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.885317 20705 raft_consensus.cc:2272] T a6e5de589d8b434b87a0bf4f41fb63ba P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.888772 20705 tablet_replica.cc:333] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.889671 20705 raft_consensus.cc:2243] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.890959 20705 raft_consensus.cc:2272] T 2e7beebb504f4966b0b73ec1fd85c8d1 P ac07267c8cab47d4b59dc27d6fe9a386 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.894102 20705 tablet_replica.cc:333] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.895018 20705 raft_consensus.cc:2243] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.896251 20705 raft_consensus.cc:2272] T e47334283cbf402c8d1c42ff7264f7e7 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.899230 20705 tablet_replica.cc:333] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.900094 20705 raft_consensus.cc:2243] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.901175 20705 raft_consensus.cc:2272] T 04f08cb5ae6d4138a6d803e9cf3c8f38 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.904560 20705 tablet_replica.cc:333] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.905645 20705 raft_consensus.cc:2243] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.906631 20705 raft_consensus.cc:2272] T 02f67b74a580421b99787adc89841d21 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.910025 20705 tablet_replica.cc:333] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.911057 20705 raft_consensus.cc:2243] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.912039 20705 raft_consensus.cc:2272] T 5937d593814d4b568742fc86c954922d P ac07267c8cab47d4b59dc27d6fe9a386 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.915723 20705 tablet_replica.cc:333] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.916729 20705 raft_consensus.cc:2243] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.918036 20705 raft_consensus.cc:2272] T d50c36e857cb4e33997aee7e5dd39447 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.922369 20705 tablet_replica.cc:333] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.923362 20705 raft_consensus.cc:2243] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.924331 20705 raft_consensus.cc:2272] T 3732a691799e4f2abfe58158cddce045 P ac07267c8cab47d4b59dc27d6fe9a386 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.927376 20705 tablet_replica.cc:333] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.928598 20705 raft_consensus.cc:2243] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.929782 20705 raft_consensus.cc:2272] T f74e6f0a66904748bff04fe46aed7685 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.933298 20705 tablet_replica.cc:333] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.934305 20705 raft_consensus.cc:2243] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.935863 20705 raft_consensus.cc:2272] T 817b6d8ff1d5425b9fdaf0cef3daa8c2 P ac07267c8cab47d4b59dc27d6fe9a386 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.939234 20705 tablet_replica.cc:333] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.940354 20705 raft_consensus.cc:2243] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.941636 20705 raft_consensus.cc:2272] T 265f2ffa166449ee9bfd498dacfcc48f P ac07267c8cab47d4b59dc27d6fe9a386 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.944772 20705 tablet_replica.cc:333] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.945711 20705 raft_consensus.cc:2243] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:31.947113 20705 raft_consensus.cc:2272] T fbfd595fdbf3470193f7cd91b4969857 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.950392 20705 tablet_replica.cc:333] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.950839 28161 raft_consensus.cc:493] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73070a828b23480e9c3588e376bce2ab)
I20260709 12:12:31.951376 20705 raft_consensus.cc:2243] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.951423 28161 raft_consensus.cc:515] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ecd8f47cd089480aa1f77728a400384a" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34757 } } peers { permanent_uuid: "73070a828b23480e9c3588e376bce2ab" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39721 } } peers { permanent_uuid: "ac07267c8cab47d4b59dc27d6fe9a386" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 40043 } attrs { promote: false } }
I20260709 12:12:31.952463 20705 raft_consensus.cc:2272] T 74ed463cf25c4e46900f103087ec2300 P ac07267c8cab47d4b59dc27d6fe9a386 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.955585 20705 tablet_replica.cc:333] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.958288 20705 raft_consensus.cc:2243] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.960474 20705 raft_consensus.cc:2272] T 209865ca9a104769a09f3a5f4a1e8b79 P ac07267c8cab47d4b59dc27d6fe9a386 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:31.961012 22549 leader_election.cc:336] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721): Network error: Client connection negotiation failed: client connection to 127.20.56.67:39721: connect: Connection refused (error 111)
W20260709 12:12:31.961920 22547 leader_election.cc:336] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757): Network error: Client connection negotiation failed: client connection to 127.20.56.66:34757: connect: Connection refused (error 111)
I20260709 12:12:31.962329 22547 leader_election.cc:304] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac07267c8cab47d4b59dc27d6fe9a386; no voters: 73070a828b23480e9c3588e376bce2ab, ecd8f47cd089480aa1f77728a400384a
I20260709 12:12:31.963088 28160 raft_consensus.cc:2749] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:12:31.963325 28161 leader_election.cc:290] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ecd8f47cd089480aa1f77728a400384a (127.20.56.66:34757), 73070a828b23480e9c3588e376bce2ab (127.20.56.67:39721)
I20260709 12:12:31.964444 20705 tablet_replica.cc:333] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.965392 20705 raft_consensus.cc:2243] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.966590 20705 raft_consensus.cc:2272] T 81e7a6bdd47e4ede8aa8580b9375a5aa P ac07267c8cab47d4b59dc27d6fe9a386 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:31.969854 20705 tablet_replica.cc:333] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386: stopping tablet replica
I20260709 12:12:31.970732 20705 raft_consensus.cc:2243] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:31.971450 20705 raft_consensus.cc:2272] T 574068a837ce42d6a654b65aa3b4a614 P ac07267c8cab47d4b59dc27d6fe9a386 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.953994 20705 tablet_server.cc:196] TabletServer@127.20.56.68:0 shutdown complete.
I20260709 12:12:33.064397 20705 master.cc:562] Master@127.20.56.126:35507 shutting down...
W20260709 12:12:33.117141 21798 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:12:33.117460 21798 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:12:33.117735 21798 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:12:34.158142 21781 debug-util.cc:398] Leaking SignalData structure 0x7b080000b6e0 after lost signal to thread 20708
W20260709 12:12:34.158677 21781 debug-util.cc:398] Leaking SignalData structure 0x7b0800305b20 after lost signal to thread 21784
W20260709 12:12:47.160979 21736 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111) [suppressed 114 similar messages]
W20260709 12:12:47.164891 21736 catalog_manager.cc:4755] TS cffb5c192e144f7caa7b94271976ed42 (127.20.56.65:42093): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9f7597e7938d4462a3e662f6b63d059a: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42093: connect: Connection refused (error 111)
I20260709 12:12:50.291932 20705 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.292932 20705 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.293263 20705 tablet_replica.cc:333] T 00000000000000000000000000000000 P 18e701898a2848c494bb06576eb2cdd4: stopping tablet replica
I20260709 12:12:50.496438 20705 master.cc:584] Master@127.20.56.126:35507 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (215216 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:12:50.622653 20705 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.56.126:36629
I20260709 12:12:50.623876 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:50.630424 28167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:50.630726 28166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:50.631152 28169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.632611 20705 server_base.cc:1061] running on GCE node
I20260709 12:12:50.635870 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:50.636075 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:50.636181 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599170636170 us; error 0 us; skew 500 ppm
I20260709 12:12:50.636647 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:50.639153 20705 webserver.cc:533] Webserver started at http://127.20.56.126:39563/ using document root <none> and password file <none>
I20260709 12:12:50.639616 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:50.639780 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:50.639999 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:50.641250 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/master-0-root/instance:
uuid: "5d6f8ce81bf04ba6a05adf7e2301c114"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-2dwh"
I20260709 12:12:50.646241 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:50.649771 28174 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.650622 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:50.650945 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/master-0-root
uuid: "5d6f8ce81bf04ba6a05adf7e2301c114"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-2dwh"
I20260709 12:12:50.651254 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:50.661943 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:50.663297 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:50.702999 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.126:36629
I20260709 12:12:50.703094 28225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.126:36629 every 8 connection(s)
I20260709 12:12:50.707420 28226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.718819 28226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114: Bootstrap starting.
I20260709 12:12:50.723839 28226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.728312 28226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114: No bootstrap required, opened a new log
I20260709 12:12:50.730688 28226 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6f8ce81bf04ba6a05adf7e2301c114" member_type: VOTER }
I20260709 12:12:50.731139 28226 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.731426 28226 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d6f8ce81bf04ba6a05adf7e2301c114, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.732121 28226 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6f8ce81bf04ba6a05adf7e2301c114" member_type: VOTER }
I20260709 12:12:50.732607 28226 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:50.732860 28226 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:50.733141 28226 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.737953 28226 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6f8ce81bf04ba6a05adf7e2301c114" member_type: VOTER }
I20260709 12:12:50.738544 28226 leader_election.cc:304] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d6f8ce81bf04ba6a05adf7e2301c114; no voters: 
I20260709 12:12:50.739801 28226 leader_election.cc:290] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:50.740257 28229 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.741699 28229 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 1 LEADER]: Becoming Leader. State: Replica: 5d6f8ce81bf04ba6a05adf7e2301c114, State: Running, Role: LEADER
I20260709 12:12:50.742501 28229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6f8ce81bf04ba6a05adf7e2301c114" member_type: VOTER }
I20260709 12:12:50.742940 28226 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:50.752590 28231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d6f8ce81bf04ba6a05adf7e2301c114. Latest consensus state: current_term: 1 leader_uuid: "5d6f8ce81bf04ba6a05adf7e2301c114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6f8ce81bf04ba6a05adf7e2301c114" member_type: VOTER } }
I20260709 12:12:50.753041 28230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d6f8ce81bf04ba6a05adf7e2301c114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d6f8ce81bf04ba6a05adf7e2301c114" member_type: VOTER } }
I20260709 12:12:50.753410 28231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:50.753921 28230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:50.755568 28239 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:50.761761 28239 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:50.762890 20705 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:50.771178 28239 catalog_manager.cc:1383] Generated new cluster ID: 83524d33bceb4f6b9d5648da9723a9d3
I20260709 12:12:50.771514 28239 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:50.804955 28239 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:50.806346 28239 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:50.833047 28239 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114: Generated new TSK 0
I20260709 12:12:50.833698 28239 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:50.893908 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:50.900280 28247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:50.901858 28248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:50.902974 28250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:50.904608 20705 server_base.cc:1061] running on GCE node
I20260709 12:12:50.906795 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:50.907056 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:50.907552 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599170907412 us; error 0 us; skew 500 ppm
I20260709 12:12:50.908226 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:50.910813 20705 webserver.cc:533] Webserver started at http://127.20.56.65:35411/ using document root <none> and password file <none>
I20260709 12:12:50.911296 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:50.911499 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:50.911828 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:50.913038 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/instance:
uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-2dwh"
I20260709 12:12:50.917922 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:12:50.921417 28255 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.922189 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:50.922544 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-2dwh"
I20260709 12:12:50.922868 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:50.937505 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:50.938774 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:50.940358 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:50.942839 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:50.943065 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.943315 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:50.943501 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:50.984967 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:41545
I20260709 12:12:50.985064 28317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:41545 every 8 connection(s)
I20260709 12:12:50.990315 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:50.997792 28322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:50.998304 28323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:51.001253 28325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:51.002029 20705 server_base.cc:1061] running on GCE node
I20260709 12:12:51.004714 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:51.004966 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:51.005187 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599171005163 us; error 0 us; skew 500 ppm
I20260709 12:12:51.005836 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:51.008307 28318 heartbeater.cc:344] Connected to a master server at 127.20.56.126:36629
I20260709 12:12:51.008701 28318 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:51.009063 20705 webserver.cc:533] Webserver started at http://127.20.56.66:41455/ using document root <none> and password file <none>
I20260709 12:12:51.009600 28318 heartbeater.cc:507] Master 127.20.56.126:36629 requested a full tablet report, sending...
I20260709 12:12:51.009694 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:51.010064 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:51.010366 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:51.012138 28191 ts_manager.cc:194] Registered new tserver with Master: 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:51.012138 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/instance:
uuid: "b94463539fe9492dbae13ef77b3cc58d"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-2dwh"
I20260709 12:12:51.014201 28191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40930
I20260709 12:12:51.017957 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:12:51.022087 28330 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.022953 20705 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:51.023300 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-1-root
uuid: "b94463539fe9492dbae13ef77b3cc58d"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-2dwh"
I20260709 12:12:51.023627 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:51.037742 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:51.039140 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:51.040665 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:51.043130 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:51.043373 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.043617 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:51.043795 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.085700 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.66:42205
I20260709 12:12:51.085799 28392 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.66:42205 every 8 connection(s)
I20260709 12:12:51.091063 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:51.098263 28396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:51.099256 28397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:51.102732 20705 server_base.cc:1061] running on GCE node
W20260709 12:12:51.102811 28399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:51.104425 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:51.104741 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:51.104867 28393 heartbeater.cc:344] Connected to a master server at 127.20.56.126:36629
I20260709 12:12:51.104955 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599171104934 us; error 0 us; skew 500 ppm
I20260709 12:12:51.105496 28393 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:51.105875 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:51.106505 28393 heartbeater.cc:507] Master 127.20.56.126:36629 requested a full tablet report, sending...
I20260709 12:12:51.108599 20705 webserver.cc:533] Webserver started at http://127.20.56.67:35293/ using document root <none> and password file <none>
I20260709 12:12:51.109134 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:51.109076 28191 ts_manager.cc:194] Registered new tserver with Master: b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:51.109557 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:51.109889 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:51.111004 28191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40940
I20260709 12:12:51.111178 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/instance:
uuid: "f4ce5f603caa48ababe023df3a36c0b4"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-2dwh"
I20260709 12:12:51.115955 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:12:51.119393 28404 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.120369 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:51.120643 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-2-root
uuid: "f4ce5f603caa48ababe023df3a36c0b4"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-2dwh"
I20260709 12:12:51.120904 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:51.140165 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:51.141616 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:51.143260 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:51.145745 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:51.145989 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.146286 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:51.146507 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:12:51.190872 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.67:39727
I20260709 12:12:51.190915 28466 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.67:39727 every 8 connection(s)
I20260709 12:12:51.195998 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:51.204697 28470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:51.206593 28471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:51.207516 20705 server_base.cc:1061] running on GCE node
W20260709 12:12:51.208680 28473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:51.209730 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:51.209992 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:51.210204 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599171210186 us; error 0 us; skew 500 ppm
I20260709 12:12:51.210410 28467 heartbeater.cc:344] Connected to a master server at 127.20.56.126:36629
I20260709 12:12:51.210877 28467 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:51.210983 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:51.211676 28467 heartbeater.cc:507] Master 127.20.56.126:36629 requested a full tablet report, sending...
I20260709 12:12:51.213841 28191 ts_manager.cc:194] Registered new tserver with Master: f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:51.214170 20705 webserver.cc:533] Webserver started at http://127.20.56.68:38323/ using document root <none> and password file <none>
I20260709 12:12:51.214736 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:51.214951 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:51.215225 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:51.215313 28191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40952
I20260709 12:12:51.216615 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-3-root/instance:
uuid: "1be5ce5bff4b443ea67188eb0de32215"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-2dwh"
I20260709 12:12:51.221089 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:51.224558 28478 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.225373 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:51.225721 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-3-root
uuid: "1be5ce5bff4b443ea67188eb0de32215"
format_stamp: "Formatted at 2026-07-09 12:12:51 on dist-test-slave-2dwh"
I20260709 12:12:51.226042 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:51.246869 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:51.248116 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:51.249639 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:51.252084 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:51.252341 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.252628 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:51.252815 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:51.294092 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.68:33813
I20260709 12:12:51.294184 28540 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.68:33813 every 8 connection(s)
I20260709 12:12:51.308743 28541 heartbeater.cc:344] Connected to a master server at 127.20.56.126:36629
I20260709 12:12:51.309242 28541 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:51.310101 28541 heartbeater.cc:507] Master 127.20.56.126:36629 requested a full tablet report, sending...
I20260709 12:12:51.312340 28191 ts_manager.cc:194] Registered new tserver with Master: 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:51.312799 20705 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015351244s
I20260709 12:12:51.313742 28191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40956
I20260709 12:12:51.341051 28191 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40962:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:12:51.601080 28357 tablet_service.cc:1511] Processing CreateTablet for tablet e3bd7017cc434cb0b7084f3bd57bc5b4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:51.603540 28283 tablet_service.cc:1511] Processing CreateTablet for tablet 682d7ecbc3044139871db2d4bf0e3366 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:51.605214 28283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682d7ecbc3044139871db2d4bf0e3366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.605569 28355 tablet_service.cc:1511] Processing CreateTablet for tablet cd7f53771e4d49d49b819836af06d45f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:51.607625 28354 tablet_service.cc:1511] Processing CreateTablet for tablet 8449846c74a54c40a37e2b241c98f91a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:51.608588 28356 tablet_service.cc:1511] Processing CreateTablet for tablet db65629d3046492494cc69476c4eec2a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:51.611713 28352 tablet_service.cc:1511] Processing CreateTablet for tablet bdd3950d455743f28ecbf1aa7548dc02 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:51.612958 28278 tablet_service.cc:1511] Processing CreateTablet for tablet b596443671174eda93522f0319b083f4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:51.613148 28351 tablet_service.cc:1511] Processing CreateTablet for tablet cd7a6a734ce644a486516976d29d7854 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:51.609877 28353 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcfa392d0584f04a0336c49ccd20978 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:51.611716 28281 tablet_service.cc:1511] Processing CreateTablet for tablet e3bd7017cc434cb0b7084f3bd57bc5b4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:51.615244 28355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd7f53771e4d49d49b819836af06d45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.614005 28350 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2c38e0d98e4333a355f887eeaf2f8f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:51.616417 28280 tablet_service.cc:1511] Processing CreateTablet for tablet cd7f53771e4d49d49b819836af06d45f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:51.615272 28279 tablet_service.cc:1511] Processing CreateTablet for tablet 8449846c74a54c40a37e2b241c98f91a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:51.617952 28282 tablet_service.cc:1511] Processing CreateTablet for tablet cf1e398ade0f49ea882023d45c3ca9dc (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:51.603660 28358 tablet_service.cc:1511] Processing CreateTablet for tablet cf1e398ade0f49ea882023d45c3ca9dc (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:51.616813 28350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2c38e0d98e4333a355f887eeaf2f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.621251 28277 tablet_service.cc:1511] Processing CreateTablet for tablet bdd3950d455743f28ecbf1aa7548dc02 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:51.621888 28279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8449846c74a54c40a37e2b241c98f91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.622802 28277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd3950d455743f28ecbf1aa7548dc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.625277 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1e398ade0f49ea882023d45c3ca9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.626895 28280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd7f53771e4d49d49b819836af06d45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.628319 28278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b596443671174eda93522f0319b083f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.629436 28276 tablet_service.cc:1511] Processing CreateTablet for tablet cd7a6a734ce644a486516976d29d7854 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:51.630813 28281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bd7017cc434cb0b7084f3bd57bc5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.632756 28358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1e398ade0f49ea882023d45c3ca9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.633553 28357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bd7017cc434cb0b7084f3bd57bc5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.635473 28352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd3950d455743f28ecbf1aa7548dc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.637012 28275 tablet_service.cc:1511] Processing CreateTablet for tablet 84f96d100bb7432592bc9f8aa85db576 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:51.640055 28274 tablet_service.cc:1511] Processing CreateTablet for tablet 14c08416cd39400bab947ef583ee460e (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:51.642822 28351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd7a6a734ce644a486516976d29d7854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.646844 28356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db65629d3046492494cc69476c4eec2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.647835 28432 tablet_service.cc:1511] Processing CreateTablet for tablet 682d7ecbc3044139871db2d4bf0e3366 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:51.649282 28432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682d7ecbc3044139871db2d4bf0e3366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.649957 28349 tablet_service.cc:1511] Processing CreateTablet for tablet 14c08416cd39400bab947ef583ee460e (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:51.651435 28349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c08416cd39400bab947ef583ee460e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.651706 28431 tablet_service.cc:1511] Processing CreateTablet for tablet cf1e398ade0f49ea882023d45c3ca9dc (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:51.653059 28431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1e398ade0f49ea882023d45c3ca9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.655725 28430 tablet_service.cc:1511] Processing CreateTablet for tablet db65629d3046492494cc69476c4eec2a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:51.657171 28430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db65629d3046492494cc69476c4eec2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.659016 28354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8449846c74a54c40a37e2b241c98f91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.659658 28429 tablet_service.cc:1511] Processing CreateTablet for tablet cd7f53771e4d49d49b819836af06d45f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:51.661109 28429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd7f53771e4d49d49b819836af06d45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.662848 28353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcfa392d0584f04a0336c49ccd20978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.663561 28506 tablet_service.cc:1511] Processing CreateTablet for tablet 682d7ecbc3044139871db2d4bf0e3366 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:51.664997 28506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682d7ecbc3044139871db2d4bf0e3366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.667608 28505 tablet_service.cc:1511] Processing CreateTablet for tablet e3bd7017cc434cb0b7084f3bd57bc5b4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:51.667779 28426 tablet_service.cc:1511] Processing CreateTablet for tablet bdd3950d455743f28ecbf1aa7548dc02 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:51.669064 28505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bd7017cc434cb0b7084f3bd57bc5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.669260 28426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdd3950d455743f28ecbf1aa7548dc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.671686 28504 tablet_service.cc:1511] Processing CreateTablet for tablet db65629d3046492494cc69476c4eec2a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:51.672367 28425 tablet_service.cc:1511] Processing CreateTablet for tablet 84f96d100bb7432592bc9f8aa85db576 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:51.673182 28504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db65629d3046492494cc69476c4eec2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.673815 28425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f96d100bb7432592bc9f8aa85db576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.664988 28428 tablet_service.cc:1511] Processing CreateTablet for tablet b596443671174eda93522f0319b083f4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:51.675640 28503 tablet_service.cc:1511] Processing CreateTablet for tablet 8449846c74a54c40a37e2b241c98f91a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:51.677423 28503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8449846c74a54c40a37e2b241c98f91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.677166 28424 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2c38e0d98e4333a355f887eeaf2f8f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:51.678846 28276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd7a6a734ce644a486516976d29d7854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.680195 28423 tablet_service.cc:1511] Processing CreateTablet for tablet 14c08416cd39400bab947ef583ee460e (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:51.680070 28502 tablet_service.cc:1511] Processing CreateTablet for tablet b596443671174eda93522f0319b083f4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:51.666250 28427 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcfa392d0584f04a0336c49ccd20978 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:51.682093 28502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b596443671174eda93522f0319b083f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.690145 28498 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2c38e0d98e4333a355f887eeaf2f8f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:51.691588 28498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2c38e0d98e4333a355f887eeaf2f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.682789 28275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f96d100bb7432592bc9f8aa85db576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.694962 28274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c08416cd39400bab947ef583ee460e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.695648 28497 tablet_service.cc:1511] Processing CreateTablet for tablet 75b9e10e4b584dd0bdc388ba5535e94a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:51.697118 28497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b9e10e4b584dd0bdc388ba5535e94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.686375 28500 tablet_service.cc:1511] Processing CreateTablet for tablet cd7a6a734ce644a486516976d29d7854 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:51.698814 28500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd7a6a734ce644a486516976d29d7854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.688297 28499 tablet_service.cc:1511] Processing CreateTablet for tablet 84f96d100bb7432592bc9f8aa85db576 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:51.683625 28424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2c38e0d98e4333a355f887eeaf2f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.684064 28501 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcfa392d0584f04a0336c49ccd20978 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:51.702307 28499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f96d100bb7432592bc9f8aa85db576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.702396 28423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c08416cd39400bab947ef583ee460e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.703047 28501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcfa392d0584f04a0336c49ccd20978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.704347 28428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b596443671174eda93522f0319b083f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.705780 28427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcfa392d0584f04a0336c49ccd20978. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:51.756265 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:51.801872 28562 tablet_bootstrap.cc:492] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:51.817588 28356 tablet_service.cc:1511] Processing CreateTablet for tablet 3b567deb01fe4f3fb96d69d4943fece9 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:51.819051 28356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b567deb01fe4f3fb96d69d4943fece9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.843729 28283 tablet_service.cc:1511] Processing CreateTablet for tablet 75b9e10e4b584dd0bdc388ba5535e94a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:51.845192 28283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b9e10e4b584dd0bdc388ba5535e94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.858162 28426 tablet_service.cc:1511] Processing CreateTablet for tablet 1868e15012414126a99e7722148f94c4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:51.859656 28426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1868e15012414126a99e7722148f94c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.860227 28282 tablet_service.cc:1511] Processing CreateTablet for tablet 1868e15012414126a99e7722148f94c4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:51.861501 28499 tablet_service.cc:1511] Processing CreateTablet for tablet 1868e15012414126a99e7722148f94c4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:51.861781 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1868e15012414126a99e7722148f94c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.868151 28276 tablet_service.cc:1511] Processing CreateTablet for tablet bb308f551c2c483eacd2ca20c16ec438 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:51.869033 28562 tablet_bootstrap.cc:654] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.869506 28276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb308f551c2c483eacd2ca20c16ec438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.879061 28355 tablet_service.cc:1511] Processing CreateTablet for tablet 75b9e10e4b584dd0bdc388ba5535e94a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:51.881031 28355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b9e10e4b584dd0bdc388ba5535e94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.884636 28505 tablet_service.cc:1511] Processing CreateTablet for tablet 3b567deb01fe4f3fb96d69d4943fece9 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:51.885990 28505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b567deb01fe4f3fb96d69d4943fece9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.891019 28499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1868e15012414126a99e7722148f94c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.895916 28352 tablet_service.cc:1511] Processing CreateTablet for tablet bb308f551c2c483eacd2ca20c16ec438 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:51.898253 28277 tablet_service.cc:1511] Processing CreateTablet for tablet c7829e294fab4d1187889634a3fca00d (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:51.899644 28277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7829e294fab4d1187889634a3fca00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.900406 28358 tablet_service.cc:1511] Processing CreateTablet for tablet c7829e294fab4d1187889634a3fca00d (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:51.923269 28561 tablet_bootstrap.cc:492] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:51.923861 28358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7829e294fab4d1187889634a3fca00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.925000 28563 tablet_bootstrap.cc:492] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:51.929111 28498 tablet_service.cc:1511] Processing CreateTablet for tablet c7829e294fab4d1187889634a3fca00d (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:51.930047 28561 tablet_bootstrap.cc:654] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.924016 28564 tablet_bootstrap.cc:492] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:51.930514 28498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7829e294fab4d1187889634a3fca00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.932497 28503 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8664110bc84069a332ebad298106ac (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:51.932720 28432 tablet_service.cc:1511] Processing CreateTablet for tablet bb308f551c2c483eacd2ca20c16ec438 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:51.934098 28432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb308f551c2c483eacd2ca20c16ec438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.937812 28429 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8664110bc84069a332ebad298106ac (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:51.952556 28429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8664110bc84069a332ebad298106ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.953447 28503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8664110bc84069a332ebad298106ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.958676 28352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb308f551c2c483eacd2ca20c16ec438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.969933 28282 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8664110bc84069a332ebad298106ac (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:51.971371 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8664110bc84069a332ebad298106ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.973335 28353 tablet_service.cc:1511] Processing CreateTablet for tablet 850ee7c88fe1482985405700cf63d47a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:51.974635 28353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 850ee7c88fe1482985405700cf63d47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.002578 28430 tablet_service.cc:1511] Processing CreateTablet for tablet 3b567deb01fe4f3fb96d69d4943fece9 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:52.004020 28430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b567deb01fe4f3fb96d69d4943fece9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.004954 28564 tablet_bootstrap.cc:654] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.013535 28563 tablet_bootstrap.cc:654] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.019466 28318 heartbeater.cc:499] Master 127.20.56.126:36629 was elected leader, sending a full tablet report...
I20260709 12:12:51.994112 28425 tablet_service.cc:1511] Processing CreateTablet for tablet 850ee7c88fe1482985405700cf63d47a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:52.026036 28425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 850ee7c88fe1482985405700cf63d47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.983438 28498 tablet_service.cc:1511] Processing CreateTablet for tablet 850ee7c88fe1482985405700cf63d47a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:52.032533 28498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 850ee7c88fe1482985405700cf63d47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.040340 28563 tablet_bootstrap.cc:492] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:52.040953 28563 ts_tablet_manager.cc:1403] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.000s
I20260709 12:12:52.042456 28562 tablet_bootstrap.cc:492] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:52.043036 28562 ts_tablet_manager.cc:1403] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.242s	user 0.023s	sys 0.010s
I20260709 12:12:52.045606 28561 tablet_bootstrap.cc:492] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:52.046154 28561 ts_tablet_manager.cc:1403] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.010s
I20260709 12:12:52.054703 28561 raft_consensus.cc:359] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.055565 28561 raft_consensus.cc:385] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.055729 28280 tablet_service.cc:1511] Processing CreateTablet for tablet 46f5691a910e47d185a194b58c0354ec (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:52.059998 28280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f5691a910e47d185a194b58c0354ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.064081 28563 raft_consensus.cc:359] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:52.064888 28563 raft_consensus.cc:385] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.065203 28563 raft_consensus.cc:740] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.069370 28564 tablet_bootstrap.cc:492] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:52.069907 28564 ts_tablet_manager.cc:1403] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.000s
I20260709 12:12:52.072975 28564 raft_consensus.cc:359] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.073693 28564 raft_consensus.cc:385] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.074002 28564 raft_consensus.cc:740] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.055962 28561 raft_consensus.cc:740] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.079169 28561 consensus_queue.cc:260] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.046626 28562 raft_consensus.cc:359] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.080699 28562 raft_consensus.cc:385] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.081035 28562 raft_consensus.cc:740] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.081533 28351 tablet_service.cc:1511] Processing CreateTablet for tablet 46f5691a910e47d185a194b58c0354ec (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:52.081809 28562 consensus_queue.cc:260] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.082947 28351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f5691a910e47d185a194b58c0354ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.066006 28563 consensus_queue.cc:260] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:52.089107 28564 consensus_queue.cc:260] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.093268 28562 ts_tablet_manager.cc:1434] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:12:52.094950 28563 ts_tablet_manager.cc:1434] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.054s	user 0.013s	sys 0.000s
W20260709 12:12:52.096746 28394 tablet.cc:2406] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:52.096830 28497 tablet_service.cc:1511] Processing CreateTablet for tablet e41a2a37b60547569fea429a0ebaf169 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:52.098274 28497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41a2a37b60547569fea429a0ebaf169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.101154 28393 heartbeater.cc:499] Master 127.20.56.126:36629 was elected leader, sending a full tablet report...
I20260709 12:12:52.098884 28541 heartbeater.cc:499] Master 127.20.56.126:36629 was elected leader, sending a full tablet report...
I20260709 12:12:52.102265 28563 tablet_bootstrap.cc:492] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:52.114135 28425 tablet_service.cc:1511] Processing CreateTablet for tablet 46f5691a910e47d185a194b58c0354ec (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:52.115579 28425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f5691a910e47d185a194b58c0354ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.127952 28563 tablet_bootstrap.cc:654] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.129601 28561 ts_tablet_manager.cc:1434] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.017s
I20260709 12:12:52.130818 28561 tablet_bootstrap.cc:492] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:52.130854 28467 heartbeater.cc:499] Master 127.20.56.126:36629 was elected leader, sending a full tablet report...
I20260709 12:12:52.131451 28280 tablet_service.cc:1511] Processing CreateTablet for tablet e41a2a37b60547569fea429a0ebaf169 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:52.132685 28564 ts_tablet_manager.cc:1434] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.017s
I20260709 12:12:52.132903 28280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41a2a37b60547569fea429a0ebaf169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.133744 28564 tablet_bootstrap.cc:492] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:52.146624 28561 tablet_bootstrap.cc:654] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.148325 28505 tablet_service.cc:1511] Processing CreateTablet for tablet 0c089a99cd334841849bfd25380410fb (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:52.151877 28353 tablet_service.cc:1511] Processing CreateTablet for tablet 81456624ac7a4b579c782075291f8cbf (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:52.149695 28505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c089a99cd334841849bfd25380410fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.154874 28564 tablet_bootstrap.cc:654] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.157294 28277 tablet_service.cc:1511] Processing CreateTablet for tablet 0c089a99cd334841849bfd25380410fb (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:52.163658 28277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c089a99cd334841849bfd25380410fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.164638 28562 tablet_bootstrap.cc:492] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:52.153527 28353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81456624ac7a4b579c782075291f8cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.167680 28355 tablet_service.cc:1511] Processing CreateTablet for tablet e41a2a37b60547569fea429a0ebaf169 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:52.169493 28355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41a2a37b60547569fea429a0ebaf169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.178033 28430 tablet_service.cc:1511] Processing CreateTablet for tablet 0c089a99cd334841849bfd25380410fb (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:52.187461 28430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c089a99cd334841849bfd25380410fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.178831 28572 raft_consensus.cc:493] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.188944 28572 raft_consensus.cc:515] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.197154 28497 tablet_service.cc:1511] Processing CreateTablet for tablet 81456624ac7a4b579c782075291f8cbf (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:52.197381 28425 tablet_service.cc:1511] Processing CreateTablet for tablet 81456624ac7a4b579c782075291f8cbf (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:52.198454 28572 leader_election.cc:290] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:52.198793 28425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81456624ac7a4b579c782075291f8cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.203636 28497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81456624ac7a4b579c782075291f8cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.204898 28282 tablet_service.cc:1511] Processing CreateTablet for tablet df473093e079470ca1369b516368ab05 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:52.207602 28563 tablet_bootstrap.cc:492] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:52.208642 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df473093e079470ca1369b516368ab05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.224225 28563 ts_tablet_manager.cc:1403] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.121s	user 0.029s	sys 0.011s
I20260709 12:12:52.228052 28570 raft_consensus.cc:493] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.228857 28561 tablet_bootstrap.cc:492] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:52.228588 28570 raft_consensus.cc:515] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.229423 28561 ts_tablet_manager.cc:1403] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.027s
I20260709 12:12:52.232038 28423 tablet_service.cc:1511] Processing CreateTablet for tablet df473093e079470ca1369b516368ab05 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:52.233292 28561 raft_consensus.cc:359] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.233844 28423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df473093e079470ca1369b516368ab05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.233925 28561 raft_consensus.cc:385] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.234537 28561 raft_consensus.cc:740] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.235289 28561 consensus_queue.cc:260] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.236150 28352 tablet_service.cc:1511] Processing CreateTablet for tablet df473093e079470ca1369b516368ab05 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:52.237462 28352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df473093e079470ca1369b516368ab05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.237612 28561 ts_tablet_manager.cc:1434] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:12:52.238691 28561 tablet_bootstrap.cc:492] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:52.244729 28570 leader_election.cc:290] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:52.259485 28561 tablet_bootstrap.cc:654] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.295094 28280 tablet_service.cc:1511] Processing CreateTablet for tablet d549a198d01a4258a83fe8e713a96f94 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:52.295646 28563 raft_consensus.cc:359] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.296531 28563 raft_consensus.cc:385] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.296656 28280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d549a198d01a4258a83fe8e713a96f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.296897 28563 raft_consensus.cc:740] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.299599 28564 tablet_bootstrap.cc:492] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:52.300148 28564 ts_tablet_manager.cc:1403] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.167s	user 0.013s	sys 0.004s
I20260709 12:12:52.323349 28498 tablet_service.cc:1511] Processing CreateTablet for tablet d549a198d01a4258a83fe8e713a96f94 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:52.326383 28498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d549a198d01a4258a83fe8e713a96f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.334544 28563 consensus_queue.cc:260] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.337451 28563 ts_tablet_manager.cc:1434] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
I20260709 12:12:52.349097 28564 raft_consensus.cc:359] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.350015 28564 raft_consensus.cc:385] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.350355 28564 raft_consensus.cc:740] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.351182 28564 consensus_queue.cc:260] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.353586 28562 tablet_bootstrap.cc:654] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.359118 28571 raft_consensus.cc:493] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.359720 28571 raft_consensus.cc:515] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:52.365990 28563 tablet_bootstrap.cc:492] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:52.371861 28425 tablet_service.cc:1511] Processing CreateTablet for tablet 2010116c72334e7f8f3a3bf9d7ea06d1 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:52.373427 28425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2010116c72334e7f8f3a3bf9d7ea06d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.376415 28571 leader_election.cc:290] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:52.389762 28564 ts_tablet_manager.cc:1434] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 12:12:52.390899 28564 tablet_bootstrap.cc:492] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:52.387306 28563 tablet_bootstrap.cc:654] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.395243 28293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:52.396153 28569 raft_consensus.cc:493] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.398532 28561 tablet_bootstrap.cc:492] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:52.401134 28569 raft_consensus.cc:515] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.404199 28569 leader_election.cc:290] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:52.405587 28293 raft_consensus.cc:2468] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:52.405068 28564 tablet_bootstrap.cc:654] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.408303 28561 ts_tablet_manager.cc:1403] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.170s	user 0.035s	sys 0.019s
I20260709 12:12:52.408245 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3950d455743f28ecbf1aa7548dc02" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:52.408221 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:52.417779 28442 raft_consensus.cc:2468] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
W20260709 12:12:52.418998 28408 leader_election.cc:343] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.420522 28334 leader_election.cc:304] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:52.420394 28561 raft_consensus.cc:359] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:52.421399 28562 tablet_bootstrap.cc:492] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:52.421669 28561 raft_consensus.cc:385] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.421788 28570 raft_consensus.cc:2804] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.422091 28562 ts_tablet_manager.cc:1403] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.258s	user 0.014s	sys 0.005s
I20260709 12:12:52.422328 28570 raft_consensus.cc:493] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.429152 28570 raft_consensus.cc:3060] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.434960 28282 tablet_service.cc:1511] Processing CreateTablet for tablet 2010116c72334e7f8f3a3bf9d7ea06d1 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:52.436496 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2010116c72334e7f8f3a3bf9d7ea06d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.436599 28562 raft_consensus.cc:359] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.441666 28562 raft_consensus.cc:385] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.445165 28352 tablet_service.cc:1511] Processing CreateTablet for tablet d549a198d01a4258a83fe8e713a96f94 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:52.422245 28561 raft_consensus.cc:740] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.450999 28497 tablet_service.cc:1511] Processing CreateTablet for tablet 2010116c72334e7f8f3a3bf9d7ea06d1 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:52.457070 28561 consensus_queue.cc:260] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:52.462013 28497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2010116c72334e7f8f3a3bf9d7ea06d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.462535 28293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3950d455743f28ecbf1aa7548dc02" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:52.462518 28353 tablet_service.cc:1511] Processing CreateTablet for tablet f905442aa27c4a6390b8baca69e6b031 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:52.464443 28353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f905442aa27c4a6390b8baca69e6b031. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:52.464691 28331 leader_election.cc:343] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.454098 28498 tablet_service.cc:1511] Processing CreateTablet for tablet f905442aa27c4a6390b8baca69e6b031 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:52.467373 28498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f905442aa27c4a6390b8baca69e6b031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.468775 28352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d549a198d01a4258a83fe8e713a96f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.471700 28405 leader_election.cc:304] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:52.449282 28562 raft_consensus.cc:740] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.473518 28572 raft_consensus.cc:2804] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.474809 28572 raft_consensus.cc:493] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.475194 28572 raft_consensus.cc:3060] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.479527 28430 tablet_service.cc:1511] Processing CreateTablet for tablet f905442aa27c4a6390b8baca69e6b031 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:52.482621 28277 tablet_service.cc:1511] Processing CreateTablet for tablet 60d8ee4c616f484ca8ad342b1c3e38f7 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:52.484088 28277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d8ee4c616f484ca8ad342b1c3e38f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.483826 28505 tablet_service.cc:1511] Processing CreateTablet for tablet 87893c2fc5894370a4e3427f4e429698 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:52.481099 28430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f905442aa27c4a6390b8baca69e6b031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.486855 28505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87893c2fc5894370a4e3427f4e429698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.495682 28351 tablet_service.cc:1511] Processing CreateTablet for tablet 60d8ee4c616f484ca8ad342b1c3e38f7 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:52.497220 28351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d8ee4c616f484ca8ad342b1c3e38f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.500679 28564 tablet_bootstrap.cc:492] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:52.501346 28561 ts_tablet_manager.cc:1434] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.002s
I20260709 12:12:52.503085 28423 tablet_service.cc:1511] Processing CreateTablet for tablet 60d8ee4c616f484ca8ad342b1c3e38f7 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:52.503501 28572 raft_consensus.cc:515] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.514269 28423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d8ee4c616f484ca8ad342b1c3e38f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.514700 28564 ts_tablet_manager.cc:1403] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.005s
I20260709 12:12:52.516088 28572 leader_election.cc:290] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:52.516964 28561 tablet_bootstrap.cc:492] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:52.517086 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:52.518311 28564 raft_consensus.cc:359] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
W20260709 12:12:52.519054 28408 leader_election.cc:343] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.512935 28280 tablet_service.cc:1511] Processing CreateTablet for tablet 87893c2fc5894370a4e3427f4e429698 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:52.519749 28293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:52.520378 28293 raft_consensus.cc:3060] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.520619 28280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87893c2fc5894370a4e3427f4e429698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.524665 28561 tablet_bootstrap.cc:654] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.519269 28564 raft_consensus.cc:385] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.506451 28570 raft_consensus.cc:515] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.536007 28293 raft_consensus.cc:2468] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:52.538297 28355 tablet_service.cc:1511] Processing CreateTablet for tablet 87893c2fc5894370a4e3427f4e429698 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:52.475165 28562 consensus_queue.cc:260] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.544574 28355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87893c2fc5894370a4e3427f4e429698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.550269 28571 raft_consensus.cc:493] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.551548 28571 raft_consensus.cc:515] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.553843 28503 tablet_service.cc:1511] Processing CreateTablet for tablet 376f42083a394141ba0bc9cd40ea7f40 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:52.539037 28564 raft_consensus.cc:740] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.559239 28293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3950d455743f28ecbf1aa7548dc02" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:52.560652 28503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376f42083a394141ba0bc9cd40ea7f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.562682 28405 leader_election.cc:304] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
W20260709 12:12:52.562707 28331 leader_election.cc:343] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.563829 28572 raft_consensus.cc:2804] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.564574 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2c38e0d98e4333a355f887eeaf2f8f" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:52.566552 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:52.554020 28571 leader_election.cc:290] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
W20260709 12:12:52.578948 28482 leader_election.cc:343] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.579802 28482 leader_election.cc:343] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.580680 28356 tablet_service.cc:1511] Processing CreateTablet for tablet 95d7c46e81fa49a29180a4eb5a184bdf (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:52.581429 28283 tablet_service.cc:1511] Processing CreateTablet for tablet 376f42083a394141ba0bc9cd40ea7f40 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:52.582100 28356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d7c46e81fa49a29180a4eb5a184bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.582890 28283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376f42083a394141ba0bc9cd40ea7f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.584569 28563 tablet_bootstrap.cc:492] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:52.585068 28563 ts_tablet_manager.cc:1403] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.247s	user 0.013s	sys 0.011s
I20260709 12:12:52.587500 28564 consensus_queue.cc:260] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:52.591861 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2c38e0d98e4333a355f887eeaf2f8f" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:52.593412 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1e398ade0f49ea882023d45c3ca9dc" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
W20260709 12:12:52.593647 28481 leader_election.cc:343] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.594105 28481 leader_election.cc:304] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:52.595304 28571 raft_consensus.cc:2749] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.598151 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1e398ade0f49ea882023d45c3ca9dc" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:52.602907 28258 leader_election.cc:343] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.603598 28570 leader_election.cc:290] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:52.604317 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3950d455743f28ecbf1aa7548dc02" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:52.605055 28441 raft_consensus.cc:3060] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:52.615548 28259 leader_election.cc:343] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.616382 28259 leader_election.cc:304] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:52.617650 28569 raft_consensus.cc:2749] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.617792 28277 tablet_service.cc:1511] Processing CreateTablet for tablet d7e80e45a85c4f95a89fbcd97a133177 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:52.617014 28497 tablet_service.cc:1511] Processing CreateTablet for tablet 95d7c46e81fa49a29180a4eb5a184bdf (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:52.619187 28277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e80e45a85c4f95a89fbcd97a133177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.619277 28497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d7c46e81fa49a29180a4eb5a184bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.630533 28441 raft_consensus.cc:2468] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:52.631753 28425 tablet_service.cc:1511] Processing CreateTablet for tablet 376f42083a394141ba0bc9cd40ea7f40 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:52.639616 28425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376f42083a394141ba0bc9cd40ea7f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.640607 28334 leader_election.cc:304] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:52.622890 28572 raft_consensus.cc:697] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:52.641610 28570 raft_consensus.cc:2804] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:52.632195 28424 tablet_service.cc:1511] Processing CreateTablet for tablet 95d7c46e81fa49a29180a4eb5a184bdf (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:52.642179 28570 raft_consensus.cc:697] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:12:52.642803 28564 ts_tablet_manager.cc:1434] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.004s
I20260709 12:12:52.643287 28424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d7c46e81fa49a29180a4eb5a184bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.643399 28570 consensus_queue.cc:237] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.645802 28564 tablet_bootstrap.cc:492] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:52.642122 28572 consensus_queue.cc:237] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.598166 28563 raft_consensus.cc:359] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.655133 28563 raft_consensus.cc:385] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.655511 28563 raft_consensus.cc:740] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.656327 28563 consensus_queue.cc:260] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.664121 28293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:52.665710 28561 tablet_bootstrap.cc:492] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
W20260709 12:12:52.666102 28479 leader_election.cc:343] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.666371 28561 ts_tablet_manager.cc:1403] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.004s
I20260709 12:12:52.666676 28479 leader_election.cc:304] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:52.669041 28571 raft_consensus.cc:2749] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.673661 28598 raft_consensus.cc:493] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.690894 28561 raft_consensus.cc:359] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.696000 28561 raft_consensus.cc:385] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.696640 28561 raft_consensus.cc:740] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.695627 28505 tablet_service.cc:1511] Processing CreateTablet for tablet e5a87d2111494acab0739a6431f79b3a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:52.693414 28563 ts_tablet_manager.cc:1434] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.001s
I20260709 12:12:52.694479 28564 tablet_bootstrap.cc:654] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.687189 28423 tablet_service.cc:1511] Processing CreateTablet for tablet d7e80e45a85c4f95a89fbcd97a133177 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:52.687459 28598 raft_consensus.cc:515] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:52.710525 28561 consensus_queue.cc:260] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.714622 28356 tablet_service.cc:1511] Processing CreateTablet for tablet d7e80e45a85c4f95a89fbcd97a133177 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:52.714495 28423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e80e45a85c4f95a89fbcd97a133177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.720924 28280 tablet_service.cc:1511] Processing CreateTablet for tablet e5a87d2111494acab0739a6431f79b3a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:52.721104 28352 tablet_service.cc:1511] Processing CreateTablet for tablet e5a87d2111494acab0739a6431f79b3a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:52.721645 28561 ts_tablet_manager.cc:1434] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.002s
I20260709 12:12:52.722769 28561 tablet_bootstrap.cc:492] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:52.723699 28563 tablet_bootstrap.cc:492] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:52.727681 28505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a87d2111494acab0739a6431f79b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.727617 28356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e80e45a85c4f95a89fbcd97a133177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.732231 28352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a87d2111494acab0739a6431f79b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.749724 28430 tablet_service.cc:1511] Processing CreateTablet for tablet cfd7b4ba0d53419e909c0c82013ee595 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:52.752216 28430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd7b4ba0d53419e909c0c82013ee595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.756919 28561 tablet_bootstrap.cc:654] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:52.759061 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:52.759563 28569 raft_consensus.cc:493] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.760136 28569 raft_consensus.cc:515] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:52.761665 28562 ts_tablet_manager.cc:1434] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.333s	user 0.021s	sys 0.004s
I20260709 12:12:52.753906 28280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a87d2111494acab0739a6431f79b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.765441 28191 catalog_manager.cc:5697] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.764914 28569 leader_election.cc:290] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:52.776120 28497 tablet_service.cc:1511] Processing CreateTablet for tablet cfd7b4ba0d53419e909c0c82013ee595 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:52.777264 28564 tablet_bootstrap.cc:492] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:52.777482 28497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd7b4ba0d53419e909c0c82013ee595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.777817 28564 ts_tablet_manager.cc:1403] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.132s	user 0.017s	sys 0.000s
I20260709 12:12:52.779354 28562 tablet_bootstrap.cc:492] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:52.780256 28277 tablet_service.cc:1511] Processing CreateTablet for tablet cfd7b4ba0d53419e909c0c82013ee595 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:52.781638 28277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd7b4ba0d53419e909c0c82013ee595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.783514 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:52.785087 28258 leader_election.cc:343] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.795815 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:52.797479 28408 leader_election.cc:343] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.798128 28598 leader_election.cc:290] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:52.801291 28564 raft_consensus.cc:359] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.802057 28564 raft_consensus.cc:385] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.790470 28355 tablet_service.cc:1511] Processing CreateTablet for tablet 7ecabc7c175741e28392767184e77da1 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:52.806936 28355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ecabc7c175741e28392767184e77da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.810609 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:52.811740 28571 raft_consensus.cc:493] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.812299 28571 raft_consensus.cc:515] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.813844 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:52.815435 28259 leader_election.cc:343] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:52.815613 28407 leader_election.cc:343] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.816006 28259 leader_election.cc:304] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:52.816104 28407 leader_election.cc:304] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:52.817256 28598 raft_consensus.cc:2749] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.818077 28569 raft_consensus.cc:2749] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.819785 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bd7017cc434cb0b7084f3bd57bc5b4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:52.821431 28481 leader_election.cc:343] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.822644 28571 leader_election.cc:290] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:52.824442 28293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bd7017cc434cb0b7084f3bd57bc5b4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:52.825201 28293 raft_consensus.cc:2468] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:52.826812 28479 leader_election.cc:304] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:52.829222 28571 raft_consensus.cc:2804] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.829599 28571 raft_consensus.cc:493] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.829934 28571 raft_consensus.cc:3060] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.830251 28562 tablet_bootstrap.cc:654] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.830641 28561 tablet_bootstrap.cc:492] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:52.831198 28561 ts_tablet_manager.cc:1403] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.024s
I20260709 12:12:52.835412 28563 tablet_bootstrap.cc:654] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.835736 28561 raft_consensus.cc:359] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.836603 28561 raft_consensus.cc:385] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.836964 28561 raft_consensus.cc:740] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.802366 28564 raft_consensus.cc:740] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.837836 28561 consensus_queue.cc:260] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.840420 28564 consensus_queue.cc:260] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.849927 28283 tablet_service.cc:1511] Processing CreateTablet for tablet 812a02f7b3bf4f248ce40cb391061654 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:52.850380 28423 tablet_service.cc:1511] Processing CreateTablet for tablet 7ecabc7c175741e28392767184e77da1 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:52.851436 28283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812a02f7b3bf4f248ce40cb391061654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.853000 28423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ecabc7c175741e28392767184e77da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.860265 28497 tablet_service.cc:1511] Processing CreateTablet for tablet 7ecabc7c175741e28392767184e77da1 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:52.860996 28564 ts_tablet_manager.cc:1434] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 12:12:52.861733 28497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ecabc7c175741e28392767184e77da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.862154 28564 tablet_bootstrap.cc:492] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:52.863503 28356 tablet_service.cc:1511] Processing CreateTablet for tablet 812a02f7b3bf4f248ce40cb391061654 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:52.865193 28356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812a02f7b3bf4f248ce40cb391061654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.869258 28430 tablet_service.cc:1511] Processing CreateTablet for tablet 812a02f7b3bf4f248ce40cb391061654 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:52.870553 28561 ts_tablet_manager.cc:1434] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.001s
I20260709 12:12:52.871950 28561 tablet_bootstrap.cc:492] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:52.882921 28190 catalog_manager.cc:5697] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.884518 28503 tablet_service.cc:1511] Processing CreateTablet for tablet cc60c63aa0fa4aff83e4d3b918c9fc05 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:52.885941 28503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc60c63aa0fa4aff83e4d3b918c9fc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.889585 28351 tablet_service.cc:1511] Processing CreateTablet for tablet cc60c63aa0fa4aff83e4d3b918c9fc05 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:52.889859 28571 raft_consensus.cc:515] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:52.891045 28351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc60c63aa0fa4aff83e4d3b918c9fc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.891337 28430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812a02f7b3bf4f248ce40cb391061654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.889626 28282 tablet_service.cc:1511] Processing CreateTablet for tablet cc60c63aa0fa4aff83e4d3b918c9fc05 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:52.894582 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bd7017cc434cb0b7084f3bd57bc5b4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:52.895000 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc60c63aa0fa4aff83e4d3b918c9fc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.895071 28571 leader_election.cc:290] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
W20260709 12:12:52.902621 28481 leader_election.cc:343] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.905418 28564 tablet_bootstrap.cc:654] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.909067 28425 tablet_service.cc:1511] Processing CreateTablet for tablet d22aef3d88a14b85bdb3763051f26d0f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:52.913650 28353 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3ee9b579654f3b8a3ad484468fa8e4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:52.914758 28561 tablet_bootstrap.cc:654] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.915160 28505 tablet_service.cc:1511] Processing CreateTablet for tablet d22aef3d88a14b85bdb3763051f26d0f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:52.916054 28280 tablet_service.cc:1511] Processing CreateTablet for tablet d22aef3d88a14b85bdb3763051f26d0f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:52.916734 28505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22aef3d88a14b85bdb3763051f26d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.917353 28280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22aef3d88a14b85bdb3763051f26d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.903601 28293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bd7017cc434cb0b7084f3bd57bc5b4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:52.915100 28353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3ee9b579654f3b8a3ad484468fa8e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.923759 28598 raft_consensus.cc:493] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.924249 28424 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3ee9b579654f3b8a3ad484468fa8e4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:52.924371 28598 raft_consensus.cc:515] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:52.927716 28293 raft_consensus.cc:3060] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.927799 28276 tablet_service.cc:1511] Processing CreateTablet for tablet 26b53fc8bee74341af2a3b4395afbb61 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:52.929608 28276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b53fc8bee74341af2a3b4395afbb61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.931787 28498 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3ee9b579654f3b8a3ad484468fa8e4 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:52.941220 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7f53771e4d49d49b819836af06d45f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
W20260709 12:12:52.943255 28405 leader_election.cc:343] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.945484 28598 leader_election.cc:290] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:52.945693 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7f53771e4d49d49b819836af06d45f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:52.948123 28368 raft_consensus.cc:2468] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:52.948771 28283 tablet_service.cc:1511] Processing CreateTablet for tablet d763609f275142958e76408fb898f06c (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:52.949496 28407 leader_election.cc:304] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:52.950196 28283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d763609f275142958e76408fb898f06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.953430 28274 tablet_service.cc:1511] Processing CreateTablet for tablet c549fcb1aed94e25b3402ef6cda0df9b (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:52.954954 28274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c549fcb1aed94e25b3402ef6cda0df9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.913650 28425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22aef3d88a14b85bdb3763051f26d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.945647 28562 tablet_bootstrap.cc:492] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:52.956233 28562 ts_tablet_manager.cc:1403] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.009s
I20260709 12:12:52.956792 28424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3ee9b579654f3b8a3ad484468fa8e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.965444 28500 tablet_service.cc:1511] Processing CreateTablet for tablet d763609f275142958e76408fb898f06c (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:52.967054 28500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d763609f275142958e76408fb898f06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.965564 28501 tablet_service.cc:1511] Processing CreateTablet for tablet c549fcb1aed94e25b3402ef6cda0df9b (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:52.918694 28563 tablet_bootstrap.cc:492] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:52.969668 28275 tablet_service.cc:1511] Processing CreateTablet for tablet 2a539209b26a46fa8275b3913fc0371c (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:52.972607 28498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3ee9b579654f3b8a3ad484468fa8e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.000970 28358 tablet_service.cc:1511] Processing CreateTablet for tablet 2a539209b26a46fa8275b3913fc0371c (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:53.002350 28358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a539209b26a46fa8275b3913fc0371c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.969849 28429 tablet_service.cc:1511] Processing CreateTablet for tablet 1c8dc12e1a8c4cceab2d9e2b404fff28 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:53.004459 28429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8dc12e1a8c4cceab2d9e2b404fff28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.968348 28432 tablet_service.cc:1511] Processing CreateTablet for tablet c549fcb1aed94e25b3402ef6cda0df9b (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:53.007974 28432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c549fcb1aed94e25b3402ef6cda0df9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.009963 28293 raft_consensus.cc:2468] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:52.995456 28598 raft_consensus.cc:2804] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.010716 28598 raft_consensus.cc:493] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.011076 28598 raft_consensus.cc:3060] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.011514 28352 tablet_service.cc:1511] Processing CreateTablet for tablet 26b53fc8bee74341af2a3b4395afbb61 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:53.012866 28352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b53fc8bee74341af2a3b4395afbb61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.999034 28563 ts_tablet_manager.cc:1403] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.286s	user 0.025s	sys 0.014s
I20260709 12:12:52.973901 28349 tablet_service.cc:1511] Processing CreateTablet for tablet 1c8dc12e1a8c4cceab2d9e2b404fff28 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:52.972894 28354 tablet_service.cc:1511] Processing CreateTablet for tablet d763609f275142958e76408fb898f06c (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:53.020210 28501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c549fcb1aed94e25b3402ef6cda0df9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.020473 28499 tablet_service.cc:1511] Processing CreateTablet for tablet 1c8dc12e1a8c4cceab2d9e2b404fff28 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:53.021824 28499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8dc12e1a8c4cceab2d9e2b404fff28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.025491 28275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a539209b26a46fa8275b3913fc0371c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.027110 28423 tablet_service.cc:1511] Processing CreateTablet for tablet 26b53fc8bee74341af2a3b4395afbb61 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:53.028270 28479 leader_election.cc:304] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:53.029526 28571 raft_consensus.cc:2804] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.029444 28563 raft_consensus.cc:359] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:53.031172 28423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b53fc8bee74341af2a3b4395afbb61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.034150 28354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d763609f275142958e76408fb898f06c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:53.040707 28408 consensus_peers.cc:597] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.053309 28426 tablet_service.cc:1511] Processing CreateTablet for tablet 2a539209b26a46fa8275b3913fc0371c (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:53.054879 28426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a539209b26a46fa8275b3913fc0371c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.059356 28563 raft_consensus.cc:385] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.060954 28563 raft_consensus.cc:740] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.046059 28562 raft_consensus.cc:359] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:53.070758 28561 tablet_bootstrap.cc:492] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:53.071333 28561 ts_tablet_manager.cc:1403] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.200s	user 0.011s	sys 0.010s
I20260709 12:12:53.076897 28563 consensus_queue.cc:260] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:53.077939 28570 consensus_queue.cc:1048] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.068238 28349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8dc12e1a8c4cceab2d9e2b404fff28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.097043 28561 raft_consensus.cc:359] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:53.097886 28561 raft_consensus.cc:385] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.098208 28561 raft_consensus.cc:740] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.098714 28504 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8c55ad801343058a6dd2912c0ec74f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:53.099146 28561 consensus_queue.cc:260] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:53.100080 28504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8c55ad801343058a6dd2912c0ec74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.102046 28561 ts_tablet_manager.cc:1434] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:12:53.062469 28598 raft_consensus.cc:515] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:53.089290 28562 raft_consensus.cc:385] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.116884 28293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7f53771e4d49d49b819836af06d45f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:53.105417 28571 raft_consensus.cc:697] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
W20260709 12:12:53.123467 28405 leader_election.cc:343] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.124073 28351 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8c55ad801343058a6dd2912c0ec74f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:53.125491 28351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8c55ad801343058a6dd2912c0ec74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.129881 28571 consensus_queue.cc:237] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.139046 28598 leader_election.cc:290] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:53.114591 28562 raft_consensus.cc:740] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.140239 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7f53771e4d49d49b819836af06d45f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:53.142488 28368 raft_consensus.cc:3060] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.141353 28562 consensus_queue.cc:260] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:53.152503 28427 tablet_service.cc:1511] Processing CreateTablet for tablet 85e086c7173346b4938961a48ccb2a78 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:53.153926 28427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e086c7173346b4938961a48ccb2a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.160076 28280 tablet_service.cc:1511] Processing CreateTablet for tablet 85e086c7173346b4938961a48ccb2a78 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:53.161434 28564 tablet_bootstrap.cc:492] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:53.162185 28564 ts_tablet_manager.cc:1403] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.300s	user 0.013s	sys 0.006s
I20260709 12:12:53.163913 28562 ts_tablet_manager.cc:1434] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.207s	user 0.006s	sys 0.005s
I20260709 12:12:53.161502 28280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e086c7173346b4938961a48ccb2a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.170584 28569 raft_consensus.cc:493] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.171132 28569 raft_consensus.cc:515] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:53.171942 28564 raft_consensus.cc:359] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.172919 28564 raft_consensus.cc:385] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.173578 28569 leader_election.cc:290] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:53.174990 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:53.175359 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:53.175868 28563 ts_tablet_manager.cc:1434] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.149s	user 0.013s	sys 0.013s
I20260709 12:12:53.176057 28516 raft_consensus.cc:2468] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
W20260709 12:12:53.176712 28258 leader_election.cc:343] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.176926 28563 tablet_bootstrap.cc:492] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:53.178930 28561 tablet_bootstrap.cc:492] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:53.181308 28259 leader_election.cc:304] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:53.185290 28569 raft_consensus.cc:2804] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.185793 28569 raft_consensus.cc:493] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.185457 28358 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac6a84976de403eba7d0dc88138e12a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:53.186192 28569 raft_consensus.cc:3060] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.187292 28358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac6a84976de403eba7d0dc88138e12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.173271 28564 raft_consensus.cc:740] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.199366 28424 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac6a84976de403eba7d0dc88138e12a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:53.201170 28424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac6a84976de403eba7d0dc88138e12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.206827 28564 consensus_queue.cc:260] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.209358 28561 tablet_bootstrap.cc:654] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.209970 28564 ts_tablet_manager.cc:1434] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:12:53.211405 28275 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8c55ad801343058a6dd2912c0ec74f (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:53.212821 28275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8c55ad801343058a6dd2912c0ec74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.213469 28563 tablet_bootstrap.cc:654] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.219643 28283 tablet_service.cc:1511] Processing CreateTablet for tablet 16779d1254f44e36b7db87097319a69e (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:53.221050 28283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16779d1254f44e36b7db87097319a69e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.222622 28505 tablet_service.cc:1511] Processing CreateTablet for tablet 85e086c7173346b4938961a48ccb2a78 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:53.223948 28505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e086c7173346b4938961a48ccb2a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.225616 28564 tablet_bootstrap.cc:492] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:53.225827 28498 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac6a84976de403eba7d0dc88138e12a (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:53.227336 28498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac6a84976de403eba7d0dc88138e12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.234261 28353 tablet_service.cc:1511] Processing CreateTablet for tablet 16779d1254f44e36b7db87097319a69e (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:53.235739 28353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16779d1254f44e36b7db87097319a69e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.236920 28598 consensus_queue.cc:1048] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.262282 28562 tablet_bootstrap.cc:492] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:53.253337 28570 raft_consensus.cc:493] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.251344 28368 raft_consensus.cc:2468] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:53.292443 28598 raft_consensus.cc:493] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.293004 28598 raft_consensus.cc:515] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.296599 28564 tablet_bootstrap.cc:654] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.269973 28570 raft_consensus.cc:515] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:53.302037 28432 tablet_service.cc:1511] Processing CreateTablet for tablet 16779d1254f44e36b7db87097319a69e (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:53.304003 28432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16779d1254f44e36b7db87097319a69e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.350008 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596443671174eda93522f0319b083f4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:53.350860 28562 tablet_bootstrap.cc:654] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.352700 28282 tablet_service.cc:1511] Processing CreateTablet for tablet ad3311f3d8df44b1a7b5123aca90c564 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:53.350214 28570 leader_election.cc:290] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:53.353304 28358 tablet_service.cc:1511] Processing CreateTablet for tablet ad3311f3d8df44b1a7b5123aca90c564 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:53.354099 28619 raft_consensus.cc:493] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.354641 28358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3311f3d8df44b1a7b5123aca90c564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.356021 28569 raft_consensus.cc:515] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:53.358440 28499 tablet_service.cc:1511] Processing CreateTablet for tablet ad3311f3d8df44b1a7b5123aca90c564 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:53.359746 28499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3311f3d8df44b1a7b5123aca90c564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.347908 28598 leader_election.cc:290] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
W20260709 12:12:53.361502 28408 leader_election.cc:343] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.342463 28407 leader_election.cc:304] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:53.354125 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad3311f3d8df44b1a7b5123aca90c564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.364614 28561 tablet_bootstrap.cc:492] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:53.365154 28561 ts_tablet_manager.cc:1403] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.186s	user 0.013s	sys 0.008s
I20260709 12:12:53.368309 28561 raft_consensus.cc:359] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.369113 28561 raft_consensus.cc:385] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.369429 28561 raft_consensus.cc:740] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.370242 28598 raft_consensus.cc:2804] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.370821 28598 raft_consensus.cc:697] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:53.371685 28598 consensus_queue.cc:237] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:53.354163 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596443671174eda93522f0319b083f4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:53.381362 28561 consensus_queue.cc:260] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.382504 28292 raft_consensus.cc:2468] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:53.354715 28619 raft_consensus.cc:515] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:53.401854 28426 tablet_service.cc:1511] Processing CreateTablet for tablet a822aa07b6a04f6e83685d3f67ed26d9 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:53.412021 28426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a822aa07b6a04f6e83685d3f67ed26d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.416102 28561 ts_tablet_manager.cc:1434] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 12:12:53.420029 28405 leader_election.cc:304] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:53.420799 28501 tablet_service.cc:1511] Processing CreateTablet for tablet a822aa07b6a04f6e83685d3f67ed26d9 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:53.421482 28598 raft_consensus.cc:2804] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.421960 28598 raft_consensus.cc:493] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.422294 28501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a822aa07b6a04f6e83685d3f67ed26d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.422710 28619 leader_election.cc:290] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:53.425050 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3950d455743f28ecbf1aa7548dc02" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:53.429049 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdd3950d455743f28ecbf1aa7548dc02" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:53.422324 28598 raft_consensus.cc:3060] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.417343 28561 tablet_bootstrap.cc:492] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:53.432042 28258 leader_election.cc:304] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:53.444649 28282 tablet_service.cc:1511] Processing CreateTablet for tablet a822aa07b6a04f6e83685d3f67ed26d9 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:53.446241 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a822aa07b6a04f6e83685d3f67ed26d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.454303 28562 tablet_bootstrap.cc:492] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:53.454622 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:53.455374 28516 raft_consensus.cc:3060] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.456398 28563 tablet_bootstrap.cc:492] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:53.456918 28563 ts_tablet_manager.cc:1403] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.280s	user 0.005s	sys 0.022s
I20260709 12:12:53.454949 28562 ts_tablet_manager.cc:1403] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.198s	user 0.017s	sys 0.001s
I20260709 12:12:53.460862 28621 raft_consensus.cc:2749] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.463128 28352 tablet_service.cc:1511] Processing CreateTablet for tablet d6eec19560a14a8db0c4d338da3a1cba (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:53.464522 28352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eec19560a14a8db0c4d338da3a1cba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.465118 28562 raft_consensus.cc:359] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.467607 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:53.468713 28424 tablet_service.cc:1511] Processing CreateTablet for tablet d6eec19560a14a8db0c4d338da3a1cba (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:53.473049 28500 tablet_service.cc:1511] Processing CreateTablet for tablet d6eec19560a14a8db0c4d338da3a1cba (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:53.475111 28500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eec19560a14a8db0c4d338da3a1cba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.476100 28188 catalog_manager.cc:5697] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:53.478271 28258 leader_election.cc:343] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.480439 28563 raft_consensus.cc:359] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:53.481226 28563 raft_consensus.cc:385] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.481523 28563 raft_consensus.cc:740] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.483230 28424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eec19560a14a8db0c4d338da3a1cba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.489612 28516 raft_consensus.cc:2468] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
W20260709 12:12:53.443709 28334 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 98293.2us
I20260709 12:12:53.490988 28292 raft_consensus.cc:3060] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.490825 28190 catalog_manager.cc:5697] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:53.492004 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:53.492781 28441 raft_consensus.cc:2468] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:53.494002 28562 raft_consensus.cc:385] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.505090 28569 leader_election.cc:290] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:53.505251 28562 raft_consensus.cc:740] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.515169 28562 consensus_queue.cc:260] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.518307 28358 tablet_service.cc:1511] Processing CreateTablet for tablet 415e5a1b64b14a7d8cc7ec3b64f5cc26 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:53.522900 28353 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5100047ea944e6b83b2f8380c39aea (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:53.524354 28427 tablet_service.cc:1511] Processing CreateTablet for tablet 50082d48fcb84e1487323de1942cbbda (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:53.540913 28427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50082d48fcb84e1487323de1942cbbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.521010 28562 ts_tablet_manager.cc:1434] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.005s
I20260709 12:12:53.521232 28429 tablet_service.cc:1511] Processing CreateTablet for tablet 415e5a1b64b14a7d8cc7ec3b64f5cc26 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:53.543798 28429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415e5a1b64b14a7d8cc7ec3b64f5cc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.545819 28259 leader_election.cc:304] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:53.546782 28569 raft_consensus.cc:2804] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.547398 28569 raft_consensus.cc:697] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:53.548233 28569 consensus_queue.cc:237] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:53.549527 28282 tablet_service.cc:1511] Processing CreateTablet for tablet 415e5a1b64b14a7d8cc7ec3b64f5cc26 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:53.550732 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415e5a1b64b14a7d8cc7ec3b64f5cc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.550694 28283 tablet_service.cc:1511] Processing CreateTablet for tablet 50082d48fcb84e1487323de1942cbbda (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:53.552284 28283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50082d48fcb84e1487323de1942cbbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.550698 28501 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5100047ea944e6b83b2f8380c39aea (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:53.565124 28501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5100047ea944e6b83b2f8380c39aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.567373 28275 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5100047ea944e6b83b2f8380c39aea (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:53.568919 28275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5100047ea944e6b83b2f8380c39aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.574713 28626 consensus_queue.cc:1048] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:12:53.578584 28562 tablet_bootstrap.cc:492] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:53.482249 28563 consensus_queue.cc:260] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:53.583333 28571 raft_consensus.cc:493] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.584990 28571 raft_consensus.cc:515] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:53.587169 28354 tablet_service.cc:1511] Processing CreateTablet for tablet ad52a0462bc74b89b194589649de08d6 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:53.591068 28358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415e5a1b64b14a7d8cc7ec3b64f5cc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.598615 28563 ts_tablet_manager.cc:1434] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.002s
I20260709 12:12:53.603327 28498 tablet_service.cc:1511] Processing CreateTablet for tablet 50082d48fcb84e1487323de1942cbbda (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:53.607761 28563 tablet_bootstrap.cc:492] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:53.610625 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:53.611173 28498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50082d48fcb84e1487323de1942cbbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.611441 28368 raft_consensus.cc:2468] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:53.612264 28598 raft_consensus.cc:515] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.613081 28481 leader_election.cc:304] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:53.614225 28611 raft_consensus.cc:2804] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.614675 28611 raft_consensus.cc:493] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.615036 28611 raft_consensus.cc:3060] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.617118 28598 leader_election.cc:290] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:53.618754 28432 tablet_service.cc:1511] Processing CreateTablet for tablet ad52a0462bc74b89b194589649de08d6 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:53.620823 28293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596443671174eda93522f0319b083f4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:53.626004 28293 raft_consensus.cc:3060] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.628981 28500 tablet_service.cc:1511] Processing CreateTablet for tablet ad52a0462bc74b89b194589649de08d6 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:53.625511 28432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad52a0462bc74b89b194589649de08d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.622721 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596443671174eda93522f0319b083f4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:53.634286 28282 tablet_service.cc:1511] Processing CreateTablet for tablet 3645480b1e2b453682244c34a005703d (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:53.621343 28353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5100047ea944e6b83b2f8380c39aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.636200 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3645480b1e2b453682244c34a005703d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.600831 28561 tablet_bootstrap.cc:654] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.630525 28500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad52a0462bc74b89b194589649de08d6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:53.642331 28408 leader_election.cc:343] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.651204 28352 tablet_service.cc:1511] Processing CreateTablet for tablet 3645480b1e2b453682244c34a005703d (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:53.652021 28354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad52a0462bc74b89b194589649de08d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.656565 28191 catalog_manager.cc:5697] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.670199 28334 leader_election.cc:304] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:53.673429 28626 raft_consensus.cc:2804] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.673866 28626 raft_consensus.cc:493] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.674247 28626 raft_consensus.cc:3060] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.674580 28571 leader_election.cc:290] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:53.677256 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:53.678033 28442 raft_consensus.cc:2468] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:53.678545 28352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3645480b1e2b453682244c34a005703d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.683069 28571 consensus_queue.cc:1048] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:53.685015 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:53.686817 28426 tablet_service.cc:1511] Processing CreateTablet for tablet 3645480b1e2b453682244c34a005703d (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:53.687476 28499 tablet_service.cc:1511] Processing CreateTablet for tablet 61ccf65866fb4d91aee23f2b55e9c293 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:53.688205 28426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3645480b1e2b453682244c34a005703d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.694769 28499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ccf65866fb4d91aee23f2b55e9c293. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:53.711131 28632 log.cc:927] Time spent T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:12:53.712755 28563 tablet_bootstrap.cc:654] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.712651 28293 raft_consensus.cc:2468] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:53.714442 28405 leader_election.cc:304] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:53.729864 28631 raft_consensus.cc:2804] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.731652 28562 tablet_bootstrap.cc:654] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.731760 28631 raft_consensus.cc:697] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:53.733193 28631 consensus_queue.cc:237] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.739367 28349 tablet_service.cc:1511] Processing CreateTablet for tablet 61ccf65866fb4d91aee23f2b55e9c293 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:53.740870 28349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ccf65866fb4d91aee23f2b55e9c293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.749557 28282 tablet_service.cc:1511] Processing CreateTablet for tablet 61ccf65866fb4d91aee23f2b55e9c293 (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:53.751425 28282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ccf65866fb4d91aee23f2b55e9c293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.760758 28505 tablet_service.cc:1511] Processing CreateTablet for tablet cb63ff5948b2424688b706c82ee3f05b (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:53.762337 28505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb63ff5948b2424688b706c82ee3f05b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:53.762842 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:53.704207 28611 raft_consensus.cc:515] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:53.776078 28368 raft_consensus.cc:3060] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.794813 28280 tablet_service.cc:1511] Processing CreateTablet for tablet cb63ff5948b2424688b706c82ee3f05b (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:53.795923 28280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb63ff5948b2424688b706c82ee3f05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.793682 28427 tablet_service.cc:1511] Processing CreateTablet for tablet cb63ff5948b2424688b706c82ee3f05b (DEFAULT_TABLE table=test-workload [id=1894cfa246194f9d9d140c492e825f7e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:53.799908 28516 raft_consensus.cc:2393] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 1: Already voted for candidate 1be5ce5bff4b443ea67188eb0de32215 in this term.
I20260709 12:12:53.800596 28427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb63ff5948b2424688b706c82ee3f05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:53.820091 28564 tablet_bootstrap.cc:492] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:53.820644 28564 ts_tablet_manager.cc:1403] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.599s	user 0.006s	sys 0.024s
I20260709 12:12:53.825977 28561 tablet_bootstrap.cc:492] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:53.826620 28561 ts_tablet_manager.cc:1403] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.410s	user 0.020s	sys 0.015s
I20260709 12:12:53.836297 28611 leader_election.cc:290] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:53.836987 28611 consensus_queue.cc:1048] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.837980 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:53.839098 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:53.839749 28441 raft_consensus.cc:3060] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.843569 28564 raft_consensus.cc:359] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.848464 28564 raft_consensus.cc:385] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.848793 28564 raft_consensus.cc:740] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.849566 28564 consensus_queue.cc:260] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.850286 28626 raft_consensus.cc:515] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:53.851552 28367 raft_consensus.cc:2393] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:12:53.854187 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:53.855278 28564 ts_tablet_manager.cc:1434] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:12:53.856389 28564 tablet_bootstrap.cc:492] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:53.858708 28626 leader_election.cc:290] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:53.871028 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db65629d3046492494cc69476c4eec2a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
W20260709 12:12:53.871632 28405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 75843us
I20260709 12:12:53.881214 28516 raft_consensus.cc:2393] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 1: Already voted for candidate 1be5ce5bff4b443ea67188eb0de32215 in this term.
I20260709 12:12:53.882663 28334 leader_election.cc:304] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:53.885216 28570 raft_consensus.cc:2749] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:12:53.889624 28405 consensus_peers.cc:597] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.889920 28191 catalog_manager.cc:5697] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.892115 28563 tablet_bootstrap.cc:492] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:53.892724 28563 ts_tablet_manager.cc:1403] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.285s	user 0.009s	sys 0.019s
I20260709 12:12:53.896608 28561 raft_consensus.cc:359] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.897334 28561 raft_consensus.cc:385] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.897599 28561 raft_consensus.cc:740] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.898265 28561 consensus_queue.cc:260] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.912600 28598 consensus_queue.cc:1048] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:53.917315 28563 raft_consensus.cc:359] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.920670 28563 raft_consensus.cc:385] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.921031 28563 raft_consensus.cc:740] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.922169 28562 tablet_bootstrap.cc:492] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:53.924634 28561 ts_tablet_manager.cc:1434] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.000s
I20260709 12:12:53.925473 28561 tablet_bootstrap.cc:492] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:53.929488 28564 tablet_bootstrap.cc:654] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.929476 28441 raft_consensus.cc:2468] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
W20260709 12:12:53.937685 28258 consensus_peers.cc:597] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.943312 28561 tablet_bootstrap.cc:654] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.943385 28482 leader_election.cc:304] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:53.944775 28611 raft_consensus.cc:2804] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.945281 28611 raft_consensus.cc:697] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:53.946120 28611 consensus_queue.cc:237] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:53.932312 28563 consensus_queue.cc:260] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.933845 28562 ts_tablet_manager.cc:1403] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.356s	user 0.021s	sys 0.010s
I20260709 12:12:53.955554 28563 ts_tablet_manager.cc:1434] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.005s
I20260709 12:12:53.957059 28563 tablet_bootstrap.cc:492] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:53.957702 28562 raft_consensus.cc:359] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:53.969117 28562 raft_consensus.cc:385] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.974018 28562 raft_consensus.cc:740] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.974818 28562 consensus_queue.cc:260] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:53.983983 28611 raft_consensus.cc:493] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.985766 28191 catalog_manager.cc:5697] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:53.989228 28564 tablet_bootstrap.cc:492] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:53.989840 28564 ts_tablet_manager.cc:1403] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.134s	user 0.034s	sys 0.009s
I20260709 12:12:53.990211 28563 tablet_bootstrap.cc:654] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.993229 28564 raft_consensus.cc:359] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:53.994114 28564 raft_consensus.cc:385] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.984604 28611 raft_consensus.cc:515] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:53.997535 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:53.998848 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:54.000983 28479 leader_election.cc:304] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:54.001904 28564 raft_consensus.cc:740] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.002173 28613 raft_consensus.cc:2749] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.003095 28564 consensus_queue.cc:260] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.004254 28642 raft_consensus.cc:493] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.004719 28642 raft_consensus.cc:515] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.006661 28564 ts_tablet_manager.cc:1434] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:12:54.007838 28564 tablet_bootstrap.cc:492] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:54.010533 28611 leader_election.cc:290] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:54.011751 28562 ts_tablet_manager.cc:1434] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:12:54.016225 28562 tablet_bootstrap.cc:492] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:54.017511 28561 tablet_bootstrap.cc:492] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:54.018010 28561 ts_tablet_manager.cc:1403] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.015s
I20260709 12:12:54.017930 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1e398ade0f49ea882023d45c3ca9dc" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:54.018807 28367 raft_consensus.cc:2468] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:54.021093 28561 raft_consensus.cc:359] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.021821 28561 raft_consensus.cc:385] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.022068 28561 raft_consensus.cc:740] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.023110 28642 leader_election.cc:290] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:54.022859 28561 consensus_queue.cc:260] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.024112 28407 leader_election.cc:304] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:54.025195 28563 tablet_bootstrap.cc:492] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:54.025012 28621 consensus_queue.cc:1048] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.025236 28561 ts_tablet_manager.cc:1434] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:54.026072 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1e398ade0f49ea882023d45c3ca9dc" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:54.025795 28563 ts_tablet_manager.cc:1403] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.008s
I20260709 12:12:54.026799 28292 raft_consensus.cc:2468] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:54.029759 28563 raft_consensus.cc:359] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.030674 28563 raft_consensus.cc:385] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.031004 28562 tablet_bootstrap.cc:654] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.031040 28563 raft_consensus.cc:740] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.032342 28563 consensus_queue.cc:260] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.033694 28642 raft_consensus.cc:2804] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.034135 28642 raft_consensus.cc:493] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.034505 28642 raft_consensus.cc:3060] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.035336 28563 ts_tablet_manager.cc:1434] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:54.036588 28563 tablet_bootstrap.cc:492] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:54.044843 28563 tablet_bootstrap.cc:654] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.025418 28564 tablet_bootstrap.cc:654] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.056917 28563 tablet_bootstrap.cc:492] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:54.057507 28563 ts_tablet_manager.cc:1403] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:12:54.057837 28561 tablet_bootstrap.cc:492] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:54.060331 28562 tablet_bootstrap.cc:492] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:54.060248 28563 raft_consensus.cc:359] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.061014 28563 raft_consensus.cc:385] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.061053 28562 ts_tablet_manager.cc:1403] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.009s
I20260709 12:12:54.061408 28563 raft_consensus.cc:740] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.062438 28563 consensus_queue.cc:260] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.065194 28563 ts_tablet_manager.cc:1434] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:54.065212 28562 raft_consensus.cc:359] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.066272 28563 tablet_bootstrap.cc:492] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:54.066320 28562 raft_consensus.cc:385] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.069341 28561 tablet_bootstrap.cc:654] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.069669 28564 tablet_bootstrap.cc:492] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:54.070254 28564 ts_tablet_manager.cc:1403] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.001s
I20260709 12:12:54.066980 28562 raft_consensus.cc:740] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.066928 28642 raft_consensus.cc:515] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.072953 28563 tablet_bootstrap.cc:654] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.072309 28562 consensus_queue.cc:260] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.075256 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1e398ade0f49ea882023d45c3ca9dc" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:54.075940 28367 raft_consensus.cc:3060] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.080583 28562 ts_tablet_manager.cc:1434] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:12:54.083149 28562 tablet_bootstrap.cc:492] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:54.085003 28367 raft_consensus.cc:2468] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:54.086323 28642 leader_election.cc:290] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:54.086440 28407 leader_election.cc:304] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:54.087435 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1e398ade0f49ea882023d45c3ca9dc" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:54.088023 28292 raft_consensus.cc:3060] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.081593 28564 raft_consensus.cc:359] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.086755 28611 raft_consensus.cc:493] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.090759 28564 raft_consensus.cc:385] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.091156 28564 raft_consensus.cc:740] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.090895 28611 raft_consensus.cc:515] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.092085 28564 consensus_queue.cc:260] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.093251 28611 leader_election.cc:290] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:54.094316 28564 ts_tablet_manager.cc:1434] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:12:54.082049 28563 tablet_bootstrap.cc:492] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:54.094378 28598 raft_consensus.cc:2804] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.094609 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596443671174eda93522f0319b083f4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:54.095285 28563 ts_tablet_manager.cc:1403] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.003s
I20260709 12:12:54.095227 28598 raft_consensus.cc:697] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:54.095619 28290 raft_consensus.cc:2393] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate f4ce5f603caa48ababe023df3a36c0b4 in this term.
I20260709 12:12:54.095235 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596443671174eda93522f0319b083f4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:54.098482 28563 raft_consensus.cc:359] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.096319 28598 consensus_queue.cc:237] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.099205 28563 raft_consensus.cc:385] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.099479 28563 raft_consensus.cc:740] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.100137 28563 consensus_queue.cc:260] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.102178 28563 ts_tablet_manager.cc:1434] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:12:54.103457 28563 tablet_bootstrap.cc:492] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:54.104863 28621 raft_consensus.cc:493] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.105934 28564 tablet_bootstrap.cc:492] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:54.105731 28479 leader_election.cc:304] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:54.113844 28611 raft_consensus.cc:3060] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.105607 28621 raft_consensus.cc:515] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.119102 28621 leader_election.cc:290] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.108083 28292 raft_consensus.cc:2468] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:54.120289 28562 tablet_bootstrap.cc:654] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.121827 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:54.122611 28516 raft_consensus.cc:2468] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:54.124528 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:54.126317 28259 leader_election.cc:304] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
W20260709 12:12:54.127347 28259 leader_election.cc:343] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.128394 28621 raft_consensus.cc:2804] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.128813 28621 raft_consensus.cc:493] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.129166 28621 raft_consensus.cc:3060] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.129933 28564 tablet_bootstrap.cc:654] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.132167 28611 raft_consensus.cc:2749] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.133602 28561 tablet_bootstrap.cc:492] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:54.137996 28563 tablet_bootstrap.cc:654] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.138550 28561 ts_tablet_manager.cc:1403] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.020s
I20260709 12:12:54.139083 28621 raft_consensus.cc:515] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.141784 28561 raft_consensus.cc:359] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.142066 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:54.142649 28561 raft_consensus.cc:385] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.143020 28561 raft_consensus.cc:740] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
W20260709 12:12:54.143702 28259 leader_election.cc:343] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.143797 28561 consensus_queue.cc:260] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.126327 28190 catalog_manager.cc:5697] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.146229 28561 ts_tablet_manager.cc:1434] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:12:54.147719 28561 tablet_bootstrap.cc:492] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:54.153424 28621 leader_election.cc:290] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.154161 28621 raft_consensus.cc:493] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.154868 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:54.154716 28621 raft_consensus.cc:515] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.155541 28516 raft_consensus.cc:3060] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.157140 28621 leader_election.cc:290] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.158366 28561 tablet_bootstrap.cc:654] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.165144 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:54.166160 28441 raft_consensus.cc:2468] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:54.168311 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:54.169286 28515 raft_consensus.cc:2468] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:54.171366 28259 leader_election.cc:304] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:12:54.172505 28621 raft_consensus.cc:2804] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.172991 28621 raft_consensus.cc:493] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.173437 28621 raft_consensus.cc:3060] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.176757 28562 tablet_bootstrap.cc:492] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:54.177400 28562 ts_tablet_manager.cc:1403] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.004s
I20260709 12:12:54.180886 28562 raft_consensus.cc:359] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.181710 28562 raft_consensus.cc:385] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.182034 28562 raft_consensus.cc:740] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.182998 28562 consensus_queue.cc:260] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.188539 28516 raft_consensus.cc:2468] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:54.189641 28562 ts_tablet_manager.cc:1434] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:12:54.190421 28259 leader_election.cc:304] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:54.191529 28569 raft_consensus.cc:2804] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.195441 28562 tablet_bootstrap.cc:492] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:54.209419 28564 tablet_bootstrap.cc:492] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:54.209229 28621 raft_consensus.cc:515] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.210119 28564 ts_tablet_manager.cc:1403] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.008s
I20260709 12:12:54.211709 28569 raft_consensus.cc:697] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:54.212746 28563 tablet_bootstrap.cc:492] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:54.213358 28563 ts_tablet_manager.cc:1403] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.007s
I20260709 12:12:54.215194 28564 raft_consensus.cc:359] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.216195 28564 raft_consensus.cc:385] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.216706 28564 raft_consensus.cc:740] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.216280 28563 raft_consensus.cc:359] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.217432 28563 raft_consensus.cc:385] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.217872 28563 raft_consensus.cc:740] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.218676 28562 tablet_bootstrap.cc:654] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.218832 28563 consensus_queue.cc:260] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.221339 28563 ts_tablet_manager.cc:1434] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:12:54.212756 28569 consensus_queue.cc:237] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.223584 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:54.224231 28441 raft_consensus.cc:3060] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.224668 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:54.227421 28563 tablet_bootstrap.cc:492] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:54.226660 28515 raft_consensus.cc:3060] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.226867 28621 leader_election.cc:290] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.264680 28598 consensus_queue.cc:1048] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.276403 28441 raft_consensus.cc:2468] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:54.278178 28259 leader_election.cc:304] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:54.279361 28621 raft_consensus.cc:2804] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.279999 28621 raft_consensus.cc:697] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:54.281243 28515 raft_consensus.cc:2468] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:54.281023 28621 consensus_queue.cc:237] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.282688 28564 consensus_queue.cc:260] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.285441 28570 raft_consensus.cc:493] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.285712 28564 ts_tablet_manager.cc:1434] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:12:54.286013 28570 raft_consensus.cc:515] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.287295 28564 tablet_bootstrap.cc:492] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:54.288390 28570 leader_election.cc:290] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.290623 28562 tablet_bootstrap.cc:492] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:54.290297 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:54.302892 28514 raft_consensus.cc:2468] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:54.303505 28564 tablet_bootstrap.cc:654] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.291682 28561 tablet_bootstrap.cc:492] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:54.304160 28561 ts_tablet_manager.cc:1403] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.157s	user 0.034s	sys 0.059s
I20260709 12:12:54.304354 28334 leader_election.cc:304] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:54.305310 28570 raft_consensus.cc:2804] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.305709 28570 raft_consensus.cc:493] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.306069 28570 raft_consensus.cc:3060] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.294873 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:54.295680 28190 catalog_manager.cc:5697] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.308832 28561 raft_consensus.cc:359] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.310042 28561 raft_consensus.cc:385] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.310389 28561 raft_consensus.cc:740] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.311172 28561 consensus_queue.cc:260] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.297226 28598 consensus_queue.cc:1048] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.299494 28642 raft_consensus.cc:493] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.313441 28642 raft_consensus.cc:515] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.312110 28562 ts_tablet_manager.cc:1403] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.117s	user 0.020s	sys 0.047s
I20260709 12:12:54.313961 28561 ts_tablet_manager.cc:1434] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.008s
I20260709 12:12:54.316888 28626 raft_consensus.cc:493] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.317437 28626 raft_consensus.cc:515] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.319584 28626 leader_election.cc:290] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.320596 28561 tablet_bootstrap.cc:492] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:54.321633 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2c38e0d98e4333a355f887eeaf2f8f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:54.319423 28562 raft_consensus.cc:359] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.322353 28514 raft_consensus.cc:2468] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:54.325793 28562 raft_consensus.cc:385] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.326288 28562 raft_consensus.cc:740] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.323220 28441 raft_consensus.cc:2468] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:54.334920 28562 consensus_queue.cc:260] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.337891 28562 ts_tablet_manager.cc:1434] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:12:54.339395 28562 tablet_bootstrap.cc:492] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:54.323146 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2c38e0d98e4333a355f887eeaf2f8f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:54.325273 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:54.351363 28569 raft_consensus.cc:493] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.352028 28569 raft_consensus.cc:515] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.359184 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7f53771e4d49d49b819836af06d45f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:54.360993 28187 catalog_manager.cc:5697] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.326607 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:54.362927 28516 raft_consensus.cc:2468] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:54.315698 28642 leader_election.cc:290] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.327461 28611 raft_consensus.cc:493] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.366520 28611 raft_consensus.cc:515] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.326774 28334 leader_election.cc:304] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:54.368475 28562 tablet_bootstrap.cc:654] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:54.368848 28334 leader_election.cc:343] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.370040 28611 leader_election.cc:290] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:54.333599 28561 tablet_bootstrap.cc:654] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.371191 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:54.372720 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:54.373471 28366 raft_consensus.cc:2468] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
W20260709 12:12:54.374831 28479 leader_election.cc:343] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.375397 28569 leader_election.cc:290] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:54.375800 28408 leader_election.cc:304] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:54.376879 28642 raft_consensus.cc:2804] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.377321 28642 raft_consensus.cc:493] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.377734 28642 raft_consensus.cc:3060] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.379694 28481 leader_election.cc:304] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:54.380878 28598 raft_consensus.cc:493] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.385825 28598 raft_consensus.cc:515] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.393386 28598 leader_election.cc:290] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:54.395000 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:54.363420 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7f53771e4d49d49b819836af06d45f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:54.397851 28259 leader_election.cc:304] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:54.399580 28621 raft_consensus.cc:2749] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.382800 28626 raft_consensus.cc:2804] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.385135 28562 tablet_bootstrap.cc:492] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:54.401425 28626 raft_consensus.cc:493] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.401973 28626 raft_consensus.cc:3060] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.401695 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:54.402853 28516 raft_consensus.cc:2393] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ce5f603caa48ababe023df3a36c0b4 in current term 1: Already voted for candidate 24654af7758f4a5ebc3e3a8fba0b617a in this term.
I20260709 12:12:54.385085 28611 raft_consensus.cc:2804] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.404340 28611 raft_consensus.cc:493] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.407267 28562 ts_tablet_manager.cc:1403] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.005s
I20260709 12:12:54.407620 28408 leader_election.cc:304] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:54.409840 28642 raft_consensus.cc:515] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.411561 28562 raft_consensus.cc:359] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.430212 28571 consensus_queue.cc:1048] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.415047 28598 raft_consensus.cc:3060] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.296826 28563 tablet_bootstrap.cc:654] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.434684 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:54.435581 28515 raft_consensus.cc:3060] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.430630 28562 raft_consensus.cc:385] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.437353 28562 raft_consensus.cc:740] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.438520 28562 consensus_queue.cc:260] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.404836 28611 raft_consensus.cc:3060] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.420900 28569 raft_consensus.cc:493] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.441411 28569 raft_consensus.cc:515] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.447992 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:54.448750 28368 raft_consensus.cc:2468] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:54.453450 28258 leader_election.cc:304] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:54.455101 28663 raft_consensus.cc:2804] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.455700 28663 raft_consensus.cc:493] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.456202 28663 raft_consensus.cc:3060] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.463923 28569 leader_election.cc:290] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:54.472538 28611 raft_consensus.cc:515] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.476948 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:54.477560 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:54.478552 28368 raft_consensus.cc:3060] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:54.479079 28479 leader_election.cc:343] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.483893 28663 raft_consensus.cc:515] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.487780 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:54.494179 28365 raft_consensus.cc:3060] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.456287 28642 leader_election.cc:290] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.507650 28290 raft_consensus.cc:3060] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.490953 28368 raft_consensus.cc:2468] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:54.509474 28481 leader_election.cc:304] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:54.510476 28571 raft_consensus.cc:2804] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.511294 28571 raft_consensus.cc:697] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:54.512261 28571 consensus_queue.cc:237] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.513867 28365 raft_consensus.cc:2468] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:54.486267 28663 leader_election.cc:290] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:54.515264 28258 leader_election.cc:304] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:54.491209 28611 leader_election.cc:290] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:54.522718 28569 raft_consensus.cc:2804] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.523670 28569 raft_consensus.cc:697] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:54.524736 28569 consensus_queue.cc:237] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.532177 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:54.534650 28561 tablet_bootstrap.cc:492] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:54.535383 28561 ts_tablet_manager.cc:1403] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.215s	user 0.017s	sys 0.015s
I20260709 12:12:54.540693 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
W20260709 12:12:54.540611 28408 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:33813, user_credentials={real_user=slave}} blocked reactor thread for 94182.5us
I20260709 12:12:54.553328 28516 raft_consensus.cc:3060] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.541499 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:54.522645 28515 raft_consensus.cc:2468] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:54.345180 28570 raft_consensus.cc:515] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.566885 28367 raft_consensus.cc:2393] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ce5f603caa48ababe023df3a36c0b4 in current term 1: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:12:54.515188 28563 tablet_bootstrap.cc:492] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:54.548960 28631 consensus_queue.cc:1048] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.577144 28570 leader_election.cc:290] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.577971 28571 consensus_queue.cc:1048] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.567713 28408 leader_election.cc:304] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:54.569054 28563 ts_tablet_manager.cc:1403] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.343s	user 0.013s	sys 0.001s
I20260709 12:12:54.593386 28561 raft_consensus.cc:359] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.598507 28561 raft_consensus.cc:385] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.599141 28561 raft_consensus.cc:740] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.600005 28561 consensus_queue.cc:260] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.603725 28562 ts_tablet_manager.cc:1434] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.196s	user 0.034s	sys 0.022s
I20260709 12:12:54.607568 28564 tablet_bootstrap.cc:492] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:54.608374 28564 ts_tablet_manager.cc:1403] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.321s	user 0.097s	sys 0.128s
W20260709 12:12:54.598737 28259 leader_election.cc:343] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.610177 28562 tablet_bootstrap.cc:492] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:54.610803 28561 ts_tablet_manager.cc:1434] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 12:12:54.600432 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:54.612608 28515 raft_consensus.cc:2393] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 1: Already voted for candidate f4ce5f603caa48ababe023df3a36c0b4 in this term.
W20260709 12:12:54.612897 28259 leader_election.cc:343] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.610204 28598 raft_consensus.cc:2749] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.615200 28626 raft_consensus.cc:515] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.611964 28561 tablet_bootstrap.cc:492] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:54.625489 28563 raft_consensus.cc:359] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.626190 28626 leader_election.cc:290] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:54.626291 28563 raft_consensus.cc:385] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.626891 28563 raft_consensus.cc:740] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.627089 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:54.627652 28563 consensus_queue.cc:260] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.629977 28563 ts_tablet_manager.cc:1434] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 12:12:54.631820 28563 tablet_bootstrap.cc:492] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:54.633241 28631 consensus_queue.cc:1048] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.634163 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2c38e0d98e4333a355f887eeaf2f8f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:54.635625 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2c38e0d98e4333a355f887eeaf2f8f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:54.636317 28515 raft_consensus.cc:3060] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.637897 28563 tablet_bootstrap.cc:654] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.639931 28564 raft_consensus.cc:359] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.640741 28564 raft_consensus.cc:385] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.641019 28564 raft_consensus.cc:740] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.641465 28676 raft_consensus.cc:2804] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.642026 28676 raft_consensus.cc:697] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:54.641783 28564 consensus_queue.cc:260] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.643548 28562 tablet_bootstrap.cc:654] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.644392 28564 ts_tablet_manager.cc:1434] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:12:54.644910 28676 consensus_queue.cc:237] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.645493 28564 tablet_bootstrap.cc:492] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:54.660426 28440 raft_consensus.cc:3060] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.671420 28663 raft_consensus.cc:493] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.672043 28663 raft_consensus.cc:515] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.674403 28663 leader_election.cc:290] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:54.675525 28515 raft_consensus.cc:2468] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:54.676142 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:54.678422 28564 tablet_bootstrap.cc:654] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.679968 28334 leader_election.cc:304] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:54.681012 28626 raft_consensus.cc:2804] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.681550 28626 raft_consensus.cc:697] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
W20260709 12:12:54.682696 28258 leader_election.cc:343] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.683197 28626 consensus_queue.cc:237] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.683872 28663 consensus_queue.cc:1048] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.681897 28190 catalog_manager.cc:5697] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.692705 28561 tablet_bootstrap.cc:654] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.711274 28663 consensus_queue.cc:1048] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.713579 28440 raft_consensus.cc:2468] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:54.700018 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:54.730114 28191 catalog_manager.cc:5697] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.739149 28663 raft_consensus.cc:493] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.752007 28663 raft_consensus.cc:515] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.752475 28562 tablet_bootstrap.cc:492] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:54.753290 28562 ts_tablet_manager.cc:1403] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.148s	user 0.025s	sys 0.022s
I20260709 12:12:54.755323 28563 tablet_bootstrap.cc:492] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:54.755914 28563 ts_tablet_manager.cc:1403] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.005s
I20260709 12:12:54.756007 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb308f551c2c483eacd2ca20c16ec438" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:54.757720 28258 leader_election.cc:343] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.760017 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb308f551c2c483eacd2ca20c16ec438" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
W20260709 12:12:54.761901 28259 leader_election.cc:343] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.762573 28259 leader_election.cc:304] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:54.763530 28569 raft_consensus.cc:2749] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.764452 28663 leader_election.cc:290] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:54.766106 28563 raft_consensus.cc:359] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.767112 28563 raft_consensus.cc:385] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.767525 28563 raft_consensus.cc:740] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.744652 28334 leader_election.cc:304] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:54.772436 28626 raft_consensus.cc:2749] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.731531 28515 raft_consensus.cc:2468] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:54.778898 28259 leader_election.cc:304] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:54.779893 28663 consensus_queue.cc:1048] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.780141 28569 raft_consensus.cc:2804] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.780833 28569 raft_consensus.cc:493] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.781263 28569 raft_consensus.cc:3060] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.785090 28562 raft_consensus.cc:359] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.785910 28562 raft_consensus.cc:385] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.786207 28562 raft_consensus.cc:740] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.786068 28561 tablet_bootstrap.cc:492] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:54.786847 28561 ts_tablet_manager.cc:1403] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.006s
I20260709 12:12:54.786993 28562 consensus_queue.cc:260] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.789193 28562 ts_tablet_manager.cc:1434] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:12:54.790166 28562 tablet_bootstrap.cc:492] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:54.789927 28561 raft_consensus.cc:359] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.790656 28561 raft_consensus.cc:385] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.790951 28561 raft_consensus.cc:740] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.791811 28561 consensus_queue.cc:260] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.795481 28561 ts_tablet_manager.cc:1434] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:12:54.796530 28561 tablet_bootstrap.cc:492] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:54.768579 28563 consensus_queue.cc:260] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.808161 28563 ts_tablet_manager.cc:1434] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 12:12:54.809795 28367 raft_consensus.cc:3060] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.814941 28563 tablet_bootstrap.cc:492] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:54.821171 28621 consensus_queue.cc:1048] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.822815 28563 tablet_bootstrap.cc:654] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.830106 28564 tablet_bootstrap.cc:492] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:54.830992 28564 ts_tablet_manager.cc:1403] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.186s	user 0.020s	sys 0.045s
I20260709 12:12:54.833819 28562 tablet_bootstrap.cc:654] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.840106 28561 tablet_bootstrap.cc:654] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:54.839686 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:54.837206 28564 raft_consensus.cc:359] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.851140 28564 raft_consensus.cc:385] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.851577 28564 raft_consensus.cc:740] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.852780 28564 consensus_queue.cc:260] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.855800 28564 ts_tablet_manager.cc:1434] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.005s
I20260709 12:12:54.857064 28564 tablet_bootstrap.cc:492] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:54.865957 28562 tablet_bootstrap.cc:492] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:54.865283 28188 catalog_manager.cc:5697] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.866669 28562 ts_tablet_manager.cc:1403] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.000s
I20260709 12:12:54.863157 28569 raft_consensus.cc:515] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.868398 28564 tablet_bootstrap.cc:654] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.870199 28562 raft_consensus.cc:359] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.873481 28562 raft_consensus.cc:385] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.873894 28562 raft_consensus.cc:740] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.877979 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:54.878715 28561 tablet_bootstrap.cc:492] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:54.878747 28514 raft_consensus.cc:3060] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.879376 28561 ts_tablet_manager.cc:1403] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.000s
I20260709 12:12:54.881657 28562 consensus_queue.cc:260] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:54.884488 28561 raft_consensus.cc:359] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.885046 28562 ts_tablet_manager.cc:1434] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 12:12:54.885389 28561 raft_consensus.cc:385] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.886264 28561 raft_consensus.cc:740] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.886840 28562 tablet_bootstrap.cc:492] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:54.896238 28569 leader_election.cc:290] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:54.901131 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:54.904201 28563 tablet_bootstrap.cc:492] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:54.904816 28563 ts_tablet_manager.cc:1403] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.015s
I20260709 12:12:54.906512 28514 raft_consensus.cc:2468] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:54.907776 28259 leader_election.cc:304] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:12:54.908028 28561 consensus_queue.cc:260] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.908906 28569 raft_consensus.cc:2804] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:54.909482 28258 leader_election.cc:343] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.910058 28569 raft_consensus.cc:697] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:54.910370 28561 ts_tablet_manager.cc:1434] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:12:54.910280 28621 raft_consensus.cc:493] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.907725 28684 consensus_queue.cc:1048] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.911477 28561 tablet_bootstrap.cc:492] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:54.911005 28569 consensus_queue.cc:237] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.911022 28621 raft_consensus.cc:515] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:54.913694 28621 leader_election.cc:290] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:54.896304 28189 catalog_manager.cc:5697] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.921254 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b9e10e4b584dd0bdc388ba5535e94a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:54.922734 28258 leader_election.cc:343] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.923425 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b9e10e4b584dd0bdc388ba5535e94a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:54.925921 28564 tablet_bootstrap.cc:492] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:54.926386 28564 ts_tablet_manager.cc:1403] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.006s
W20260709 12:12:54.928020 28259 leader_election.cc:343] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.928484 28259 leader_election.cc:304] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:54.929368 28564 raft_consensus.cc:359] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.929924 28621 raft_consensus.cc:2749] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.930080 28564 raft_consensus.cc:385] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.930513 28564 raft_consensus.cc:740] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.930696 28563 raft_consensus.cc:359] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.932772 28563 raft_consensus.cc:385] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.933075 28563 raft_consensus.cc:740] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.937924 28563 consensus_queue.cc:260] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:54.940339 28563 ts_tablet_manager.cc:1434] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:12:54.941394 28563 tablet_bootstrap.cc:492] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:54.949712 28562 tablet_bootstrap.cc:654] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.949882 28564 consensus_queue.cc:260] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.952600 28564 ts_tablet_manager.cc:1434] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:12:54.953740 28564 tablet_bootstrap.cc:492] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:54.957643 28563 tablet_bootstrap.cc:654] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.958501 28561 tablet_bootstrap.cc:654] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:54.963990 28479 consensus_peers.cc:597] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.964351 28564 tablet_bootstrap.cc:654] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.977399 28564 tablet_bootstrap.cc:492] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:54.978006 28564 ts_tablet_manager.cc:1403] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 12:12:54.981462 28564 raft_consensus.cc:359] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.982323 28564 raft_consensus.cc:385] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.988869 28564 raft_consensus.cc:740] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.988159 28190 catalog_manager.cc:5697] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.990864 28564 consensus_queue.cc:260] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:54.996580 28564 ts_tablet_manager.cc:1434] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:12:54.997828 28564 tablet_bootstrap.cc:492] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:55.012054 28564 tablet_bootstrap.cc:654] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.015045 28562 tablet_bootstrap.cc:492] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:55.015547 28562 ts_tablet_manager.cc:1403] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.129s	user 0.012s	sys 0.024s
I20260709 12:12:55.016187 28563 tablet_bootstrap.cc:492] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:55.016492 28561 tablet_bootstrap.cc:492] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:55.016914 28563 ts_tablet_manager.cc:1403] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.076s	user 0.003s	sys 0.033s
I20260709 12:12:55.017002 28561 ts_tablet_manager.cc:1403] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.010s
I20260709 12:12:55.018323 28562 raft_consensus.cc:359] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.019099 28562 raft_consensus.cc:385] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.019380 28562 raft_consensus.cc:740] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.020303 28561 raft_consensus.cc:359] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.020231 28562 consensus_queue.cc:260] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.020625 28563 raft_consensus.cc:359] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.021272 28561 raft_consensus.cc:385] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.021615 28563 raft_consensus.cc:385] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.021644 28561 raft_consensus.cc:740] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.022169 28563 raft_consensus.cc:740] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.022962 28561 consensus_queue.cc:260] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.023061 28563 consensus_queue.cc:260] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.029959 28563 ts_tablet_manager.cc:1434] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:55.031199 28563 tablet_bootstrap.cc:492] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:55.032346 28631 raft_consensus.cc:493] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.032925 28631 raft_consensus.cc:515] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.037168 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb308f551c2c483eacd2ca20c16ec438" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.038264 28563 tablet_bootstrap.cc:654] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:55.038587 28407 leader_election.cc:343] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.039795 28631 leader_election.cc:290] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.040989 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb308f551c2c483eacd2ca20c16ec438" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:55.041680 28290 raft_consensus.cc:2468] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:55.042665 28564 tablet_bootstrap.cc:492] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:55.043259 28564 ts_tablet_manager.cc:1403] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.000s
I20260709 12:12:55.043545 28405 leader_election.cc:304] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.044731 28631 raft_consensus.cc:2804] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.045125 28631 raft_consensus.cc:493] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.045456 28631 raft_consensus.cc:3060] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.046639 28564 raft_consensus.cc:359] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.047389 28564 raft_consensus.cc:385] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.047719 28564 raft_consensus.cc:740] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.048601 28564 consensus_queue.cc:260] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.054229 28564 ts_tablet_manager.cc:1434] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:12:55.055294 28564 tablet_bootstrap.cc:492] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:55.055371 28569 consensus_queue.cc:1048] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.058344 28598 raft_consensus.cc:493] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.058921 28598 raft_consensus.cc:515] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.061094 28598 leader_election.cc:290] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.064356 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.066687 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:55.067833 28561 ts_tablet_manager.cc:1434] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:12:55.068413 28405 leader_election.cc:304] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.069679 28598 raft_consensus.cc:2749] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.071851 28564 tablet_bootstrap.cc:654] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.074764 28626 raft_consensus.cc:493] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.075328 28626 raft_consensus.cc:515] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.077654 28626 leader_election.cc:290] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:55.079797 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:55.080729 28514 raft_consensus.cc:2393] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 1: Already voted for candidate 24654af7758f4a5ebc3e3a8fba0b617a in this term.
I20260709 12:12:55.081507 28626 consensus_queue.cc:1048] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.082283 28561 tablet_bootstrap.cc:492] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:55.084007 28569 raft_consensus.cc:493] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.084558 28569 raft_consensus.cc:515] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.085366 28564 tablet_bootstrap.cc:492] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:55.085645 28562 ts_tablet_manager.cc:1434] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:12:55.085990 28564 ts_tablet_manager.cc:1403] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.003s
I20260709 12:12:55.087109 28569 leader_election.cc:290] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:55.078666 28631 raft_consensus.cc:515] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.089303 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:55.089598 28561 tablet_bootstrap.cc:654] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.089995 28514 raft_consensus.cc:2468] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:55.090103 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb308f551c2c483eacd2ca20c16ec438" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:55.084002 28598 raft_consensus.cc:493] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.090723 28292 raft_consensus.cc:3060] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.091138 28598 raft_consensus.cc:515] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.093924 28259 leader_election.cc:304] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:12:55.095016 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "850ee7c88fe1482985405700cf63d47a" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:55.083402 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:55.095760 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "850ee7c88fe1482985405700cf63d47a" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.096426 28367 raft_consensus.cc:2468] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
W20260709 12:12:55.096458 28408 leader_election.cc:343] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.097224 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:55.096350 28569 raft_consensus.cc:2804] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.098009 28407 leader_election.cc:304] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:55.098338 28569 raft_consensus.cc:493] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.098779 28569 raft_consensus.cc:3060] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.099035 28676 raft_consensus.cc:2804] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.099432 28676 raft_consensus.cc:493] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.099772 28676 raft_consensus.cc:3060] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.100929 28331 leader_election.cc:304] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:55.097977 28441 raft_consensus.cc:2468] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:55.102752 28626 raft_consensus.cc:3060] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.108263 28598 leader_election.cc:290] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:55.111471 28564 raft_consensus.cc:359] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.112195 28564 raft_consensus.cc:385] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.112437 28564 raft_consensus.cc:740] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.116367 28676 raft_consensus.cc:515] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.117120 28292 raft_consensus.cc:2468] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:55.120306 28569 raft_consensus.cc:515] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.118330 28564 consensus_queue.cc:260] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.122767 28405 leader_election.cc:304] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:55.122953 28675 consensus_queue.cc:1048] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.124859 28675 raft_consensus.cc:2804] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.125430 28675 raft_consensus.cc:697] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:55.131489 28675 consensus_queue.cc:237] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.134203 28621 raft_consensus.cc:493] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.135331 28621 raft_consensus.cc:515] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.138121 28564 ts_tablet_manager.cc:1434] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:12:55.142566 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:55.143181 28441 raft_consensus.cc:3060] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.150518 28621 leader_election.cc:290] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.151535 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.151468 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:55.150816 28442 raft_consensus.cc:3060] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.159157 28259 leader_election.cc:304] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.160955 28621 raft_consensus.cc:2749] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.165757 28441 raft_consensus.cc:2468] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:55.163389 28621 consensus_queue.cc:1048] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:55.168984 28676 leader_election.cc:290] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:55.169718 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "850ee7c88fe1482985405700cf63d47a" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:55.170373 28366 raft_consensus.cc:3060] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.170557 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "850ee7c88fe1482985405700cf63d47a" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
W20260709 12:12:55.172266 28408 leader_election.cc:343] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.174132 28562 tablet_bootstrap.cc:492] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:55.179967 28564 tablet_bootstrap.cc:492] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:55.199985 28611 raft_consensus.cc:493] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:55.199616 28405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 76945.2us
I20260709 12:12:55.209529 28561 tablet_bootstrap.cc:492] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:55.210284 28561 ts_tablet_manager.cc:1403] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.128s	user 0.053s	sys 0.062s
I20260709 12:12:55.212915 28611 raft_consensus.cc:515] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.215842 28626 raft_consensus.cc:2749] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.216756 28569 leader_election.cc:290] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:55.218430 28611 leader_election.cc:290] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:55.219316 28631 leader_election.cc:290] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.256130 28259 leader_election.cc:304] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:55.178906 28366 raft_consensus.cc:2468] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:55.267493 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:55.269174 28514 raft_consensus.cc:3060] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.273427 28407 leader_election.cc:304] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:55.281291 28621 raft_consensus.cc:2804] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.281545 28720 raft_consensus.cc:2804] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.283929 28720 raft_consensus.cc:697] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:55.297571 28626 consensus_queue.cc:1048] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.298475 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b567deb01fe4f3fb96d69d4943fece9" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:55.299612 28439 raft_consensus.cc:2468] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:55.277194 28718 consensus_queue.cc:1048] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.285646 28720 consensus_queue.cc:237] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.303848 28561 raft_consensus.cc:359] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.304822 28561 raft_consensus.cc:385] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.305167 28561 raft_consensus.cc:740] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.315842 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb308f551c2c483eacd2ca20c16ec438" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:55.307966 28621 raft_consensus.cc:697] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:55.330523 28564 tablet_bootstrap.cc:654] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.326117 28561 consensus_queue.cc:260] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.346144 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b567deb01fe4f3fb96d69d4943fece9" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.360955 28482 leader_election.cc:304] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:55.365147 28571 raft_consensus.cc:2804] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.365386 28563 tablet_bootstrap.cc:492] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:55.365644 28571 raft_consensus.cc:493] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.366163 28571 raft_consensus.cc:3060] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.366456 28563 ts_tablet_manager.cc:1403] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.335s	user 0.040s	sys 0.036s
I20260709 12:12:55.373286 28562 tablet_bootstrap.cc:654] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.379773 28563 raft_consensus.cc:359] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.380793 28563 raft_consensus.cc:385] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.381224 28563 raft_consensus.cc:740] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.381717 28611 raft_consensus.cc:493] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.382588 28611 raft_consensus.cc:515] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:12:55.387421 28481 leader_election.cc:343] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.394381 28561 ts_tablet_manager.cc:1434] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.184s	user 0.007s	sys 0.008s
I20260709 12:12:55.401158 28611 leader_election.cc:290] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.404709 28563 consensus_queue.cc:260] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.408213 28621 consensus_queue.cc:237] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.411160 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b9e10e4b584dd0bdc388ba5535e94a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:55.413976 28481 leader_election.cc:343] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.420773 28563 ts_tablet_manager.cc:1434] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.005s
I20260709 12:12:55.427665 28290 raft_consensus.cc:3060] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.438491 28725 raft_consensus.cc:493] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.439296 28725 raft_consensus.cc:515] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.440533 28561 tablet_bootstrap.cc:492] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:55.444820 28723 consensus_queue.cc:1048] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:12:55.448097 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f5691a910e47d185a194b58c0354ec" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.449779 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f5691a910e47d185a194b58c0354ec" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:55.450997 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b9e10e4b584dd0bdc388ba5535e94a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:55.452826 28292 raft_consensus.cc:2468] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:55.454391 28479 leader_election.cc:304] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.442320 28725 leader_election.cc:290] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
W20260709 12:12:55.464114 28259 leader_election.cc:343] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.464512 28613 raft_consensus.cc:2804] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.464978 28613 raft_consensus.cc:493] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.465440 28613 raft_consensus.cc:3060] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.470956 28563 tablet_bootstrap.cc:492] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:55.473546 28571 raft_consensus.cc:515] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
W20260709 12:12:55.475629 28407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:42205, user_credentials={real_user=slave}} blocked reactor thread for 160869us
I20260709 12:12:55.481314 28571 leader_election.cc:290] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:55.482280 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b567deb01fe4f3fb96d69d4943fece9" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:55.484124 28442 raft_consensus.cc:3060] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.485530 28564 tablet_bootstrap.cc:492] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:55.486264 28564 ts_tablet_manager.cc:1403] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.347s	user 0.020s	sys 0.009s
I20260709 12:12:55.486989 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b567deb01fe4f3fb96d69d4943fece9" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
W20260709 12:12:55.488730 28481 leader_election.cc:343] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.490024 28564 raft_consensus.cc:359] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
W20260709 12:12:55.490782 28258 leader_election.cc:343] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.491142 28564 raft_consensus.cc:385] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.491523 28564 raft_consensus.cc:740] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.491308 28258 leader_election.cc:304] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:55.492558 28564 consensus_queue.cc:260] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.503173 28514 raft_consensus.cc:2468] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:55.511121 28562 tablet_bootstrap.cc:492] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:55.505599 28621 raft_consensus.cc:2749] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.513625 28562 ts_tablet_manager.cc:1403] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.340s	user 0.016s	sys 0.021s
W20260709 12:12:55.507769 28407 leader_election.cc:343] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.525755 28561 tablet_bootstrap.cc:654] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.532801 28564 ts_tablet_manager.cc:1434] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 12:12:55.534755 28563 tablet_bootstrap.cc:654] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.522341 28190 catalog_manager.cc:5697] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.538579 28442 raft_consensus.cc:2468] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:55.534245 28564 tablet_bootstrap.cc:492] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:55.540256 28191 catalog_manager.cc:5697] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.546101 28482 leader_election.cc:304] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.549033 28571 raft_consensus.cc:2804] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.549554 28571 raft_consensus.cc:697] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:55.547082 28562 raft_consensus.cc:359] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.550431 28562 raft_consensus.cc:385] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.550737 28571 consensus_queue.cc:237] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.553792 28564 tablet_bootstrap.cc:654] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.557250 28191 catalog_manager.cc:5697] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.550756 28562 raft_consensus.cc:740] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.578658 28621 consensus_queue.cc:1048] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.573794 28613 raft_consensus.cc:515] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.584079 28562 consensus_queue.cc:260] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.591979 28562 ts_tablet_manager.cc:1434] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.004s
I20260709 12:12:55.593323 28562 tablet_bootstrap.cc:492] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:55.593621 28564 tablet_bootstrap.cc:492] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:55.593416 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b9e10e4b584dd0bdc388ba5535e94a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:55.594158 28564 ts_tablet_manager.cc:1403] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.000s
I20260709 12:12:55.594271 28292 raft_consensus.cc:3060] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.594772 28563 tablet_bootstrap.cc:492] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:55.595530 28563 ts_tablet_manager.cc:1403] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.173s	user 0.012s	sys 0.030s
I20260709 12:12:55.597308 28564 raft_consensus.cc:359] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.598090 28564 raft_consensus.cc:385] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.598385 28564 raft_consensus.cc:740] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.599354 28564 consensus_queue.cc:260] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.600421 28562 tablet_bootstrap.cc:654] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.603540 28613 leader_election.cc:290] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.604399 28564 ts_tablet_manager.cc:1434] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:12:55.604349 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b9e10e4b584dd0bdc388ba5535e94a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:55.611328 28563 raft_consensus.cc:359] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:12:55.611896 28481 leader_election.cc:343] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.612708 28563 raft_consensus.cc:385] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.613143 28564 tablet_bootstrap.cc:492] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:55.618165 28561 tablet_bootstrap.cc:492] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:55.620656 28561 ts_tablet_manager.cc:1403] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.187s	user 0.016s	sys 0.009s
I20260709 12:12:55.613128 28563 raft_consensus.cc:740] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.622782 28563 consensus_queue.cc:260] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.623615 28292 raft_consensus.cc:2468] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:55.625435 28563 ts_tablet_manager.cc:1434] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.006s
I20260709 12:12:55.625723 28561 raft_consensus.cc:359] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.626538 28561 raft_consensus.cc:385] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.626914 28561 raft_consensus.cc:740] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.626906 28563 tablet_bootstrap.cc:492] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:55.627266 28479 leader_election.cc:304] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.627852 28561 consensus_queue.cc:260] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.628559 28613 raft_consensus.cc:2804] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.629696 28613 raft_consensus.cc:697] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
W20260709 12:12:55.634764 28407 consensus_peers.cc:597] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:55.630790 28613 consensus_queue.cc:237] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.638499 28563 tablet_bootstrap.cc:654] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.639184 28561 ts_tablet_manager.cc:1434] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:12:55.640658 28561 tablet_bootstrap.cc:492] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:55.641832 28564 tablet_bootstrap.cc:654] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.646876 28562 tablet_bootstrap.cc:492] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:55.647523 28562 ts_tablet_manager.cc:1403] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.008s
I20260709 12:12:55.650833 28562 raft_consensus.cc:359] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.651569 28562 raft_consensus.cc:385] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.651865 28562 raft_consensus.cc:740] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.652549 28562 consensus_queue.cc:260] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.658018 28561 tablet_bootstrap.cc:654] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.660583 28564 tablet_bootstrap.cc:492] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:55.661126 28564 ts_tablet_manager.cc:1403] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.002s
I20260709 12:12:55.662607 28562 ts_tablet_manager.cc:1434] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:55.664027 28562 tablet_bootstrap.cc:492] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:55.671527 28564 raft_consensus.cc:359] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.672356 28564 raft_consensus.cc:385] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.672703 28564 raft_consensus.cc:740] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.673460 28564 consensus_queue.cc:260] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.675770 28564 ts_tablet_manager.cc:1434] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:12:55.677018 28564 tablet_bootstrap.cc:492] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:55.679180 28562 tablet_bootstrap.cc:654] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.684120 28564 tablet_bootstrap.cc:654] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.685621 28720 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.686175 28720 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.691924 28561 tablet_bootstrap.cc:492] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:55.692646 28561 ts_tablet_manager.cc:1403] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.052s	user 0.026s	sys 0.010s
I20260709 12:12:55.694115 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:55.696717 28561 raft_consensus.cc:359] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.697723 28561 raft_consensus.cc:385] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.698073 28561 raft_consensus.cc:740] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
W20260709 12:12:55.698338 28405 leader_election.cc:343] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.699572 28561 consensus_queue.cc:260] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.702289 28561 ts_tablet_manager.cc:1434] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.007s
I20260709 12:12:55.703598 28561 tablet_bootstrap.cc:492] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:55.707633 28718 consensus_queue.cc:1048] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.711983 28561 tablet_bootstrap.cc:654] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.714378 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:55.716884 28407 leader_election.cc:343] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.717530 28407 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.718645 28720 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.719503 28720 raft_consensus.cc:2749] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.726147 28561 tablet_bootstrap.cc:492] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:55.726974 28561 ts_tablet_manager.cc:1403] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.011s
I20260709 12:12:55.727895 28563 tablet_bootstrap.cc:492] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:55.728425 28563 ts_tablet_manager.cc:1403] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.007s
I20260709 12:12:55.728571 28189 catalog_manager.cc:5697] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.730309 28561 raft_consensus.cc:359] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.731093 28561 raft_consensus.cc:385] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.731459 28561 raft_consensus.cc:740] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.732257 28561 consensus_queue.cc:260] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.733884 28563 raft_consensus.cc:359] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.734651 28563 raft_consensus.cc:385] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.734942 28563 raft_consensus.cc:740] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.737484 28561 ts_tablet_manager.cc:1434] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:12:55.737674 28563 consensus_queue.cc:260] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.739328 28561 tablet_bootstrap.cc:492] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:55.740094 28564 tablet_bootstrap.cc:492] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:55.740628 28564 ts_tablet_manager.cc:1403] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.030s
I20260709 12:12:55.741746 28563 ts_tablet_manager.cc:1434] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:12:55.742988 28563 tablet_bootstrap.cc:492] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:55.744045 28564 raft_consensus.cc:359] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.746588 28564 raft_consensus.cc:385] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.746977 28564 raft_consensus.cc:740] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.748881 28564 consensus_queue.cc:260] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.751996 28564 ts_tablet_manager.cc:1434] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 12:12:55.754022 28564 tablet_bootstrap.cc:492] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:55.756331 28563 tablet_bootstrap.cc:654] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.760917 28564 tablet_bootstrap.cc:654] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.731161 28189 catalog_manager.cc:5697] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.765821 28562 tablet_bootstrap.cc:492] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:55.766510 28562 ts_tablet_manager.cc:1403] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.103s	user 0.043s	sys 0.013s
I20260709 12:12:55.777068 28720 consensus_queue.cc:1048] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.777241 28562 raft_consensus.cc:359] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.778231 28562 raft_consensus.cc:385] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.778647 28562 raft_consensus.cc:740] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.779798 28562 consensus_queue.cc:260] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.788059 28561 tablet_bootstrap.cc:654] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.795454 28514 raft_consensus.cc:3060] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.819115 28720 raft_consensus.cc:493] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.819973 28720 raft_consensus.cc:515] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.821923 28563 tablet_bootstrap.cc:492] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:55.822657 28563 ts_tablet_manager.cc:1403] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.003s
I20260709 12:12:55.827433 28562 ts_tablet_manager.cc:1434] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.001s
I20260709 12:12:55.832015 28571 raft_consensus.cc:493] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.832585 28571 raft_consensus.cc:515] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.834084 28720 leader_election.cc:290] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.834823 28571 leader_election.cc:290] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:55.835428 28562 tablet_bootstrap.cc:492] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:55.835785 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f5691a910e47d185a194b58c0354ec" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.836898 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c089a99cd334841849bfd25380410fb" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
W20260709 12:12:55.837394 28407 leader_election.cc:343] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:55.838379 28479 leader_election.cc:343] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.839087 28621 raft_consensus.cc:493] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.840533 28563 raft_consensus.cc:359] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.841137 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f5691a910e47d185a194b58c0354ec" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:55.841471 28563 raft_consensus.cc:385] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.841811 28292 raft_consensus.cc:2468] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:55.843075 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c089a99cd334841849bfd25380410fb" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:55.843189 28405 leader_election.cc:304] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.843894 28442 raft_consensus.cc:2468] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:55.841899 28563 raft_consensus.cc:740] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.839655 28621 raft_consensus.cc:515] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.846522 28734 raft_consensus.cc:2804] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.847078 28734 raft_consensus.cc:493] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.847512 28734 raft_consensus.cc:3060] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.849555 28621 leader_election.cc:290] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.853467 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:55.866016 28564 tablet_bootstrap.cc:492] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:55.866601 28564 ts_tablet_manager.cc:1403] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.113s	user 0.051s	sys 0.049s
I20260709 12:12:55.869570 28564 raft_consensus.cc:359] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.870236 28564 raft_consensus.cc:385] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.870517 28564 raft_consensus.cc:740] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.871188 28564 consensus_queue.cc:260] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.854252 28513 raft_consensus.cc:2468] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:55.856520 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.876747 28613 raft_consensus.cc:493] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.877331 28613 raft_consensus.cc:515] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
W20260709 12:12:55.877970 28258 leader_election.cc:343] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.862772 28563 consensus_queue.cc:260] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.883735 28482 leader_election.cc:304] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:55.885041 28611 raft_consensus.cc:2804] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.885452 28611 raft_consensus.cc:493] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.885528 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "850ee7c88fe1482985405700cf63d47a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.885860 28611 raft_consensus.cc:3060] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.888051 28676 consensus_queue.cc:1048] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.893435 28259 leader_election.cc:304] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.895982 28725 raft_consensus.cc:2804] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.896451 28725 raft_consensus.cc:493] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.896824 28725 raft_consensus.cc:3060] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.899602 28723 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.893229 28734 raft_consensus.cc:515] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.900244 28723 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:55.914697 28734 leader_election.cc:290] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.918888 28613 leader_election.cc:290] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:55.921847 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "850ee7c88fe1482985405700cf63d47a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:55.924391 28482 leader_election.cc:304] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:55.925979 28562 tablet_bootstrap.cc:654] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.927022 28621 consensus_queue.cc:1048] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.929531 28613 raft_consensus.cc:493] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.930125 28613 raft_consensus.cc:515] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:55.932646 28613 leader_election.cc:290] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:55.933370 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d549a198d01a4258a83fe8e713a96f94" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:55.933777 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d549a198d01a4258a83fe8e713a96f94" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:55.934119 28292 raft_consensus.cc:2468] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:55.942703 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
W20260709 12:12:55.943041 28481 leader_election.cc:343] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.934545 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f5691a910e47d185a194b58c0354ec" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:55.943512 28442 raft_consensus.cc:2468] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:55.944165 28479 leader_election.cc:304] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.945693 28259 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:55.936789 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f5691a910e47d185a194b58c0354ec" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:55.947018 28290 raft_consensus.cc:3060] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.947427 28621 raft_consensus.cc:2804] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.908063 28720 raft_consensus.cc:493] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.947851 28621 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.948251 28621 raft_consensus.cc:3060] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.948179 28720 raft_consensus.cc:515] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:55.940495 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:55.951645 28407 leader_election.cc:343] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.952646 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81456624ac7a4b579c782075291f8cbf" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:55.954188 28407 leader_election.cc:343] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.954272 28723 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:55.954639 28613 raft_consensus.cc:2804] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.955405 28613 raft_consensus.cc:493] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.955792 28613 raft_consensus.cc:3060] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.957636 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81456624ac7a4b579c782075291f8cbf" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:55.959556 28408 leader_election.cc:343] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.960009 28408 leader_election.cc:304] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.960937 28720 leader_election.cc:290] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:55.961234 28290 raft_consensus.cc:2468] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:55.961843 28720 raft_consensus.cc:2749] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.964982 28723 consensus_queue.cc:1048] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:55.965013 28258 leader_election.cc:343] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.974910 28564 ts_tablet_manager.cc:1434] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.108s	user 0.004s	sys 0.003s
I20260709 12:12:55.966876 28611 raft_consensus.cc:515] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.980890 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c089a99cd334841849bfd25380410fb" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:55.981779 28441 raft_consensus.cc:3060] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.983915 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c089a99cd334841849bfd25380410fb" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
W20260709 12:12:55.985678 28479 leader_election.cc:343] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.985684 28720 raft_consensus.cc:493] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.986495 28720 raft_consensus.cc:515] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:55.989984 28720 leader_election.cc:290] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:55.991357 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2010116c72334e7f8f3a3bf9d7ea06d1" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:55.993189 28408 leader_election.cc:343] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.996467 28405 leader_election.cc:304] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:55.997735 28720 raft_consensus.cc:2804] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.998693 28720 raft_consensus.cc:697] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:55.999583 28720 consensus_queue.cc:237] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.000478 28564 tablet_bootstrap.cc:492] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:55.941910 28725 raft_consensus.cc:515] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:12:56.001298 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:56.001472 28611 leader_election.cc:290] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:56.019057 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2010116c72334e7f8f3a3bf9d7ea06d1" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:56.019309 28621 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.024430 28626 raft_consensus.cc:493] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:56.030911 28405 leader_election.cc:343] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.031633 28405 leader_election.cc:304] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:56.033118 28718 raft_consensus.cc:2749] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.033085 28626 raft_consensus.cc:515] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.033097 28613 raft_consensus.cc:515] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.035827 28626 leader_election.cc:290] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:56.025893 28571 raft_consensus.cc:2749] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:56.036912 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b567deb01fe4f3fb96d69d4943fece9" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.037803 28439 raft_consensus.cc:2393] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 1: Already voted for candidate 1be5ce5bff4b443ea67188eb0de32215 in this term.
I20260709 12:12:56.037918 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d549a198d01a4258a83fe8e713a96f94" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:56.038019 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d549a198d01a4258a83fe8e713a96f94" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:56.038837 28290 raft_consensus.cc:3060] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.039628 28481 leader_election.cc:343] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.040556 28613 leader_election.cc:290] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:56.043393 28725 leader_election.cc:290] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:56.043936 28561 tablet_bootstrap.cc:492] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:56.044461 28561 ts_tablet_manager.cc:1403] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.305s	user 0.026s	sys 0.065s
I20260709 12:12:56.038841 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b567deb01fe4f3fb96d69d4943fece9" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:56.047381 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:56.048182 28334 leader_election.cc:304] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:56.048920 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:56.044215 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:56.051308 28515 raft_consensus.cc:3060] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.055066 28626 raft_consensus.cc:3060] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.055151 28258 leader_election.cc:343] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:56.056372 28258 leader_election.cc:343] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.058372 28611 consensus_queue.cc:1048] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.060075 28563 ts_tablet_manager.cc:1434] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.237s	user 0.007s	sys 0.025s
I20260709 12:12:56.061348 28563 tablet_bootstrap.cc:492] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:56.063843 28561 raft_consensus.cc:359] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.064611 28561 raft_consensus.cc:385] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.064906 28561 raft_consensus.cc:740] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.066071 28562 tablet_bootstrap.cc:492] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:56.065732 28561 consensus_queue.cc:260] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.081598 28441 raft_consensus.cc:2468] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:56.080525 28621 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:56.078788 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:56.070797 28564 tablet_bootstrap.cc:654] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.088269 28563 tablet_bootstrap.cc:654] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.092757 28626 raft_consensus.cc:2749] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.066645 28562 ts_tablet_manager.cc:1403] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.232s	user 0.021s	sys 0.006s
I20260709 12:12:56.093290 28190 catalog_manager.cc:5697] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.098106 28561 ts_tablet_manager.cc:1434] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.004s
I20260709 12:12:56.095870 28482 leader_election.cc:304] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:56.101589 28611 raft_consensus.cc:2804] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.101897 28561 tablet_bootstrap.cc:492] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:56.102255 28611 raft_consensus.cc:697] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:56.085554 28290 raft_consensus.cc:2468] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:56.098294 28365 raft_consensus.cc:3060] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.103273 28611 consensus_queue.cc:237] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.110503 28613 consensus_queue.cc:1048] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.094862 28439 raft_consensus.cc:3060] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.125487 28570 raft_consensus.cc:493] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.126157 28570 raft_consensus.cc:515] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.127713 28479 leader_election.cc:304] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:56.102557 28562 raft_consensus.cc:359] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.129436 28562 raft_consensus.cc:385] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.129712 28562 raft_consensus.cc:740] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.130568 28561 tablet_bootstrap.cc:654] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.130722 28611 raft_consensus.cc:2804] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.131482 28611 raft_consensus.cc:697] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:56.134083 28562 consensus_queue.cc:260] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.136823 28761 consensus_queue.cc:1048] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.137450 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb308f551c2c483eacd2ca20c16ec438" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:56.140787 28191 catalog_manager.cc:5697] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.143479 28564 tablet_bootstrap.cc:492] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:56.132567 28611 consensus_queue.cc:237] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.144044 28564 ts_tablet_manager.cc:1403] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.168s	user 0.012s	sys 0.004s
I20260709 12:12:56.149375 28564 raft_consensus.cc:359] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.150102 28564 raft_consensus.cc:385] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.150393 28564 raft_consensus.cc:740] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.137439 28562 ts_tablet_manager.cc:1434] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:12:56.152908 28562 tablet_bootstrap.cc:492] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:56.156908 28561 tablet_bootstrap.cc:492] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:56.157513 28561 ts_tablet_manager.cc:1403] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.011s
I20260709 12:12:56.158912 28563 tablet_bootstrap.cc:492] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:56.160184 28563 ts_tablet_manager.cc:1403] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.000s
I20260709 12:12:56.160606 28561 raft_consensus.cc:359] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.160324 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb308f551c2c483eacd2ca20c16ec438" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.161439 28561 raft_consensus.cc:385] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.161803 28561 raft_consensus.cc:740] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.159783 28564 consensus_queue.cc:260] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.162930 28334 leader_election.cc:304] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:56.160898 28570 leader_election.cc:290] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:56.088630 28515 raft_consensus.cc:2468] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:56.159281 28562 tablet_bootstrap.cc:654] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.164392 28561 consensus_queue.cc:260] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.164940 28626 raft_consensus.cc:2749] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.169577 28561 ts_tablet_manager.cc:1434] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:12:56.170665 28561 tablet_bootstrap.cc:492] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:56.176816 28561 tablet_bootstrap.cc:654] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.177378 28761 consensus_queue.cc:1048] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.180677 28564 ts_tablet_manager.cc:1434] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.004s
I20260709 12:12:56.171120 28439 raft_consensus.cc:2468] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:56.197384 28564 tablet_bootstrap.cc:492] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:56.179688 28259 leader_election.cc:304] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:56.204733 28259 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:56.206023 28723 raft_consensus.cc:2804] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.205384 28191 catalog_manager.cc:5697] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.206648 28723 raft_consensus.cc:697] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:56.207036 28663 raft_consensus.cc:2804] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.207561 28723 consensus_queue.cc:237] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.210042 28563 raft_consensus.cc:359] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.212414 28563 raft_consensus.cc:385] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.219956 28365 raft_consensus.cc:3060] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.212822 28563 raft_consensus.cc:740] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.237900 28563 consensus_queue.cc:260] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.239883 28563 ts_tablet_manager.cc:1434] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.000s
I20260709 12:12:56.240065 28562 tablet_bootstrap.cc:492] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:56.240567 28562 ts_tablet_manager.cc:1403] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.007s
I20260709 12:12:56.241201 28563 tablet_bootstrap.cc:492] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:56.243431 28562 raft_consensus.cc:359] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.244127 28562 raft_consensus.cc:385] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.244410 28562 raft_consensus.cc:740] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.245157 28562 consensus_queue.cc:260] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.247264 28725 raft_consensus.cc:493] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.247850 28725 raft_consensus.cc:515] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.250249 28725 leader_election.cc:290] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:56.235809 28663 raft_consensus.cc:697] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:56.251999 28562 ts_tablet_manager.cc:1434] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:12:56.257400 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c089a99cd334841849bfd25380410fb" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.258404 28439 raft_consensus.cc:2393] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24654af7758f4a5ebc3e3a8fba0b617a in current term 1: Already voted for candidate 1be5ce5bff4b443ea67188eb0de32215 in this term.
I20260709 12:12:56.260030 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c089a99cd334841849bfd25380410fb" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:56.262542 28259 leader_election.cc:304] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:56.265954 28611 raft_consensus.cc:493] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.266505 28611 raft_consensus.cc:515] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.267606 28564 tablet_bootstrap.cc:654] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.270566 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81456624ac7a4b579c782075291f8cbf" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:56.271257 28367 raft_consensus.cc:2468] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:56.273175 28481 leader_election.cc:304] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:56.274850 28613 raft_consensus.cc:2804] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.264508 28663 consensus_queue.cc:237] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.275228 28613 raft_consensus.cc:493] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.275625 28613 raft_consensus.cc:3060] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.264915 28723 raft_consensus.cc:3060] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.279615 28561 tablet_bootstrap.cc:492] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:56.279970 28563 tablet_bootstrap.cc:654] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.280157 28561 ts_tablet_manager.cc:1403] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.004s
I20260709 12:12:56.282186 28562 tablet_bootstrap.cc:492] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:56.283185 28561 raft_consensus.cc:359] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.283908 28561 raft_consensus.cc:385] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.284157 28561 raft_consensus.cc:740] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.284840 28561 consensus_queue.cc:260] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.285768 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81456624ac7a4b579c782075291f8cbf" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.286626 28439 raft_consensus.cc:2468] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:56.287051 28561 ts_tablet_manager.cc:1434] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:56.288110 28561 tablet_bootstrap.cc:492] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:56.268721 28611 leader_election.cc:290] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:56.295841 28561 tablet_bootstrap.cc:654] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.295444 28613 raft_consensus.cc:515] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.298949 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81456624ac7a4b579c782075291f8cbf" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:56.299585 28367 raft_consensus.cc:3060] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.312372 28561 tablet_bootstrap.cc:492] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:56.313012 28561 ts_tablet_manager.cc:1403] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.007s
I20260709 12:12:56.315814 28367 raft_consensus.cc:2468] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:56.315860 28561 raft_consensus.cc:359] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.323987 28561 raft_consensus.cc:385] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.319427 28723 raft_consensus.cc:2749] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.322568 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81456624ac7a4b579c782075291f8cbf" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:56.324954 28561 raft_consensus.cc:740] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.325222 28439 raft_consensus.cc:3060] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.325958 28563 tablet_bootstrap.cc:492] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:56.326567 28563 ts_tablet_manager.cc:1403] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.004s
I20260709 12:12:56.325946 28561 consensus_queue.cc:260] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.324247 28481 leader_election.cc:304] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:56.328781 28561 ts_tablet_manager.cc:1434] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:56.329021 28611 raft_consensus.cc:2804] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.329548 28562 tablet_bootstrap.cc:654] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.329783 28611 raft_consensus.cc:697] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:56.329442 28563 raft_consensus.cc:359] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.330312 28561 tablet_bootstrap.cc:492] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:56.330359 28563 raft_consensus.cc:385] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.332621 28563 raft_consensus.cc:740] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.332965 28611 consensus_queue.cc:237] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.334046 28191 catalog_manager.cc:5697] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.336885 28561 tablet_bootstrap.cc:654] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.317504 28564 tablet_bootstrap.cc:492] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:56.336158 28191 catalog_manager.cc:5697] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.337472 28564 ts_tablet_manager.cc:1403] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.140s	user 0.012s	sys 0.003s
I20260709 12:12:56.340431 28564 raft_consensus.cc:359] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.341104 28564 raft_consensus.cc:385] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.324452 28613 leader_election.cc:290] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:56.341368 28564 raft_consensus.cc:740] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.342381 28564 consensus_queue.cc:260] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.343562 28439 raft_consensus.cc:2468] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:56.344736 28564 ts_tablet_manager.cc:1434] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:12:56.344895 28562 tablet_bootstrap.cc:492] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:56.345409 28562 ts_tablet_manager.cc:1403] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.008s
I20260709 12:12:56.345849 28564 tablet_bootstrap.cc:492] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:56.347164 28723 raft_consensus.cc:493] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.347800 28723 raft_consensus.cc:515] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.348140 28562 raft_consensus.cc:359] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.348869 28562 raft_consensus.cc:385] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.349157 28562 raft_consensus.cc:740] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.350085 28562 consensus_queue.cc:260] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.351841 28723 leader_election.cc:290] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:56.352197 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:56.352427 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:56.354066 28258 leader_election.cc:343] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.353946 28563 consensus_queue.cc:260] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.356302 28563 ts_tablet_manager.cc:1434] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:12:56.357327 28563 tablet_bootstrap.cc:492] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
W20260709 12:12:56.357578 28259 leader_election.cc:343] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.358119 28259 leader_election.cc:304] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:56.359073 28564 tablet_bootstrap.cc:654] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.359711 28562 ts_tablet_manager.cc:1434] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:12:56.360347 28723 raft_consensus.cc:2749] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.365851 28561 tablet_bootstrap.cc:492] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:56.366768 28561 ts_tablet_manager.cc:1403] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.001s
I20260709 12:12:56.370081 28562 tablet_bootstrap.cc:492] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:56.369820 28561 raft_consensus.cc:359] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.370589 28561 raft_consensus.cc:385] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.370898 28561 raft_consensus.cc:740] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.371615 28561 consensus_queue.cc:260] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.374903 28561 ts_tablet_manager.cc:1434] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:56.375849 28562 tablet_bootstrap.cc:654] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.376678 28564 tablet_bootstrap.cc:492] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:56.376801 28561 tablet_bootstrap.cc:492] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:56.377188 28564 ts_tablet_manager.cc:1403] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:12:56.379814 28676 raft_consensus.cc:493] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.380307 28676 raft_consensus.cc:515] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.380434 28564 raft_consensus.cc:359] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.381373 28564 raft_consensus.cc:385] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.381759 28564 raft_consensus.cc:740] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.382597 28564 consensus_queue.cc:260] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.383620 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d8ee4c616f484ca8ad342b1c3e38f7" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:56.384305 28290 raft_consensus.cc:2468] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:56.385543 28405 leader_election.cc:304] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:56.386934 28676 leader_election.cc:290] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:56.387483 28676 raft_consensus.cc:2804] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.387795 28676 raft_consensus.cc:493] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.385149 28561 tablet_bootstrap.cc:654] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.388716 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d8ee4c616f484ca8ad342b1c3e38f7" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:56.390312 28407 leader_election.cc:343] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.388131 28676 raft_consensus.cc:3060] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.392553 28564 ts_tablet_manager.cc:1434] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:56.393723 28564 tablet_bootstrap.cc:492] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:56.399869 28676 raft_consensus.cc:515] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.400498 28611 raft_consensus.cc:493] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.401052 28611 raft_consensus.cc:515] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.402905 28290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d8ee4c616f484ca8ad342b1c3e38f7" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:56.403206 28611 leader_election.cc:290] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:56.403571 28290 raft_consensus.cc:3060] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.407177 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2010116c72334e7f8f3a3bf9d7ea06d1" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.407927 28439 raft_consensus.cc:2468] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:56.409436 28564 tablet_bootstrap.cc:654] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.409578 28482 leader_election.cc:304] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:56.412285 28611 raft_consensus.cc:2804] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.412950 28611 raft_consensus.cc:493] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.413484 28611 raft_consensus.cc:3060] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.412966 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2010116c72334e7f8f3a3bf9d7ea06d1" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:56.415232 28292 raft_consensus.cc:2468] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:56.426393 28564 tablet_bootstrap.cc:492] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:56.427606 28561 tablet_bootstrap.cc:492] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:56.429030 28561 ts_tablet_manager.cc:1403] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.011s
I20260709 12:12:56.429437 28564 ts_tablet_manager.cc:1403] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.003s
I20260709 12:12:56.430861 28570 raft_consensus.cc:493] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.431414 28570 raft_consensus.cc:515] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.432425 28564 raft_consensus.cc:359] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.433130 28564 raft_consensus.cc:385] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.433396 28564 raft_consensus.cc:740] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.433534 28570 leader_election.cc:290] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:56.433971 28561 raft_consensus.cc:359] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.435986 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f5691a910e47d185a194b58c0354ec" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.436178 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f5691a910e47d185a194b58c0354ec" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:56.436098 28561 raft_consensus.cc:385] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.437057 28292 raft_consensus.cc:2393] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 1: Already voted for candidate f4ce5f603caa48ababe023df3a36c0b4 in this term.
I20260709 12:12:56.436952 28561 raft_consensus.cc:740] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.434186 28564 consensus_queue.cc:260] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.438239 28331 leader_election.cc:304] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:56.435061 28611 raft_consensus.cc:515] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.439807 28570 raft_consensus.cc:3060] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.442147 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2010116c72334e7f8f3a3bf9d7ea06d1" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:56.443068 28439 raft_consensus.cc:3060] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.448246 28570 raft_consensus.cc:2749] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.454213 28564 ts_tablet_manager.cc:1434] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:12:56.454993 28720 consensus_queue.cc:1048] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.456512 28290 raft_consensus.cc:2468] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:56.457842 28405 leader_election.cc:304] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:56.458998 28734 raft_consensus.cc:2804] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.459538 28734 raft_consensus.cc:697] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:56.460659 28734 consensus_queue.cc:237] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.462163 28563 tablet_bootstrap.cc:654] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.467501 28611 leader_election.cc:290] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:56.438156 28561 consensus_queue.cc:260] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.471798 28564 tablet_bootstrap.cc:492] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:56.479386 28291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2010116c72334e7f8f3a3bf9d7ea06d1" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:56.503980 28291 raft_consensus.cc:3060] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.504722 28439 raft_consensus.cc:2468] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:56.481175 28189 catalog_manager.cc:5697] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.482856 28676 leader_election.cc:290] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:56.483959 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d8ee4c616f484ca8ad342b1c3e38f7" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:56.515244 28718 consensus_queue.cc:1048] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.486364 28562 tablet_bootstrap.cc:492] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
W20260709 12:12:56.517814 28407 leader_election.cc:343] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.521518 28562 ts_tablet_manager.cc:1403] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.152s	user 0.040s	sys 0.041s
I20260709 12:12:56.525425 28562 raft_consensus.cc:359] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.531862 28562 raft_consensus.cc:385] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.532158 28562 raft_consensus.cc:740] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.547639 28190 catalog_manager.cc:5697] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.550649 28561 ts_tablet_manager.cc:1434] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.121s	user 0.010s	sys 0.000s
I20260709 12:12:56.552156 28561 tablet_bootstrap.cc:492] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:56.561070 28564 tablet_bootstrap.cc:654] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.566773 28562 consensus_queue.cc:260] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.569506 28562 ts_tablet_manager.cc:1434] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.005s
I20260709 12:12:56.570875 28663 raft_consensus.cc:493] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.571584 28663 raft_consensus.cc:515] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.584535 28663 leader_election.cc:290] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:56.593044 28562 tablet_bootstrap.cc:492] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:56.595532 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e80e45a85c4f95a89fbcd97a133177" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:56.583494 28408 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:33813, user_credentials={real_user=slave}} blocked reactor thread for 93311.7us
I20260709 12:12:56.597564 28482 leader_election.cc:304] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:56.591450 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e80e45a85c4f95a89fbcd97a133177" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.598517 28571 raft_consensus.cc:2804] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.599038 28571 raft_consensus.cc:697] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:56.599888 28571 consensus_queue.cc:237] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
W20260709 12:12:56.597553 28258 leader_election.cc:343] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:56.603323 28259 leader_election.cc:343] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.605526 28259 leader_election.cc:304] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:56.606313 28562 tablet_bootstrap.cc:654] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.608297 28613 consensus_queue.cc:1048] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.609755 28613 consensus_queue.cc:1048] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.610160 28663 raft_consensus.cc:2749] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.611701 28570 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.612226 28570 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.614815 28570 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:56.615617 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:56.615993 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.616916 28439 raft_consensus.cc:2393] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 1: Already voted for candidate 24654af7758f4a5ebc3e3a8fba0b617a in this term.
I20260709 12:12:56.618253 28334 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:56.619479 28570 raft_consensus.cc:3060] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.619831 28561 tablet_bootstrap.cc:654] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.620056 28291 raft_consensus.cc:2468] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:56.625026 28563 tablet_bootstrap.cc:492] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:56.625620 28563 ts_tablet_manager.cc:1403] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.269s	user 0.033s	sys 0.037s
I20260709 12:12:56.633634 28563 raft_consensus.cc:359] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.634402 28563 raft_consensus.cc:385] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.634805 28563 raft_consensus.cc:740] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.647090 28720 raft_consensus.cc:493] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.647682 28720 raft_consensus.cc:515] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.648470 28190 catalog_manager.cc:5697] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.649842 28720 leader_election.cc:290] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:56.651917 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f905442aa27c4a6390b8baca69e6b031" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:56.653992 28408 leader_election.cc:343] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.625018 28564 tablet_bootstrap.cc:492] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:56.655879 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f905442aa27c4a6390b8baca69e6b031" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:56.656611 28564 ts_tablet_manager.cc:1403] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.185s	user 0.025s	sys 0.020s
W20260709 12:12:56.658254 28407 leader_election.cc:343] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.659039 28407 leader_election.cc:304] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:56.661196 28720 raft_consensus.cc:2749] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.664608 28563 consensus_queue.cc:260] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.667766 28563 ts_tablet_manager.cc:1434] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:12:56.668262 28562 tablet_bootstrap.cc:492] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:56.668845 28562 ts_tablet_manager.cc:1403] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.000s
I20260709 12:12:56.669026 28563 tablet_bootstrap.cc:492] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:56.673172 28796 raft_consensus.cc:493] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.673700 28796 raft_consensus.cc:515] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.676783 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:56.677094 28796 leader_election.cc:290] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
W20260709 12:12:56.678812 28408 leader_election.cc:343] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.679972 28564 raft_consensus.cc:359] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.680361 28723 raft_consensus.cc:493] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.680877 28723 raft_consensus.cc:515] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.684847 28723 leader_election.cc:290] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:56.685703 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.686474 28442 raft_consensus.cc:2468] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:56.687605 28259 leader_election.cc:304] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:56.688225 28291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:56.688489 28663 raft_consensus.cc:2804] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.689308 28663 raft_consensus.cc:493] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.689680 28663 raft_consensus.cc:3060] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.690136 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:56.691828 28259 leader_election.cc:343] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.693195 28562 raft_consensus.cc:359] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.695106 28562 raft_consensus.cc:385] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.695436 28562 raft_consensus.cc:740] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.697536 28562 consensus_queue.cc:260] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.699234 28561 tablet_bootstrap.cc:492] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:56.699935 28561 ts_tablet_manager.cc:1403] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.148s	user 0.033s	sys 0.030s
I20260709 12:12:56.704056 28570 raft_consensus.cc:2749] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.708735 28562 ts_tablet_manager.cc:1434] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.040s	user 0.002s	sys 0.005s
I20260709 12:12:56.709693 28563 tablet_bootstrap.cc:654] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.709975 28562 tablet_bootstrap.cc:492] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:56.711377 28561 raft_consensus.cc:359] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.712141 28561 raft_consensus.cc:385] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.712420 28561 raft_consensus.cc:740] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.713075 28561 consensus_queue.cc:260] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.713603 28777 consensus_queue.cc:1048] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.713591 28564 raft_consensus.cc:385] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.715199 28561 ts_tablet_manager.cc:1434] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:56.715445 28564 raft_consensus.cc:740] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.716358 28561 tablet_bootstrap.cc:492] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:56.716270 28564 consensus_queue.cc:260] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.717267 28367 raft_consensus.cc:3060] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.718087 28562 tablet_bootstrap.cc:654] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.718328 28663 raft_consensus.cc:515] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.719619 28291 raft_consensus.cc:2393] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ce5f603caa48ababe023df3a36c0b4 in current term 1: Already voted for candidate 24654af7758f4a5ebc3e3a8fba0b617a in this term.
I20260709 12:12:56.721490 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:56.722128 28442 raft_consensus.cc:3060] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.722616 28405 leader_election.cc:304] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:56.730633 28561 tablet_bootstrap.cc:654] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.733984 28562 tablet_bootstrap.cc:492] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:56.734615 28562 ts_tablet_manager.cc:1403] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 12:12:56.737421 28562 raft_consensus.cc:359] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.739849 28564 ts_tablet_manager.cc:1434] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.001s
I20260709 12:12:56.740276 28571 consensus_queue.cc:1048] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.738310 28562 raft_consensus.cc:385] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.740947 28561 tablet_bootstrap.cc:492] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:56.741092 28562 raft_consensus.cc:740] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.741549 28561 ts_tablet_manager.cc:1403] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.026s	user 0.002s	sys 0.008s
I20260709 12:12:56.742286 28562 consensus_queue.cc:260] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.744029 28564 tablet_bootstrap.cc:492] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:56.745060 28562 ts_tablet_manager.cc:1434] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:56.750027 28562 tablet_bootstrap.cc:492] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:56.749768 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:56.751390 28561 raft_consensus.cc:359] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
W20260709 12:12:56.751782 28259 leader_election.cc:343] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.748628 28442 raft_consensus.cc:2468] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:56.752803 28720 raft_consensus.cc:2749] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.753193 28259 leader_election.cc:304] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:56.754206 28725 raft_consensus.cc:2804] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.754539 28663 leader_election.cc:290] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:56.754871 28725 raft_consensus.cc:697] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:56.755798 28725 consensus_queue.cc:237] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.756516 28561 raft_consensus.cc:385] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.756877 28561 raft_consensus.cc:740] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.757587 28561 consensus_queue.cc:260] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.759828 28561 ts_tablet_manager.cc:1434] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:12:56.761040 28561 tablet_bootstrap.cc:492] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:56.761792 28720 raft_consensus.cc:493] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.762634 28564 tablet_bootstrap.cc:654] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.762399 28720 raft_consensus.cc:515] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.767520 28720 leader_election.cc:290] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:56.763140 28570 raft_consensus.cc:493] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.768486 28570 raft_consensus.cc:515] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.771886 28570 leader_election.cc:290] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:56.765012 28562 tablet_bootstrap.cc:654] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.777913 28561 tablet_bootstrap.cc:654] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.780731 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f905442aa27c4a6390b8baca69e6b031" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:56.782655 28334 leader_election.cc:343] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.793751 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d7c46e81fa49a29180a4eb5a184bdf" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:56.795723 28407 leader_election.cc:343] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.797303 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f905442aa27c4a6390b8baca69e6b031" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:56.798283 28439 raft_consensus.cc:2468] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:56.800856 28562 tablet_bootstrap.cc:492] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:56.802541 28334 leader_election.cc:304] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:56.804210 28570 raft_consensus.cc:2804] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.804714 28570 raft_consensus.cc:493] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.804941 28564 tablet_bootstrap.cc:492] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:56.805161 28570 raft_consensus.cc:3060] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.805672 28564 ts_tablet_manager.cc:1403] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.006s
I20260709 12:12:56.809209 28564 raft_consensus.cc:359] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.811056 28564 raft_consensus.cc:385] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.810551 28562 ts_tablet_manager.cc:1403] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.001s
I20260709 12:12:56.815809 28562 raft_consensus.cc:359] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.817260 28562 raft_consensus.cc:385] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.817768 28562 raft_consensus.cc:740] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.811533 28564 raft_consensus.cc:740] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.819618 28564 consensus_queue.cc:260] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:56.823148 28562 consensus_queue.cc:260] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.824894 28564 ts_tablet_manager.cc:1434] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:12:56.826844 28564 tablet_bootstrap.cc:492] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:56.828662 28720 raft_consensus.cc:493] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.829406 28720 raft_consensus.cc:515] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.828554 28562 ts_tablet_manager.cc:1434] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:12:56.831560 28562 tablet_bootstrap.cc:492] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:56.833029 28291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e80e45a85c4f95a89fbcd97a133177" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:56.839365 28291 raft_consensus.cc:2468] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:56.840881 28405 leader_election.cc:304] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:56.841894 28795 raft_consensus.cc:2804] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.842308 28795 raft_consensus.cc:493] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.842705 28795 raft_consensus.cc:3060] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.846298 28562 tablet_bootstrap.cc:654] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.835024 28720 leader_election.cc:290] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:56.835242 28663 consensus_queue.cc:1048] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.835779 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e80e45a85c4f95a89fbcd97a133177" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:56.838529 28564 tablet_bootstrap.cc:654] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:56.851109 28407 leader_election.cc:343] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.864948 28564 tablet_bootstrap.cc:492] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:56.865486 28564 ts_tablet_manager.cc:1403] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.002s
I20260709 12:12:56.862354 28570 raft_consensus.cc:515] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.867890 28626 raft_consensus.cc:493] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.908413 28815 consensus_queue.cc:1048] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.908717 28626 raft_consensus.cc:515] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:56.919561 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:56.920555 28626 leader_election.cc:290] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:56.857592 28795 raft_consensus.cc:515] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.870288 28663 consensus_queue.cc:1048] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.887991 28723 consensus_queue.cc:1048] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.872131 28564 raft_consensus.cc:359] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.894644 28562 tablet_bootstrap.cc:492] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:56.926846 28564 raft_consensus.cc:385] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.927119 28562 ts_tablet_manager.cc:1403] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.010s
I20260709 12:12:56.927287 28564 raft_consensus.cc:740] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.928270 28564 consensus_queue.cc:260] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:56.930222 28562 raft_consensus.cc:359] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.931005 28562 raft_consensus.cc:385] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.931288 28562 raft_consensus.cc:740] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.933915 28562 consensus_queue.cc:260] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:56.934804 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e80e45a85c4f95a89fbcd97a133177" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
W20260709 12:12:56.936853 28407 leader_election.cc:343] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.938271 28562 ts_tablet_manager.cc:1434] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:12:56.938575 28291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e80e45a85c4f95a89fbcd97a133177" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:56.934131 28795 leader_election.cc:290] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:56.939414 28562 tablet_bootstrap.cc:492] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
W20260709 12:12:56.903860 28479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 177177us
I20260709 12:12:56.939432 28291 raft_consensus.cc:3060] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.958292 28562 tablet_bootstrap.cc:654] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.967095 28564 ts_tablet_manager.cc:1434] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.000s
I20260709 12:12:56.971228 28564 tablet_bootstrap.cc:492] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:57.012127 28561 tablet_bootstrap.cc:492] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:57.012696 28561 ts_tablet_manager.cc:1403] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.252s	user 0.052s	sys 0.043s
I20260709 12:12:57.014513 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f905442aa27c4a6390b8baca69e6b031" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:57.015209 28442 raft_consensus.cc:3060] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.016655 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d7c46e81fa49a29180a4eb5a184bdf" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:57.012554 28570 leader_election.cc:290] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:56.992798 28611 raft_consensus.cc:493] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.033872 28676 raft_consensus.cc:493] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.037561 28676 raft_consensus.cc:515] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.040431 28676 leader_election.cc:290] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:57.040884 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f905442aa27c4a6390b8baca69e6b031" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:57.035539 28611 raft_consensus.cc:515] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:12:57.046907 28334 leader_election.cc:343] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.047374 28368 raft_consensus.cc:3060] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.047659 28734 consensus_queue.cc:1048] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:57.049537 28364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecabc7c175741e28392767184e77da1" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:57.047519 28366 raft_consensus.cc:3060] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.053540 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecabc7c175741e28392767184e77da1" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:57.058341 28611 leader_election.cc:290] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
W20260709 12:12:57.052147 28407 leader_election.cc:343] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.054320 28408 leader_election.cc:343] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.068246 28561 raft_consensus.cc:359] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.071507 28561 raft_consensus.cc:385] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.072156 28408 leader_election.cc:304] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:57.073843 28561 raft_consensus.cc:740] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.078399 28676 raft_consensus.cc:2749] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:57.082348 28408 leader_election.cc:343] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.082918 28795 consensus_queue.cc:1048] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:57.086262 28291 raft_consensus.cc:2468] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:57.088757 28562 tablet_bootstrap.cc:492] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:57.089772 28562 ts_tablet_manager.cc:1403] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.150s	user 0.033s	sys 0.006s
I20260709 12:12:57.092100 28570 raft_consensus.cc:493] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.093266 28570 raft_consensus.cc:515] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.094118 28405 leader_election.cc:304] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:57.094539 28564 tablet_bootstrap.cc:654] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.096233 28795 raft_consensus.cc:2804] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.096762 28795 raft_consensus.cc:697] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:57.097589 28795 consensus_queue.cc:237] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.115274 28561 consensus_queue.cc:260] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.118073 28562 raft_consensus.cc:359] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.119391 28562 raft_consensus.cc:385] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.119846 28562 raft_consensus.cc:740] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.114313 28364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:57.122296 28562 consensus_queue.cc:260] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.116747 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d549a198d01a4258a83fe8e713a96f94" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:57.124274 28562 ts_tablet_manager.cc:1434] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:12:57.115151 28626 raft_consensus.cc:493] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.082975 28408 leader_election.cc:304] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:57.139504 28562 tablet_bootstrap.cc:492] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:57.141554 28561 ts_tablet_manager.cc:1434] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.001s
I20260709 12:12:57.132369 28364 raft_consensus.cc:2468] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:57.140583 28570 leader_election.cc:290] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:57.151221 28777 raft_consensus.cc:493] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:57.158852 28408 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:33813, user_credentials={real_user=slave}} blocked reactor thread for 76523.5us
I20260709 12:12:57.161315 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:57.162446 28442 raft_consensus.cc:2468] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:57.165237 28288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:57.166834 28334 leader_election.cc:304] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:57.151875 28777 raft_consensus.cc:515] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.136585 28626 raft_consensus.cc:515] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.178779 28561 tablet_bootstrap.cc:492] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:57.169191 28720 raft_consensus.cc:2749] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.183300 28723 raft_consensus.cc:493] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.192983 28804 raft_consensus.cc:2804] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.192391 28720 raft_consensus.cc:493] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.179690 28288 raft_consensus.cc:2468] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:57.197983 28815 consensus_queue.cc:1048] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:12:57.205765 28481 leader_election.cc:304] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:57.198277 28723 raft_consensus.cc:515] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.206735 28777 leader_election.cc:290] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:57.206730 28626 leader_election.cc:290] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:57.208998 28723 leader_election.cc:290] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:57.209439 28815 raft_consensus.cc:2804] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.209918 28815 raft_consensus.cc:493] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.209862 28809 consensus_queue.cc:1048] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:12:57.210614 28815 raft_consensus.cc:3060] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.212206 28814 consensus_queue.cc:1048] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:57.189203 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d549a198d01a4258a83fe8e713a96f94" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:57.215384 28285 raft_consensus.cc:2468] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:57.224779 28613 consensus_queue.cc:1048] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:57.203099 28804 raft_consensus.cc:697] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:12:57.227571 28804 consensus_queue.cc:237] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.195384 28331 leader_election.cc:304] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:57.233990 28626 raft_consensus.cc:2749] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:57.256824 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a02f7b3bf4f248ce40cb391061654" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:57.250573 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:57.260479 28259 leader_election.cc:343] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.261051 28561 tablet_bootstrap.cc:654] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.262344 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d7c46e81fa49a29180a4eb5a184bdf" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:57.263031 28441 raft_consensus.cc:2468] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:57.263559 28439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a02f7b3bf4f248ce40cb391061654" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:57.203117 28720 raft_consensus.cc:515] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.266393 28720 leader_election.cc:290] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:57.268028 28334 leader_election.cc:304] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:57.269572 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d7c46e81fa49a29180a4eb5a184bdf" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:57.275602 28258 leader_election.cc:343] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.276252 28570 raft_consensus.cc:2804] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.276721 28570 raft_consensus.cc:493] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.277076 28570 raft_consensus.cc:3060] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.277493 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:57.279696 28334 leader_election.cc:343] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.286547 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd7b4ba0d53419e909c0c82013ee595" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:57.288066 28815 raft_consensus.cc:515] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.289959 28331 leader_election.cc:304] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:57.299340 28564 tablet_bootstrap.cc:492] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:57.300071 28564 ts_tablet_manager.cc:1403] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.329s	user 0.012s	sys 0.021s
W20260709 12:12:57.309247 28563 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.048s	sys 0.110s
W20260709 12:12:57.309828 28563 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.048s	sys 0.110s
I20260709 12:12:57.311913 28626 raft_consensus.cc:2804] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:57.312419 28408 leader_election.cc:343] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.314905 28259 leader_election.cc:343] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.315440 28259 leader_election.cc:304] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:57.316584 28723 raft_consensus.cc:2749] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.317234 28188 catalog_manager.cc:5697] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.327171 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd7b4ba0d53419e909c0c82013ee595" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:57.331797 28285 raft_consensus.cc:2468] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
W20260709 12:12:57.337759 28258 leader_election.cc:343] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.339171 28405 leader_election.cc:304] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:57.340480 28720 raft_consensus.cc:2804] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.339802 28564 raft_consensus.cc:359] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.341101 28720 raft_consensus.cc:493] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.338310 28258 leader_election.cc:304] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:57.341742 28720 raft_consensus.cc:3060] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.343217 28563 tablet_bootstrap.cc:492] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:57.343798 28563 ts_tablet_manager.cc:1403] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.675s	user 0.060s	sys 0.110s
W20260709 12:12:57.347558 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:57.348695 28626 raft_consensus.cc:493] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1be5ce5bff4b443ea67188eb0de32215)
I20260709 12:12:57.349483 28626 raft_consensus.cc:3060] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.351837 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:57.352569 28285 raft_consensus.cc:3060] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.365378 28190 catalog_manager.cc:5697] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.354821 28822 raft_consensus.cc:2749] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.371379 28563 raft_consensus.cc:359] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.373194 28563 raft_consensus.cc:385] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.341218 28564 raft_consensus.cc:385] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.373972 28564 raft_consensus.cc:740] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.373610 28563 raft_consensus.cc:740] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.376129 28564 consensus_queue.cc:260] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.348234 28815 leader_election.cc:290] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:57.380604 28563 consensus_queue.cc:260] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.386276 28285 raft_consensus.cc:2468] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:57.390940 28723 consensus_queue.cc:1048] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:57.393062 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:57.393715 28562 tablet_bootstrap.cc:654] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.396301 28191 catalog_manager.cc:5697] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.408859 28563 ts_tablet_manager.cc:1434] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:12:57.421200 28479 leader_election.cc:304] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:12:57.422256 28815 raft_consensus.cc:2804] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.422881 28815 raft_consensus.cc:697] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:57.423887 28561 tablet_bootstrap.cc:492] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:57.423813 28815 consensus_queue.cc:237] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.424445 28561 ts_tablet_manager.cc:1403] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.255s	user 0.018s	sys 0.023s
I20260709 12:12:57.370885 28570 raft_consensus.cc:515] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.427811 28570 leader_election.cc:290] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:57.427467 28561 raft_consensus.cc:359] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.429448 28561 raft_consensus.cc:385] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.429744 28561 raft_consensus.cc:740] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.404184 28366 raft_consensus.cc:3060] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.430435 28561 consensus_queue.cc:260] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.431602 28563 tablet_bootstrap.cc:492] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:57.433395 28561 ts_tablet_manager.cc:1434] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:57.447216 28564 ts_tablet_manager.cc:1434] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.146s	user 0.006s	sys 0.004s
I20260709 12:12:57.448979 28564 tablet_bootstrap.cc:492] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:57.454034 28561 tablet_bootstrap.cc:492] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
W20260709 12:12:57.456404 28259 consensus_peers.cc:597] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:57.459869 28626 raft_consensus.cc:515] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.461241 28368 raft_consensus.cc:1240] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Rejecting Update request from peer 1be5ce5bff4b443ea67188eb0de32215 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:57.463330 28563 tablet_bootstrap.cc:654] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:57.398929 28334 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 73027.8us
I20260709 12:12:57.470013 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d7c46e81fa49a29180a4eb5a184bdf" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:57.471141 28440 raft_consensus.cc:3060] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.469937 28561 tablet_bootstrap.cc:654] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.475296 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d7c46e81fa49a29180a4eb5a184bdf" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:57.476071 28720 raft_consensus.cc:515] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.487830 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd7b4ba0d53419e909c0c82013ee595" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:57.488479 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd7b4ba0d53419e909c0c82013ee595" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:57.489708 28562 tablet_bootstrap.cc:492] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:57.490439 28562 ts_tablet_manager.cc:1403] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.351s	user 0.028s	sys 0.001s
W20260709 12:12:57.495842 28408 leader_election.cc:343] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.489130 28285 raft_consensus.cc:3060] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.487840 28720 leader_election.cc:290] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:57.512626 28626 leader_election.cc:290] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:57.510326 28440 raft_consensus.cc:2468] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:57.517813 28611 consensus_queue.cc:1059] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:57.525849 28611 raft_consensus.cc:3055] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:57.526221 28611 raft_consensus.cc:740] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:57.527029 28611 consensus_queue.cc:260] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.531852 28611 raft_consensus.cc:3060] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.535777 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d549a198d01a4258a83fe8e713a96f94" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:57.552527 28288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d549a198d01a4258a83fe8e713a96f94" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:57.559197 28562 raft_consensus.cc:359] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.560040 28562 raft_consensus.cc:385] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.560316 28562 raft_consensus.cc:740] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.560978 28562 consensus_queue.cc:260] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
W20260709 12:12:57.541081 28334 leader_election.cc:343] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.570806 28562 ts_tablet_manager.cc:1434] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 12:12:57.571826 28562 tablet_bootstrap.cc:492] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:57.543756 28285 raft_consensus.cc:2468] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:57.574082 28334 leader_election.cc:304] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:57.574968 28626 raft_consensus.cc:2804] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.575434 28626 raft_consensus.cc:697] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:12:57.575352 28839 raft_consensus.cc:493] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.576382 28626 consensus_queue.cc:237] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.576305 28839 raft_consensus.cc:515] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.579195 28405 leader_election.cc:304] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:57.580096 28720 raft_consensus.cc:2804] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.580790 28720 raft_consensus.cc:697] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:57.534391 28366 raft_consensus.cc:2468] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:57.585677 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e80e45a85c4f95a89fbcd97a133177" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:57.581555 28839 leader_election.cc:290] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:57.588333 28564 tablet_bootstrap.cc:654] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.590258 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e80e45a85c4f95a89fbcd97a133177" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:57.591132 28285 raft_consensus.cc:2393] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 1: Already voted for candidate f4ce5f603caa48ababe023df3a36c0b4 in this term.
I20260709 12:12:57.599586 28331 leader_election.cc:304] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:57.581682 28720 consensus_queue.cc:237] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.609400 28839 raft_consensus.cc:3060] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.623152 28571 raft_consensus.cc:493] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.623339 28561 tablet_bootstrap.cc:492] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:57.623996 28561 ts_tablet_manager.cc:1403] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.170s	user 0.018s	sys 0.006s
I20260709 12:12:57.623773 28571 raft_consensus.cc:515] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.625998 28571 leader_election.cc:290] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:57.627161 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f905442aa27c4a6390b8baca69e6b031" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:57.627401 28561 raft_consensus.cc:359] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.628010 28831 consensus_queue.cc:1048] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:12:57.629637 28564 tablet_bootstrap.cc:492] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:57.628067 28442 raft_consensus.cc:2393] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:12:57.630132 28564 ts_tablet_manager.cc:1403] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.182s	user 0.011s	sys 0.008s
I20260709 12:12:57.629662 28563 tablet_bootstrap.cc:492] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:57.631623 28563 ts_tablet_manager.cc:1403] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.200s	user 0.028s	sys 0.039s
I20260709 12:12:57.632128 28839 raft_consensus.cc:2749] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.632932 28564 raft_consensus.cc:359] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.633690 28564 raft_consensus.cc:385] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.633968 28564 raft_consensus.cc:740] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.628120 28561 raft_consensus.cc:385] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.634804 28561 raft_consensus.cc:740] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.635649 28561 consensus_queue.cc:260] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.636804 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f905442aa27c4a6390b8baca69e6b031" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:57.637543 28561 ts_tablet_manager.cc:1434] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:12:57.638235 28481 leader_election.cc:304] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:57.638731 28561 tablet_bootstrap.cc:492] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:57.647928 28563 raft_consensus.cc:359] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.621037 28512 raft_consensus.cc:2468] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 2.
I20260709 12:12:57.650784 28563 raft_consensus.cc:385] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.651113 28563 raft_consensus.cc:740] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.651815 28563 consensus_queue.cc:260] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.646883 28571 raft_consensus.cc:3060] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.653000 28334 leader_election.cc:304] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:57.653966 28563 ts_tablet_manager.cc:1434] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:12:57.654286 28839 raft_consensus.cc:2804] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:57.654815 28839 raft_consensus.cc:697] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:12:57.655161 28563 tablet_bootstrap.cc:492] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:57.655637 28839 consensus_queue.cc:237] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.650314 28562 tablet_bootstrap.cc:654] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.662298 28190 catalog_manager.cc:5697] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.662863 28564 consensus_queue.cc:260] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.666821 28676 raft_consensus.cc:493] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.668371 28676 raft_consensus.cc:515] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.670928 28676 leader_election.cc:290] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:57.677002 28564 ts_tablet_manager.cc:1434] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 12:12:57.680939 28725 raft_consensus.cc:493] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.681509 28725 raft_consensus.cc:515] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.682912 28564 tablet_bootstrap.cc:492] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:57.683629 28725 leader_election.cc:290] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:57.686462 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:57.686265 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:57.689860 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:57.687860 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:57.675486 28571 raft_consensus.cc:2749] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:57.703226 28259 leader_election.cc:343] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.703593 28405 leader_election.cc:343] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.704365 28259 leader_election.cc:343] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.704842 28259 leader_election.cc:304] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4
W20260709 12:12:57.708055 28408 leader_election.cc:343] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.709513 28408 leader_election.cc:304] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:57.707490 28777 raft_consensus.cc:2749] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.712435 28831 consensus_queue.cc:1048] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.715360 28563 tablet_bootstrap.cc:654] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.716825 28188 catalog_manager.cc:5697] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 1 to 2, leader changed from 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68) to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 2 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.719897 28796 raft_consensus.cc:2749] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.719756 28190 catalog_manager.cc:5697] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.721189 28561 tablet_bootstrap.cc:654] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.724390 28562 tablet_bootstrap.cc:492] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:57.728739 28562 ts_tablet_manager.cc:1403] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.157s	user 0.012s	sys 0.024s
I20260709 12:12:57.730967 28564 tablet_bootstrap.cc:654] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.736994 28562 raft_consensus.cc:359] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.737730 28562 raft_consensus.cc:385] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.738010 28562 raft_consensus.cc:740] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.744262 28189 catalog_manager.cc:5697] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.749986 28626 consensus_queue.cc:1048] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.752866 28562 consensus_queue.cc:260] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.755260 28562 ts_tablet_manager.cc:1434] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:12:57.756413 28562 tablet_bootstrap.cc:492] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:57.756597 28563 tablet_bootstrap.cc:492] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:57.757270 28563 ts_tablet_manager.cc:1403] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.002s
I20260709 12:12:57.761133 28563 raft_consensus.cc:359] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.762051 28563 raft_consensus.cc:385] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.762244 28562 tablet_bootstrap.cc:654] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.767742 28561 tablet_bootstrap.cc:492] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:57.773481 28561 ts_tablet_manager.cc:1403] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.135s	user 0.023s	sys 0.007s
I20260709 12:12:57.770568 28564 tablet_bootstrap.cc:492] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:57.774252 28564 ts_tablet_manager.cc:1403] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.003s
I20260709 12:12:57.768359 28563 raft_consensus.cc:740] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.775933 28563 consensus_queue.cc:260] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.777100 28561 raft_consensus.cc:359] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.777853 28561 raft_consensus.cc:385] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.778162 28561 raft_consensus.cc:740] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.779008 28564 raft_consensus.cc:359] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.779166 28561 consensus_queue.cc:260] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.780155 28564 raft_consensus.cc:385] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.780609 28564 raft_consensus.cc:740] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.781589 28564 consensus_queue.cc:260] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.782756 28561 ts_tablet_manager.cc:1434] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:57.784870 28561 tablet_bootstrap.cc:492] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:57.786237 28563 ts_tablet_manager.cc:1434] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:12:57.789661 28563 tablet_bootstrap.cc:492] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:57.794808 28676 raft_consensus.cc:493] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.795411 28676 raft_consensus.cc:515] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.796893 28564 ts_tablet_manager.cc:1434] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:12:57.797978 28564 tablet_bootstrap.cc:492] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:57.798625 28562 tablet_bootstrap.cc:492] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:57.799152 28562 ts_tablet_manager.cc:1403] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.011s
I20260709 12:12:57.802089 28562 raft_consensus.cc:359] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.802791 28562 raft_consensus.cc:385] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.802795 28516 raft_consensus.cc:3060] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.803229 28562 raft_consensus.cc:740] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.804131 28562 consensus_queue.cc:260] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.804435 28676 leader_election.cc:290] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:57.804970 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:57.805698 28562 ts_tablet_manager.cc:1434] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:57.806705 28562 tablet_bootstrap.cc:492] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
W20260709 12:12:57.806813 28408 leader_election.cc:343] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.814148 28562 tablet_bootstrap.cc:654] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.803463 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:57.824906 28626 consensus_queue.cc:1048] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:57.826033 28407 leader_election.cc:343] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.826598 28407 leader_election.cc:304] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:57.828346 28720 raft_consensus.cc:2749] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.843365 28561 tablet_bootstrap.cc:654] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.847733 28777 raft_consensus.cc:493] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.848371 28777 raft_consensus.cc:515] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.850451 28777 leader_election.cc:290] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:57.851970 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b53fc8bee74341af2a3b4395afbb61" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:57.854292 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b53fc8bee74341af2a3b4395afbb61" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:57.854753 28259 leader_election.cc:343] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.856771 28564 tablet_bootstrap.cc:654] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.857997 28563 tablet_bootstrap.cc:654] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:57.858284 28258 leader_election.cc:343] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.858830 28258 leader_election.cc:304] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:57.859957 28777 raft_consensus.cc:2749] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.861833 28611 raft_consensus.cc:493] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.862317 28611 raft_consensus.cc:515] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.864037 28562 tablet_bootstrap.cc:492] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:57.864500 28562 ts_tablet_manager.cc:1403] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.011s
I20260709 12:12:57.865053 28564 tablet_bootstrap.cc:492] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:57.865248 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d7c46e81fa49a29180a4eb5a184bdf" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:57.865531 28564 ts_tablet_manager.cc:1403] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 12:12:57.867163 28562 raft_consensus.cc:359] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.867908 28562 raft_consensus.cc:385] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.868172 28562 raft_consensus.cc:740] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.868168 28564 raft_consensus.cc:359] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.869015 28564 raft_consensus.cc:385] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.869309 28564 raft_consensus.cc:740] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.870152 28564 consensus_queue.cc:260] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.870751 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d7c46e81fa49a29180a4eb5a184bdf" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:57.872068 28441 raft_consensus.cc:2393] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:12:57.872571 28564 ts_tablet_manager.cc:1434] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:57.873245 28482 leader_election.cc:304] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:57.873664 28564 tablet_bootstrap.cc:492] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:57.874176 28815 raft_consensus.cc:3060] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.869107 28562 consensus_queue.cc:260] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:57.880529 28564 tablet_bootstrap.cc:654] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.881553 28562 ts_tablet_manager.cc:1434] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:12:57.882639 28562 tablet_bootstrap.cc:492] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:57.887060 28777 raft_consensus.cc:493] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.887602 28777 raft_consensus.cc:515] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.889727 28777 leader_election.cc:290] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:57.870919 28611 leader_election.cc:290] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:57.890870 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a539209b26a46fa8275b3913fc0371c" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:57.891323 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a539209b26a46fa8275b3913fc0371c" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:57.892355 28259 leader_election.cc:343] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.892877 28258 leader_election.cc:343] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.893332 28258 leader_election.cc:304] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:57.894438 28777 raft_consensus.cc:2749] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.897012 28562 tablet_bootstrap.cc:654] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.898061 28815 raft_consensus.cc:2749] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:57.905869 28865 log.cc:927] Time spent T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:12:57.918800 28561 tablet_bootstrap.cc:492] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:57.919410 28561 ts_tablet_manager.cc:1403] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.135s	user 0.005s	sys 0.008s
I20260709 12:12:57.923441 28561 raft_consensus.cc:359] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.925604 28561 raft_consensus.cc:385] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.927009 28561 raft_consensus.cc:740] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.928635 28561 consensus_queue.cc:260] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.932937 28563 tablet_bootstrap.cc:492] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:57.934996 28563 ts_tablet_manager.cc:1403] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.146s	user 0.023s	sys 0.016s
I20260709 12:12:57.936112 28564 tablet_bootstrap.cc:492] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:57.936925 28564 ts_tablet_manager.cc:1403] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.024s
I20260709 12:12:57.937229 28563 raft_consensus.cc:359] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.937954 28563 raft_consensus.cc:385] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.938249 28563 raft_consensus.cc:740] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.938957 28563 consensus_queue.cc:260] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:57.939949 28564 raft_consensus.cc:359] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.940791 28563 ts_tablet_manager.cc:1434] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:57.941059 28564 raft_consensus.cc:385] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.941416 28564 raft_consensus.cc:740] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.942004 28563 tablet_bootstrap.cc:492] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:57.942258 28564 consensus_queue.cc:260] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:57.947620 28562 tablet_bootstrap.cc:492] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:57.947654 28564 ts_tablet_manager.cc:1434] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:57.948424 28562 ts_tablet_manager.cc:1403] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.015s
I20260709 12:12:57.948663 28563 tablet_bootstrap.cc:654] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.951315 28562 raft_consensus.cc:359] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.952010 28562 raft_consensus.cc:385] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.953842 28561 ts_tablet_manager.cc:1434] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 12:12:57.954378 28564 tablet_bootstrap.cc:492] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:57.955161 28561 tablet_bootstrap.cc:492] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:57.961148 28564 tablet_bootstrap.cc:654] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.968729 28562 raft_consensus.cc:740] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.972942 28562 consensus_queue.cc:260] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:57.973280 28839 consensus_queue.cc:1048] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.975441 28562 ts_tablet_manager.cc:1434] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:12:57.976593 28562 tablet_bootstrap.cc:492] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:57.988845 28561 tablet_bootstrap.cc:654] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.993438 28815 consensus_queue.cc:1048] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:57.995716 28626 raft_consensus.cc:493] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.996495 28626 raft_consensus.cc:515] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.005558 28562 tablet_bootstrap.cc:654] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.008296 28777 raft_consensus.cc:493] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.009047 28777 raft_consensus.cc:515] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.012226 28804 raft_consensus.cc:493] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.012787 28804 raft_consensus.cc:515] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.014848 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:58.015007 28777 leader_election.cc:290] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
W20260709 12:12:58.016427 28259 leader_election.cc:343] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.018782 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:58.019572 28442 raft_consensus.cc:2468] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:58.020946 28259 leader_election.cc:304] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.022562 28725 raft_consensus.cc:2804] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.022941 28626 leader_election.cc:290] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:58.023187 28725 raft_consensus.cc:493] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.023749 28725 raft_consensus.cc:3060] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.024149 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:58.027179 28334 leader_election.cc:343] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.029417 28804 leader_election.cc:290] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:58.032193 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecabc7c175741e28392767184e77da1" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:58.033047 28442 raft_consensus.cc:2468] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:58.035851 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecabc7c175741e28392767184e77da1" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:58.042547 28334 leader_election.cc:304] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
W20260709 12:12:58.043771 28334 leader_election.cc:343] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.044730 28804 raft_consensus.cc:2804] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.045190 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:58.046649 28285 raft_consensus.cc:2468] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:58.048336 28331 leader_election.cc:304] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.050014 28839 raft_consensus.cc:2804] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.050706 28839 raft_consensus.cc:493] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.051148 28839 raft_consensus.cc:3060] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.049358 28725 raft_consensus.cc:515] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.052551 28561 tablet_bootstrap.cc:492] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:58.053061 28561 ts_tablet_manager.cc:1403] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.000s
I20260709 12:12:58.054246 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:58.055318 28442 raft_consensus.cc:3060] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.056031 28561 raft_consensus.cc:359] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.056766 28561 raft_consensus.cc:385] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.057046 28561 raft_consensus.cc:740] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.057786 28561 consensus_queue.cc:260] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.061110 28561 ts_tablet_manager.cc:1434] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:58.063931 28561 tablet_bootstrap.cc:492] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:58.045223 28804 raft_consensus.cc:493] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.068101 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:58.069080 28804 raft_consensus.cc:3060] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.070039 28259 leader_election.cc:343] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.074651 28815 consensus_queue.cc:1048] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:12:58.068876 28725 leader_election.cc:290] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:58.066100 28442 raft_consensus.cc:2468] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:58.093544 28259 leader_election.cc:304] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.094820 28725 raft_consensus.cc:2804] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.081297 28561 tablet_bootstrap.cc:654] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.099064 28723 raft_consensus.cc:493] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.096772 28562 tablet_bootstrap.cc:492] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:58.100056 28562 ts_tablet_manager.cc:1403] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.018s
I20260709 12:12:58.099578 28723 raft_consensus.cc:515] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.075317 28626 consensus_queue.cc:1048] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:12:58.108332 28562 raft_consensus.cc:359] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.109073 28562 raft_consensus.cc:385] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.111052 28723 leader_election.cc:290] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:58.113169 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d763609f275142958e76408fb898f06c" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:58.109380 28562 raft_consensus.cc:740] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.114779 28676 raft_consensus.cc:493] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:58.115129 28258 leader_election.cc:343] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.115330 28676 raft_consensus.cc:515] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.118240 28676 leader_election.cc:290] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:58.120201 28287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a02f7b3bf4f248ce40cb391061654" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:58.121014 28287 raft_consensus.cc:2468] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:58.123456 28562 consensus_queue.cc:260] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.125797 28405 leader_election.cc:304] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:58.127424 28562 ts_tablet_manager.cc:1434] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:12:58.127550 28831 raft_consensus.cc:2804] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.127974 28831 raft_consensus.cc:493] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.128314 28831 raft_consensus.cc:3060] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.128609 28562 tablet_bootstrap.cc:492] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:58.136297 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a02f7b3bf4f248ce40cb391061654" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:58.137070 28831 raft_consensus.cc:515] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
W20260709 12:12:58.137833 28407 leader_election.cc:343] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.140082 28720 consensus_queue.cc:1048] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.140934 28831 leader_election.cc:290] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:58.142715 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a02f7b3bf4f248ce40cb391061654" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
W20260709 12:12:58.144368 28407 leader_election.cc:343] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.147783 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a02f7b3bf4f248ce40cb391061654" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:58.148452 28285 raft_consensus.cc:3060] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.166839 28562 tablet_bootstrap.cc:654] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.176244 28725 raft_consensus.cc:697] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:58.200426 28839 raft_consensus.cc:515] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.209187 28720 raft_consensus.cc:493] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.210050 28720 raft_consensus.cc:515] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.213025 28720 leader_election.cc:290] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:58.219089 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d763609f275142958e76408fb898f06c" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:58.226675 28562 tablet_bootstrap.cc:492] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:58.229661 28514 raft_consensus.cc:3060] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.227638 28562 ts_tablet_manager.cc:1403] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.004s
I20260709 12:12:58.242568 28562 raft_consensus.cc:359] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.243566 28562 raft_consensus.cc:385] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.244065 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a539209b26a46fa8275b3913fc0371c" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:58.245057 28366 raft_consensus.cc:2468] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:58.243950 28562 raft_consensus.cc:740] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.246955 28562 consensus_queue.cc:260] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.245833 28285 raft_consensus.cc:2468] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
W20260709 12:12:58.250813 28259 leader_election.cc:343] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.251487 28259 leader_election.cc:304] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:58.257166 28723 raft_consensus.cc:2749] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.247131 28288 raft_consensus.cc:3060] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:58.257887 28796 raft_consensus.cc:493] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.279460 28796 raft_consensus.cc:515] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.283524 28796 leader_election.cc:290] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:58.294926 28839 leader_election.cc:290] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:58.297000 28563 tablet_bootstrap.cc:492] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:58.297693 28563 ts_tablet_manager.cc:1403] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.356s	user 0.089s	sys 0.102s
I20260709 12:12:58.294495 28564 tablet_bootstrap.cc:492] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:58.300424 28564 ts_tablet_manager.cc:1403] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.346s	user 0.024s	sys 0.013s
I20260709 12:12:58.319214 28562 ts_tablet_manager.cc:1434] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.084s	user 0.010s	sys 0.000s
I20260709 12:12:58.291000 28407 leader_election.cc:304] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:58.324386 28804 raft_consensus.cc:515] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.327881 28561 tablet_bootstrap.cc:492] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:58.328795 28561 ts_tablet_manager.cc:1403] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.267s	user 0.022s	sys 0.054s
W20260709 12:12:58.332074 28407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:42205, user_credentials={real_user=slave}} blocked reactor thread for 43521.8us
I20260709 12:12:58.339514 28563 raft_consensus.cc:359] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.344684 28563 raft_consensus.cc:385] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.294061 28725 consensus_queue.cc:237] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.345158 28563 raft_consensus.cc:740] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.345367 28562 tablet_bootstrap.cc:492] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:58.337909 28796 raft_consensus.cc:2804] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.346643 28563 consensus_queue.cc:260] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:12:58.331835 28479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 102630us
I20260709 12:12:58.344337 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
W20260709 12:12:58.342598 28405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 128469us
I20260709 12:12:58.375530 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecabc7c175741e28392767184e77da1" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:58.376160 28287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a539209b26a46fa8275b3913fc0371c" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:58.377195 28287 raft_consensus.cc:2468] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:58.347617 28804 leader_election.cc:290] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
W20260709 12:12:58.378610 28334 leader_election.cc:343] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.361075 28564 raft_consensus.cc:359] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.380345 28564 raft_consensus.cc:385] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.367117 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ecabc7c175741e28392767184e77da1" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:58.381310 28442 raft_consensus.cc:3060] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.382884 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:58.388157 28408 leader_election.cc:343] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.369678 28512 raft_consensus.cc:1275] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:58.370515 28839 raft_consensus.cc:493] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.391379 28839 raft_consensus.cc:515] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.393642 28804 consensus_queue.cc:1048] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:58.351655 28796 raft_consensus.cc:493] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.397195 28796 raft_consensus.cc:3060] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.400476 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:58.401541 28440 raft_consensus.cc:2468] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:58.380779 28564 raft_consensus.cc:740] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.393959 28839 leader_election.cc:290] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:58.374058 28516 raft_consensus.cc:3060] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.403203 28564 consensus_queue.cc:260] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.405810 28564 ts_tablet_manager.cc:1434] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.002s
I20260709 12:12:58.406826 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:58.407120 28564 tablet_bootstrap.cc:492] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
W20260709 12:12:58.410842 28334 leader_election.cc:343] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.411286 28571 raft_consensus.cc:493] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.412089 28571 raft_consensus.cc:515] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.388150 28287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:58.419890 28287 raft_consensus.cc:2468] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:58.416525 28334 leader_election.cc:304] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.423224 28839 raft_consensus.cc:2804] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.421838 28405 leader_election.cc:304] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:58.423679 28839 raft_consensus.cc:493] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.424299 28839 raft_consensus.cc:3060] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.415836 28796 raft_consensus.cc:515] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.431074 28720 consensus_queue.cc:1048] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.433681 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a539209b26a46fa8275b3913fc0371c" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:58.434384 28365 raft_consensus.cc:3060] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.436013 28563 ts_tablet_manager.cc:1434] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.138s	user 0.011s	sys 0.000s
I20260709 12:12:58.394188 28561 raft_consensus.cc:359] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.437125 28561 raft_consensus.cc:385] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.437390 28561 raft_consensus.cc:740] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.441968 28564 tablet_bootstrap.cc:654] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.443665 28561 consensus_queue.cc:260] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.435381 28796 leader_election.cc:290] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:58.448096 28563 tablet_bootstrap.cc:492] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:58.442178 28720 raft_consensus.cc:2804] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.443676 28288 raft_consensus.cc:1275] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:58.462596 28561 ts_tablet_manager.cc:1434] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.001s
I20260709 12:12:58.466698 28561 tablet_bootstrap.cc:492] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:58.463562 28720 raft_consensus.cc:697] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:58.469889 28720 consensus_queue.cc:237] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.474815 28571 leader_election.cc:290] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:58.477144 28676 raft_consensus.cc:493] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.481143 28676 raft_consensus.cc:515] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.483139 28516 raft_consensus.cc:2468] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:58.484609 28288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd7b4ba0d53419e909c0c82013ee595" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:58.493674 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b53fc8bee74341af2a3b4395afbb61" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:58.494557 28287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:58.495312 28287 raft_consensus.cc:3060] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.495977 28407 leader_election.cc:343] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.486519 28676 leader_election.cc:290] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:58.507303 28334 leader_election.cc:304] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:12:58.508391 28570 raft_consensus.cc:2804] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.508981 28570 raft_consensus.cc:697] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:12:58.509925 28570 consensus_queue.cc:237] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.519335 28563 tablet_bootstrap.cc:654] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.523900 28442 raft_consensus.cc:2468] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:58.500939 28365 raft_consensus.cc:2468] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:58.502027 28885 raft_consensus.cc:493] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.553215 28885 raft_consensus.cc:515] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.541076 28804 consensus_queue.cc:1048] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:58.556070 28885 leader_election.cc:290] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:58.541666 28405 leader_election.cc:304] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.543452 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd7b4ba0d53419e909c0c82013ee595" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:58.561728 28562 tablet_bootstrap.cc:654] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.571337 28561 tablet_bootstrap.cc:654] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.568185 28190 catalog_manager.cc:5697] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.574365 28796 raft_consensus.cc:2804] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.583323 28839 raft_consensus.cc:515] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.585906 28839 leader_election.cc:290] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:58.582087 28796 raft_consensus.cc:493] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.593390 28189 catalog_manager.cc:5697] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.593875 28796 raft_consensus.cc:3060] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.590135 28288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:58.605912 28777 raft_consensus.cc:493] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.607805 28777 raft_consensus.cc:515] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.610016 28777 leader_election.cc:290] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:58.614694 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:58.615816 28796 raft_consensus.cc:515] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.589756 28287 raft_consensus.cc:2468] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:58.620623 28563 tablet_bootstrap.cc:492] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:58.621192 28563 ts_tablet_manager.cc:1403] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.178s	user 0.023s	sys 0.005s
I20260709 12:12:58.621282 28287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a539209b26a46fa8275b3913fc0371c" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:58.625267 28292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b53fc8bee74341af2a3b4395afbb61" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:58.626080 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:58.626154 28292 raft_consensus.cc:2468] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:58.626819 28442 raft_consensus.cc:3060] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.595777 28407 leader_election.cc:304] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
W20260709 12:12:58.628943 28407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:42205, user_credentials={real_user=slave}} blocked reactor thread for 47977.1us
I20260709 12:12:58.628973 28564 tablet_bootstrap.cc:492] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:58.629818 28405 leader_election.cc:304] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:58.621985 28287 raft_consensus.cc:3060] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.629078 28676 raft_consensus.cc:2804] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.630772 28334 leader_election.cc:304] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.630851 28882 raft_consensus.cc:2804] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.631059 28676 raft_consensus.cc:697] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:58.631613 28564 ts_tablet_manager.cc:1403] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.225s	user 0.040s	sys 0.004s
I20260709 12:12:58.631574 28882 raft_consensus.cc:493] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.631965 28885 raft_consensus.cc:2804] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.632182 28882 raft_consensus.cc:3060] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.593473 28482 leader_election.cc:304] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:58.632582 28885 raft_consensus.cc:697] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:12:58.639218 28885 consensus_queue.cc:237] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.640280 28676 consensus_queue.cc:237] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.633693 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:58.652181 28563 raft_consensus.cc:359] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.653388 28563 raft_consensus.cc:385] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.653517 28815 raft_consensus.cc:2749] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:58.653896 28563 raft_consensus.cc:740] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.655200 28563 consensus_queue.cc:260] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.649240 28564 raft_consensus.cc:359] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.657823 28564 raft_consensus.cc:385] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.658281 28564 raft_consensus.cc:740] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.634694 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
W20260709 12:12:58.661803 28334 leader_election.cc:343] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:58.662436 28331 leader_election.cc:343] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:58.662668 28334 leader_election.cc:343] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.662904 28331 leader_election.cc:304] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:58.664039 28839 raft_consensus.cc:2749] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:58.665149 28259 leader_election.cc:343] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.667359 28839 raft_consensus.cc:493] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.667678 28564 consensus_queue.cc:260] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.667876 28839 raft_consensus.cc:515] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.669533 28563 ts_tablet_manager.cc:1434] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.002s
I20260709 12:12:58.675926 28191 catalog_manager.cc:5697] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.685684 28839 leader_election.cc:290] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:58.686993 28796 leader_election.cc:290] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:58.666446 28882 raft_consensus.cc:515] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.690383 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:58.691064 28286 raft_consensus.cc:3060] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.692749 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:58.698027 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
W20260709 12:12:58.699621 28331 leader_election.cc:343] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.702235 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
W20260709 12:12:58.704331 28408 leader_election.cc:343] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.704807 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:58.706357 28259 leader_election.cc:343] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:58.706895 28334 leader_election.cc:343] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.707823 28287 raft_consensus.cc:2468] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:58.706889 28259 leader_election.cc:304] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:58.710467 28663 raft_consensus.cc:2749] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.702258 28563 tablet_bootstrap.cc:492] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:58.707664 28334 leader_election.cc:304] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:12:58.714344 28564 ts_tablet_manager.cc:1434] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 12:12:58.715342 28442 raft_consensus.cc:2468] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:58.723418 28564 tablet_bootstrap.cc:492] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:58.723313 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b53fc8bee74341af2a3b4395afbb61" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:58.723883 28561 tablet_bootstrap.cc:492] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:58.724160 28285 raft_consensus.cc:3060] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.724452 28561 ts_tablet_manager.cc:1403] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.258s	user 0.021s	sys 0.009s
I20260709 12:12:58.725332 28882 leader_election.cc:290] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:58.717124 28839 raft_consensus.cc:2749] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.732745 28285 raft_consensus.cc:2468] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:58.741566 28405 leader_election.cc:304] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:58.743256 28561 raft_consensus.cc:359] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.744140 28561 raft_consensus.cc:385] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.744468 28561 raft_consensus.cc:740] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.747252 28561 consensus_queue.cc:260] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.750174 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b53fc8bee74341af2a3b4395afbb61" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:58.742849 28796 raft_consensus.cc:2804] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.751158 28796 raft_consensus.cc:697] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:58.752274 28796 consensus_queue.cc:237] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.760874 28561 ts_tablet_manager.cc:1434] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 12:12:58.765638 28561 tablet_bootstrap.cc:492] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:58.765985 28286 raft_consensus.cc:2468] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:58.767715 28725 consensus_queue.cc:1048] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.768364 28405 leader_election.cc:304] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.769069 28564 tablet_bootstrap.cc:654] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.758953 28334 leader_election.cc:304] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.774997 28561 tablet_bootstrap.cc:654] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.774909 28839 raft_consensus.cc:2804] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:58.775934 28407 leader_election.cc:343] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.776093 28839 raft_consensus.cc:697] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:12:58.777305 28839 consensus_queue.cc:237] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.778654 28882 raft_consensus.cc:2804] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.780858 28563 tablet_bootstrap.cc:654] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.796537 28562 tablet_bootstrap.cc:492] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:58.797169 28562 ts_tablet_manager.cc:1403] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.466s	user 0.016s	sys 0.012s
I20260709 12:12:58.794854 28189 catalog_manager.cc:5697] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.797353 28882 raft_consensus.cc:697] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:58.817207 28882 consensus_queue.cc:237] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
W20260709 12:12:58.832208 28259 consensus_peers.cc:597] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:58.838886 28562 raft_consensus.cc:359] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.839695 28562 raft_consensus.cc:385] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.839969 28562 raft_consensus.cc:740] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.840631 28562 consensus_queue.cc:260] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:58.842167 28562 ts_tablet_manager.cc:1434] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.003s
I20260709 12:12:58.843302 28561 tablet_bootstrap.cc:492] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:58.843842 28561 ts_tablet_manager.cc:1403] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.013s
I20260709 12:12:58.848753 28777 raft_consensus.cc:493] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.849320 28777 raft_consensus.cc:515] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.855157 28777 leader_election.cc:290] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
W20260709 12:12:58.857442 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:58.857496 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:58.859925 28259 leader_election.cc:343] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.864567 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:58.865355 28368 raft_consensus.cc:2468] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:58.867141 28562 tablet_bootstrap.cc:492] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:58.866994 28258 leader_election.cc:304] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.874468 28725 raft_consensus.cc:2804] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.874939 28725 raft_consensus.cc:493] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.875285 28725 raft_consensus.cc:3060] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.882325 28562 tablet_bootstrap.cc:654] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.886971 28561 raft_consensus.cc:359] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.887742 28561 raft_consensus.cc:385] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.887998 28561 raft_consensus.cc:740] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.888501 28561 consensus_queue.cc:260] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:58.903175 28561 ts_tablet_manager.cc:1434] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.002s
I20260709 12:12:58.905205 28561 tablet_bootstrap.cc:492] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:58.908420 28563 tablet_bootstrap.cc:492] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:58.908964 28563 ts_tablet_manager.cc:1403] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.207s	user 0.014s	sys 0.001s
I20260709 12:12:58.911857 28563 raft_consensus.cc:359] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.912531 28563 raft_consensus.cc:385] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.912819 28563 raft_consensus.cc:740] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.913457 28563 consensus_queue.cc:260] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:58.915249 28885 consensus_queue.cc:1048] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.915782 28563 ts_tablet_manager.cc:1434] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:58.923862 28561 tablet_bootstrap.cc:654] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.941352 28561 tablet_bootstrap.cc:492] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:58.943676 28561 ts_tablet_manager.cc:1403] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.003s
I20260709 12:12:58.941983 28725 raft_consensus.cc:515] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.948745 28725 leader_election.cc:290] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:58.949978 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:58.950040 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:58.950785 28368 raft_consensus.cc:3060] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.951647 28259 leader_election.cc:343] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.954222 28570 consensus_queue.cc:1048] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.936010 28188 catalog_manager.cc:5697] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.957232 28188 catalog_manager.cc:5697] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.959882 28368 raft_consensus.cc:2468] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:58.960222 28191 catalog_manager.cc:5697] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.961694 28258 leader_election.cc:304] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:58.966625 28723 raft_consensus.cc:2804] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.965709 28191 catalog_manager.cc:5697] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.967387 28723 raft_consensus.cc:697] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:58.968667 28723 consensus_queue.cc:237] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.976045 28563 tablet_bootstrap.cc:492] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:58.963933 28561 raft_consensus.cc:359] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.976924 28561 raft_consensus.cc:385] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.977365 28561 raft_consensus.cc:740] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.978134 28561 consensus_queue.cc:260] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:58.980935 28561 ts_tablet_manager.cc:1434] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:12:58.982323 28561 tablet_bootstrap.cc:492] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:58.984416 28563 tablet_bootstrap.cc:654] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:58.989779 28407 consensus_peers.cc:597] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:58.990294 28564 tablet_bootstrap.cc:492] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:58.991032 28564 ts_tablet_manager.cc:1403] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.271s	user 0.025s	sys 0.020s
I20260709 12:12:59.015516 28564 raft_consensus.cc:359] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.016314 28564 raft_consensus.cc:385] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.016578 28564 raft_consensus.cc:740] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.018152 28564 consensus_queue.cc:260] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.021950 28564 ts_tablet_manager.cc:1434] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.006s
I20260709 12:12:59.022295 28882 consensus_queue.cc:1048] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.023656 28564 tablet_bootstrap.cc:492] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:59.032637 28564 tablet_bootstrap.cc:654] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.037325 28676 raft_consensus.cc:493] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.037978 28676 raft_consensus.cc:515] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.043040 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8dc12e1a8c4cceab2d9e2b404fff28" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:59.043742 28365 raft_consensus.cc:2468] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:59.043910 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8dc12e1a8c4cceab2d9e2b404fff28" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:59.045328 28407 leader_election.cc:304] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:59.046327 28796 raft_consensus.cc:2804] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.046790 28796 raft_consensus.cc:493] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.047127 28796 raft_consensus.cc:3060] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.045501 28676 leader_election.cc:290] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:59.038038 28663 raft_consensus.cc:493] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.053049 28561 tablet_bootstrap.cc:654] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.056690 28562 tablet_bootstrap.cc:492] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:59.057628 28562 ts_tablet_manager.cc:1403] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.191s	user 0.014s	sys 0.024s
W20260709 12:12:59.053413 28408 leader_election.cc:343] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.079728 28562 raft_consensus.cc:359] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.080518 28562 raft_consensus.cc:385] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.080777 28562 raft_consensus.cc:740] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.084733 28514 raft_consensus.cc:3060] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.084714 28562 consensus_queue.cc:260] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.096518 28570 consensus_queue.cc:1048] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.057863 28663 raft_consensus.cc:515] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.107967 28563 tablet_bootstrap.cc:492] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:59.108570 28563 ts_tablet_manager.cc:1403] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.021s
I20260709 12:12:59.110898 28663 leader_election.cc:290] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:59.111492 28563 raft_consensus.cc:359] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.112272 28563 raft_consensus.cc:385] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.112553 28563 raft_consensus.cc:740] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.113603 28562 ts_tablet_manager.cc:1434] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.005s
I20260709 12:12:59.113243 28563 consensus_queue.cc:260] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.084800 28796 raft_consensus.cc:515] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.118130 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8dc12e1a8c4cceab2d9e2b404fff28" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:59.118731 28563 ts_tablet_manager.cc:1434] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:12:59.118818 28365 raft_consensus.cc:3060] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.124424 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3311f3d8df44b1a7b5123aca90c564" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:59.125907 28259 leader_election.cc:343] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.131858 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3311f3d8df44b1a7b5123aca90c564" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:59.141319 28564 tablet_bootstrap.cc:492] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:59.141852 28564 ts_tablet_manager.cc:1403] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.027s
W20260709 12:12:59.143404 28258 leader_election.cc:343] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.145699 28258 leader_election.cc:304] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:59.145741 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8dc12e1a8c4cceab2d9e2b404fff28" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:59.147511 28723 raft_consensus.cc:2749] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.143584 28796 leader_election.cc:290] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:59.151913 28831 consensus_queue.cc:1048] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.153033 28564 raft_consensus.cc:359] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
W20260709 12:12:59.153867 28408 leader_election.cc:343] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.153920 28564 raft_consensus.cc:385] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.154922 28564 raft_consensus.cc:740] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.155772 28564 consensus_queue.cc:260] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.157070 28365 raft_consensus.cc:2468] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:59.158357 28564 ts_tablet_manager.cc:1434] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 12:12:59.159060 28563 tablet_bootstrap.cc:492] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:59.158357 28407 leader_election.cc:304] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:59.161788 28882 raft_consensus.cc:2804] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.162722 28882 raft_consensus.cc:697] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:59.163815 28882 consensus_queue.cc:237] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.165189 28564 tablet_bootstrap.cc:492] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:59.176064 28562 tablet_bootstrap.cc:492] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:59.181334 28191 catalog_manager.cc:5697] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.192184 28563 tablet_bootstrap.cc:654] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.196949 28564 tablet_bootstrap.cc:654] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.211714 28513 raft_consensus.cc:3060] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.222800 28561 tablet_bootstrap.cc:492] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:59.223502 28561 ts_tablet_manager.cc:1403] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.241s	user 0.028s	sys 0.014s
I20260709 12:12:59.227344 28570 consensus_queue.cc:1048] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.230963 28561 raft_consensus.cc:359] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.232016 28561 raft_consensus.cc:385] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.232358 28561 raft_consensus.cc:740] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.233168 28561 consensus_queue.cc:260] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.234074 28562 tablet_bootstrap.cc:654] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.237699 28831 consensus_queue.cc:1048] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.240447 28561 ts_tablet_manager.cc:1434] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:12:59.241693 28561 tablet_bootstrap.cc:492] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:59.255759 28564 tablet_bootstrap.cc:492] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:59.256431 28564 ts_tablet_manager.cc:1403] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.003s
I20260709 12:12:59.260042 28564 raft_consensus.cc:359] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.260977 28564 raft_consensus.cc:385] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.261416 28564 raft_consensus.cc:740] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.262153 28564 consensus_queue.cc:260] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.267048 28564 ts_tablet_manager.cc:1434] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:59.270473 28564 tablet_bootstrap.cc:492] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:59.276160 28815 raft_consensus.cc:493] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:12:59.276808 28815 raft_consensus.cc:515] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.286121 28815 leader_election.cc:290] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:59.288312 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:59.290644 28676 consensus_queue.cc:1048] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.292237 28563 tablet_bootstrap.cc:492] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:59.292757 28563 ts_tablet_manager.cc:1403] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.001s
W20260709 12:12:59.293092 28408 consensus_peers.cc:597] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:59.293207 28407 consensus_peers.cc:597] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.300719 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:59.300954 28563 raft_consensus.cc:359] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.301618 28563 raft_consensus.cc:385] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.301976 28563 raft_consensus.cc:740] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.302820 28562 tablet_bootstrap.cc:492] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:59.303337 28562 ts_tablet_manager.cc:1403] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.010s
I20260709 12:12:59.308919 28563 consensus_queue.cc:260] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.310566 28562 raft_consensus.cc:359] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.311301 28562 raft_consensus.cc:385] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.311566 28562 raft_consensus.cc:740] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.313282 28562 consensus_queue.cc:260] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.311612 28190 catalog_manager.cc:5697] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.309942 28482 leader_election.cc:304] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:59.315708 28883 raft_consensus.cc:2749] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:59.319823 28564 tablet_bootstrap.cc:654] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.328619 28563 ts_tablet_manager.cc:1434] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:12:59.331218 28563 tablet_bootstrap.cc:492] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:59.331949 28561 tablet_bootstrap.cc:654] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.330049 28562 ts_tablet_manager.cc:1434] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:12:59.335625 28562 tablet_bootstrap.cc:492] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:59.351497 28563 tablet_bootstrap.cc:654] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.359423 28562 tablet_bootstrap.cc:654] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.360179 28561 tablet_bootstrap.cc:492] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:59.360775 28561 ts_tablet_manager.cc:1403] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.002s
I20260709 12:12:59.362965 28564 tablet_bootstrap.cc:492] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:59.363516 28564 ts_tablet_manager.cc:1403] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.003s
I20260709 12:12:59.370294 28725 raft_consensus.cc:493] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.371133 28725 raft_consensus.cc:515] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.375409 28564 raft_consensus.cc:359] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.376173 28564 raft_consensus.cc:385] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.376442 28564 raft_consensus.cc:740] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.377174 28564 consensus_queue.cc:260] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.377604 28561 raft_consensus.cc:359] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.378368 28561 raft_consensus.cc:385] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.378670 28561 raft_consensus.cc:740] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.379340 28561 consensus_queue.cc:260] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.380190 28564 ts_tablet_manager.cc:1434] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:12:59.380538 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:59.381268 28564 tablet_bootstrap.cc:492] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:59.385478 28561 ts_tablet_manager.cc:1434] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:12:59.391644 28564 tablet_bootstrap.cc:654] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:59.392529 28258 leader_election.cc:343] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.399609 28839 consensus_queue.cc:1048] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.400980 28882 consensus_queue.cc:1048] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.403797 28515 raft_consensus.cc:3060] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.408064 28839 raft_consensus.cc:493] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.408617 28839 raft_consensus.cc:515] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.410892 28839 leader_election.cc:290] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:59.415938 28562 tablet_bootstrap.cc:492] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:59.416486 28562 ts_tablet_manager.cc:1403] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.001s
I20260709 12:12:59.417099 28663 consensus_queue.cc:1048] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.417769 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a02f7b3bf4f248ce40cb391061654" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:59.418916 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a02f7b3bf4f248ce40cb391061654" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:59.422761 28725 leader_election.cc:290] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:59.423653 28334 leader_election.cc:304] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:59.424557 28562 raft_consensus.cc:359] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.425285 28562 raft_consensus.cc:385] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.425042 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:59.425611 28562 raft_consensus.cc:740] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.425886 28441 raft_consensus.cc:2468] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:59.426873 28885 raft_consensus.cc:2749] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.428314 28259 leader_election.cc:304] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:59.430764 28561 tablet_bootstrap.cc:492] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:59.431563 28723 raft_consensus.cc:2804] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.432106 28723 raft_consensus.cc:493] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.432591 28723 raft_consensus.cc:3060] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.435205 28562 consensus_queue.cc:260] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.444157 28562 ts_tablet_manager.cc:1434] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
W20260709 12:12:59.445324 28334 consensus_peers.cc:597] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.445382 28882 raft_consensus.cc:493] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.453758 28562 tablet_bootstrap.cc:492] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:59.453841 28882 raft_consensus.cc:515] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.449517 28563 tablet_bootstrap.cc:492] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:59.455317 28563 ts_tablet_manager.cc:1403] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.124s	user 0.021s	sys 0.007s
I20260709 12:12:59.460121 28561 tablet_bootstrap.cc:654] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.461782 28366 raft_consensus.cc:3060] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.471630 28563 raft_consensus.cc:359] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.472409 28563 raft_consensus.cc:385] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.472676 28563 raft_consensus.cc:740] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.473340 28563 consensus_queue.cc:260] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.474628 28725 raft_consensus.cc:493] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.452890 28564 tablet_bootstrap.cc:492] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:59.475154 28725 raft_consensus.cc:515] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.475896 28564 ts_tablet_manager.cc:1403] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.000s
I20260709 12:12:59.477669 28725 leader_election.cc:290] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:59.478490 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:59.479130 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:59.479894 28368 raft_consensus.cc:2468] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
W20260709 12:12:59.480623 28259 leader_election.cc:343] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.481149 28882 leader_election.cc:290] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:59.481916 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:59.483340 28408 leader_election.cc:343] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.484046 28564 raft_consensus.cc:359] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.484758 28564 raft_consensus.cc:385] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.485026 28564 raft_consensus.cc:740] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.484911 28258 leader_election.cc:304] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:59.486069 28564 consensus_queue.cc:260] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.488144 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:59.488847 28289 raft_consensus.cc:2468] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:59.488302 28663 raft_consensus.cc:2804] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.489421 28663 raft_consensus.cc:493] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.489796 28663 raft_consensus.cc:3060] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.496374 28563 ts_tablet_manager.cc:1434] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 12:12:59.498667 28563 tablet_bootstrap.cc:492] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:59.500065 28883 raft_consensus.cc:493] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.500617 28883 raft_consensus.cc:515] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.504496 28883 leader_election.cc:290] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:59.505132 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:59.505942 28564 ts_tablet_manager.cc:1434] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:12:59.507084 28564 tablet_bootstrap.cc:492] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:59.506808 28723 raft_consensus.cc:515] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.507597 28563 tablet_bootstrap.cc:654] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.507200 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:59.509371 28777 consensus_queue.cc:1048] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.509764 28479 leader_election.cc:304] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:59.511099 28883 raft_consensus.cc:2749] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:59.514262 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:59.514855 28440 raft_consensus.cc:3060] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.515657 28723 leader_election.cc:290] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:59.517501 28723 raft_consensus.cc:493] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.517760 28405 leader_election.cc:304] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:59.517973 28723 raft_consensus.cc:515] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.519079 28796 raft_consensus.cc:2804] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.519459 28796 raft_consensus.cc:493] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.519806 28796 raft_consensus.cc:3060] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.521035 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:59.521786 28441 raft_consensus.cc:2468] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:12:59.522136 28723 leader_election.cc:290] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:59.522532 28564 tablet_bootstrap.cc:654] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.524946 28259 leader_election.cc:304] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:59.527290 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:59.528882 28883 raft_consensus.cc:493] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.529457 28883 raft_consensus.cc:515] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.529554 28796 raft_consensus.cc:515] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.531811 28883 leader_election.cc:290] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
W20260709 12:12:59.529459 28259 leader_election.cc:343] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.532696 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d763609f275142958e76408fb898f06c" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:59.546880 28289 raft_consensus.cc:2468] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 0.
I20260709 12:12:59.534653 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d763609f275142958e76408fb898f06c" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:59.548471 28479 leader_election.cc:304] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:12:59.549288 28883 raft_consensus.cc:2804] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.549640 28883 raft_consensus.cc:493] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.550004 28883 raft_consensus.cc:3060] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.543789 28570 raft_consensus.cc:493] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.540967 28562 tablet_bootstrap.cc:654] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.550555 28570 raft_consensus.cc:515] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.543707 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:59.552768 28570 leader_election.cc:290] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
W20260709 12:12:59.553632 28258 leader_election.cc:343] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.544981 28663 raft_consensus.cc:515] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.549674 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:59.554711 28289 raft_consensus.cc:3060] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.552765 28481 leader_election.cc:343] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.500001 28882 raft_consensus.cc:493] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.559062 28882 raft_consensus.cc:515] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.559259 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6a84976de403eba7d0dc88138e12a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:59.560319 28441 raft_consensus.cc:2468] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:12:59.561802 28334 leader_election.cc:304] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:12:59.562588 28570 raft_consensus.cc:2804] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.562947 28570 raft_consensus.cc:493] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.563266 28570 raft_consensus.cc:3060] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.563968 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6a84976de403eba7d0dc88138e12a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:59.564330 28561 tablet_bootstrap.cc:492] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:59.565006 28561 ts_tablet_manager.cc:1403] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.001s
W20260709 12:12:59.565337 28334 leader_election.cc:343] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.570430 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6a84976de403eba7d0dc88138e12a" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:12:59.572610 28570 raft_consensus.cc:515] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
W20260709 12:12:59.575033 28408 leader_election.cc:343] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.577323 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6a84976de403eba7d0dc88138e12a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:59.578279 28441 raft_consensus.cc:3060] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.576529 28289 raft_consensus.cc:2468] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:59.582523 28882 leader_election.cc:290] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:59.583487 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:59.583990 28796 leader_election.cc:290] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
W20260709 12:12:59.585265 28408 leader_election.cc:343] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.587337 28405 leader_election.cc:304] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:59.587864 28883 raft_consensus.cc:515] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.588912 28796 raft_consensus.cc:2804] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.599576 28796 raft_consensus.cc:697] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:59.600730 28796 consensus_queue.cc:237] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.590359 28663 leader_election.cc:290] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:59.591506 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:59.603245 28368 raft_consensus.cc:3060] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.593256 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
W20260709 12:12:59.611567 28259 leader_election.cc:343] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.574894 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6a84976de403eba7d0dc88138e12a" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:59.612540 28365 raft_consensus.cc:2393] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ce5f603caa48ababe023df3a36c0b4 in current term 1: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:12:59.542788 28723 raft_consensus.cc:2804] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.594796 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac6a84976de403eba7d0dc88138e12a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:12:59.614890 28407 leader_election.cc:304] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:59.615788 28723 raft_consensus.cc:493] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.616273 28723 raft_consensus.cc:3060] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.616530 28334 leader_election.cc:343] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.595244 28570 leader_election.cc:290] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:59.596793 28815 raft_consensus.cc:493] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.618783 28815 raft_consensus.cc:515] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.621069 28815 leader_election.cc:290] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:12:59.623958 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:59.626631 28440 raft_consensus.cc:2468] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:59.629388 28368 raft_consensus.cc:2468] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:12:59.630646 28563 tablet_bootstrap.cc:492] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:59.631165 28563 ts_tablet_manager.cc:1403] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.023s
I20260709 12:12:59.637295 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d763609f275142958e76408fb898f06c" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:59.638955 28289 raft_consensus.cc:3060] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.633955 28563 raft_consensus.cc:359] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.640882 28258 leader_election.cc:304] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:59.645867 28441 raft_consensus.cc:2468] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:12:59.645025 28259 leader_election.cc:304] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:59.646684 28882 raft_consensus.cc:2749] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.639199 28561 raft_consensus.cc:359] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.647469 28561 raft_consensus.cc:385] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.647538 28334 leader_election.cc:304] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:59.648769 28570 raft_consensus.cc:2804] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.649920 28570 raft_consensus.cc:697] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:12:59.650817 28570 consensus_queue.cc:237] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.643293 28563 raft_consensus.cc:385] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.654083 28563 raft_consensus.cc:740] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.655020 28563 consensus_queue.cc:260] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.657382 28725 raft_consensus.cc:2804] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.658035 28725 raft_consensus.cc:697] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:59.661366 28839 raft_consensus.cc:493] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.661617 28561 raft_consensus.cc:740] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.661270 28725 consensus_queue.cc:237] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.661972 28839 raft_consensus.cc:515] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.662334 28561 consensus_queue.cc:260] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.664161 28839 leader_election.cc:290] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:12:59.664599 28561 ts_tablet_manager.cc:1434] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 12:12:59.669721 28563 ts_tablet_manager.cc:1434] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:12:59.674937 28563 tablet_bootstrap.cc:492] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:59.643731 28883 leader_election.cc:290] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
W20260709 12:12:59.665067 28479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 53491.9us
I20260709 12:12:59.680043 28564 tablet_bootstrap.cc:492] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:59.682734 28563 tablet_bootstrap.cc:654] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.682618 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b53fc8bee74341af2a3b4395afbb61" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:12:59.678649 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d763609f275142958e76408fb898f06c" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:59.688705 28564 ts_tablet_manager.cc:1403] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.182s	user 0.023s	sys 0.024s
I20260709 12:12:59.683818 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b53fc8bee74341af2a3b4395afbb61" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:59.677012 28663 raft_consensus.cc:2804] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.690094 28663 raft_consensus.cc:697] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:59.690980 28663 consensus_queue.cc:237] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.691385 28564 raft_consensus.cc:359] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.692101 28564 raft_consensus.cc:385] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.692389 28564 raft_consensus.cc:740] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.693002 28564 consensus_queue.cc:260] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.694428 28561 tablet_bootstrap.cc:492] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:12:59.686546 28723 raft_consensus.cc:515] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.698295 28564 ts_tablet_manager.cc:1434] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:59.699437 28289 raft_consensus.cc:2468] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:12:59.701768 28720 consensus_queue.cc:1048] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:59.698160 28481 leader_election.cc:343] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.706161 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:59.707852 28479 leader_election.cc:304] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:59.708873 28564 tablet_bootstrap.cc:492] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:12:59.711769 28479 leader_election.cc:304] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:59.712615 28940 raft_consensus.cc:2804] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.713527 28940 raft_consensus.cc:697] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:12:59.714633 28365 raft_consensus.cc:3060] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.714531 28940 consensus_queue.cc:237] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:12:59.704872 28188 catalog_manager.cc:5697] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.715895 28723 leader_election.cc:290] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:59.716295 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:12:59.720619 28334 leader_election.cc:304] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:12:59.726290 28571 raft_consensus.cc:2749] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.734023 28562 tablet_bootstrap.cc:492] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:12:59.734575 28562 ts_tablet_manager.cc:1403] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.290s	user 0.009s	sys 0.011s
I20260709 12:12:59.724432 28831 raft_consensus.cc:493] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.734975 28831 raft_consensus.cc:515] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.737042 28831 leader_election.cc:290] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:59.737792 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
W20260709 12:12:59.739425 28259 leader_election.cc:343] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.726394 28441 raft_consensus.cc:3060] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.742959 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415e5a1b64b14a7d8cc7ec3b64f5cc26" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:12:59.744356 28407 leader_election.cc:343] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.739054 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415e5a1b64b14a7d8cc7ec3b64f5cc26" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:12:59.745111 28286 raft_consensus.cc:2468] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:12:59.746455 28405 leader_election.cc:304] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:59.747350 28676 raft_consensus.cc:2804] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.747792 28676 raft_consensus.cc:493] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.748993 28676 raft_consensus.cc:3060] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.761677 28562 raft_consensus.cc:359] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.762853 28562 raft_consensus.cc:385] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.763216 28562 raft_consensus.cc:740] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.764112 28562 consensus_queue.cc:260] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
W20260709 12:12:59.758160 28479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 46503.5us
I20260709 12:12:59.791682 28441 raft_consensus.cc:2468] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
W20260709 12:12:59.793331 28408 consensus_peers.cc:597] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.795183 28259 leader_election.cc:304] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:12:59.797360 28562 ts_tablet_manager.cc:1434] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 12:12:59.803134 28564 tablet_bootstrap.cc:654] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.806685 28570 raft_consensus.cc:2749] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.804975 28942 raft_consensus.cc:2804] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.814935 28187 catalog_manager.cc:5697] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.818562 28561 tablet_bootstrap.cc:654] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.820248 28514 raft_consensus.cc:3060] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.827625 28562 tablet_bootstrap.cc:492] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:12:59.832719 28188 catalog_manager.cc:5697] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.834005 28942 raft_consensus.cc:697] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:12:59.834290 28676 raft_consensus.cc:515] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.847409 28942 consensus_queue.cc:237] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.848522 28676 leader_election.cc:290] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:12:59.850055 28563 tablet_bootstrap.cc:492] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:12:59.850662 28563 ts_tablet_manager.cc:1403] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.003s
I20260709 12:12:59.863596 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415e5a1b64b14a7d8cc7ec3b64f5cc26" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:12:59.884436 28563 raft_consensus.cc:359] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.885608 28563 raft_consensus.cc:385] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.864319 28289 raft_consensus.cc:3060] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.885978 28563 raft_consensus.cc:740] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
W20260709 12:12:59.889894 28947 log.cc:927] Time spent T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:12:59.891613 28562 tablet_bootstrap.cc:654] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.892449 28882 raft_consensus.cc:493] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:59.897862 28334 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 123176us
I20260709 12:12:59.909348 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415e5a1b64b14a7d8cc7ec3b64f5cc26" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:12:59.910760 28563 consensus_queue.cc:260] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.905591 28882 raft_consensus.cc:515] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:12:59.918201 28882 leader_election.cc:290] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:12:59.923750 28563 ts_tablet_manager.cc:1434] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.002s
I20260709 12:12:59.924903 28563 tablet_bootstrap.cc:492] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:12:59.928102 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eec19560a14a8db0c4d338da3a1cba" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:12:59.930929 28408 leader_election.cc:343] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.934087 28187 catalog_manager.cc:5697] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 1 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.945469 28561 tablet_bootstrap.cc:492] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:12:59.946061 28561 ts_tablet_manager.cc:1403] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.257s	user 0.030s	sys 0.017s
W20260709 12:12:59.946712 28407 leader_election.cc:343] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.951601 28289 raft_consensus.cc:2468] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:12:59.954138 28405 leader_election.cc:304] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:12:59.955363 28676 raft_consensus.cc:2804] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.955823 28676 raft_consensus.cc:697] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:12:59.956508 28676 consensus_queue.cc:237] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:12:59.970335 28564 tablet_bootstrap.cc:492] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:12:59.970937 28564 ts_tablet_manager.cc:1403] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.263s	user 0.020s	sys 0.004s
I20260709 12:12:59.973824 28564 raft_consensus.cc:359] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.974642 28564 raft_consensus.cc:385] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.974939 28564 raft_consensus.cc:740] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.975553 28564 consensus_queue.cc:260] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:12:59.976284 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eec19560a14a8db0c4d338da3a1cba" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:12:59.977730 28564 ts_tablet_manager.cc:1434] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:12:59.986958 28564 tablet_bootstrap.cc:492] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:13:00.005137 28883 raft_consensus.cc:493] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.006281 28883 raft_consensus.cc:515] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:00.008447 28883 leader_election.cc:290] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:00.015336 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8dc12e1a8c4cceab2d9e2b404fff28" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:00.018087 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8dc12e1a8c4cceab2d9e2b404fff28" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:00.023906 28839 raft_consensus.cc:493] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.024425 28839 raft_consensus.cc:515] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.026880 28839 leader_election.cc:290] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:00.028597 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:00.028779 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:00.029716 28441 raft_consensus.cc:2393] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 1: Already voted for candidate 24654af7758f4a5ebc3e3a8fba0b617a in this term.
I20260709 12:13:00.032207 28481 leader_election.cc:304] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:00.033793 28571 raft_consensus.cc:2749] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.037123 28513 raft_consensus.cc:3060] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.039515 28564 tablet_bootstrap.cc:654] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:00.043956 28407 leader_election.cc:343] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.046234 28561 raft_consensus.cc:359] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.069759 28561 raft_consensus.cc:385] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.054973 28331 leader_election.cc:304] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:00.070186 28561 raft_consensus.cc:740] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.071095 28561 consensus_queue.cc:260] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.074214 28839 raft_consensus.cc:3060] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.072393 28563 tablet_bootstrap.cc:654] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.065006 28188 catalog_manager.cc:5697] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:00.081537 28777 consensus_queue.cc:1048] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:13:00.044549 28407 leader_election.cc:304] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
W20260709 12:13:00.088829 28407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.66:42205, user_credentials={real_user=slave}} blocked reactor thread for 44894.3us
I20260709 12:13:00.090240 28962 raft_consensus.cc:2749] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.067837 28562 tablet_bootstrap.cc:492] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:13:00.093510 28562 ts_tablet_manager.cc:1403] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.266s	user 0.021s	sys 0.035s
I20260709 12:13:00.097234 28562 raft_consensus.cc:359] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:13:00.084692 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:00.074488 28561 ts_tablet_manager.cc:1434] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.128s	user 0.009s	sys 0.000s
I20260709 12:13:00.102550 28561 tablet_bootstrap.cc:492] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:00.107831 28190 catalog_manager.cc:5697] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.109882 28190 catalog_manager.cc:5697] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:00.114828 28563 tablet_bootstrap.cc:492] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:00.115401 28563 ts_tablet_manager.cc:1403] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.191s	user 0.008s	sys 0.010s
I20260709 12:13:00.098220 28562 raft_consensus.cc:385] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.117331 28562 raft_consensus.cc:740] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.118739 28562 consensus_queue.cc:260] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.131336 28562 ts_tablet_manager.cc:1434] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.007s
I20260709 12:13:00.133498 28562 tablet_bootstrap.cc:492] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:13:00.137277 28839 raft_consensus.cc:2749] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.146451 28562 tablet_bootstrap.cc:654] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.147758 28676 consensus_queue.cc:1048] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.152235 28561 tablet_bootstrap.cc:654] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:00.156347 28334 consensus_peers.cc:597] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.198258 28564 tablet_bootstrap.cc:492] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:13:00.198982 28564 ts_tablet_manager.cc:1403] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.220s	user 0.021s	sys 0.001s
I20260709 12:13:00.223357 28564 raft_consensus.cc:359] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.224169 28564 raft_consensus.cc:385] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.226158 28564 raft_consensus.cc:740] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.226673 28953 consensus_queue.cc:1048] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:00.233983 28259 consensus_peers.cc:597] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.226931 28839 consensus_queue.cc:1048] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.228936 28563 raft_consensus.cc:359] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.238005 28563 raft_consensus.cc:385] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.238389 28563 raft_consensus.cc:740] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.239285 28563 consensus_queue.cc:260] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.231434 28883 consensus_queue.cc:1048] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.248602 28563 ts_tablet_manager.cc:1434] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.133s	user 0.006s	sys 0.002s
W20260709 12:13:00.249554 28259 consensus_peers.cc:597] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.249410 28564 consensus_queue.cc:260] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.252755 28564 ts_tablet_manager.cc:1434] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:13:00.253657 28563 tablet_bootstrap.cc:492] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:00.253751 28564 tablet_bootstrap.cc:492] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:13:00.262225 28561 tablet_bootstrap.cc:492] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:13:00.263681 28561 ts_tablet_manager.cc:1403] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.161s	user 0.010s	sys 0.005s
I20260709 12:13:00.272090 28561 raft_consensus.cc:359] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.273646 28561 raft_consensus.cc:385] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.274008 28561 raft_consensus.cc:740] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.274569 28723 consensus_queue.cc:1048] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:00.277789 28408 consensus_peers.cc:597] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.279635 28561 consensus_queue.cc:260] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.282344 28564 tablet_bootstrap.cc:654] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.288120 28723 consensus_queue.cc:1048] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:13:00.288156 28561 ts_tablet_manager.cc:1434] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
W20260709 12:13:00.321141 28481 consensus_peers.cc:597] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.288271 28563 tablet_bootstrap.cc:654] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.289444 28513 raft_consensus.cc:3060] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.322332 28561 tablet_bootstrap.cc:492] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:00.300443 28562 tablet_bootstrap.cc:492] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:13:00.326112 28562 ts_tablet_manager.cc:1403] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.193s	user 0.005s	sys 0.015s
I20260709 12:13:00.331233 28562 raft_consensus.cc:359] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.331969 28562 raft_consensus.cc:385] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.332345 28562 raft_consensus.cc:740] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.333621 28561 tablet_bootstrap.cc:654] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.333321 28562 consensus_queue.cc:260] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.336508 28562 ts_tablet_manager.cc:1434] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:13:00.337667 28562 tablet_bootstrap.cc:492] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:13:00.348968 28676 raft_consensus.cc:493] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.349558 28676 raft_consensus.cc:515] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.388064 28571 raft_consensus.cc:493] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.388835 28571 raft_consensus.cc:515] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.401250 28570 raft_consensus.cc:493] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.401978 28570 raft_consensus.cc:515] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.406483 28571 leader_election.cc:290] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:00.432477 28676 leader_election.cc:290] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:00.437704 28570 leader_election.cc:290] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:00.410688 28954 raft_consensus.cc:493] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:00.453425 28259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:33813, user_credentials={real_user=slave}} blocked reactor thread for 48136.8us
I20260709 12:13:00.472254 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:00.469736 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d763609f275142958e76408fb898f06c" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:00.471241 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d763609f275142958e76408fb898f06c" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:13:00.466653 28407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:42205, user_credentials={real_user=slave}} blocked reactor thread for 48052.9us
I20260709 12:13:00.450598 28954 raft_consensus.cc:515] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.486334 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:00.496433 28562 tablet_bootstrap.cc:654] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.499358 28564 tablet_bootstrap.cc:492] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:13:00.500131 28564 ts_tablet_manager.cc:1403] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.247s	user 0.045s	sys 0.025s
I20260709 12:13:00.502336 28563 tablet_bootstrap.cc:492] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:00.502763 28561 tablet_bootstrap.cc:492] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:13:00.502936 28563 ts_tablet_manager.cc:1403] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.250s	user 0.026s	sys 0.035s
I20260709 12:13:00.503263 28561 ts_tablet_manager.cc:1403] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.182s	user 0.034s	sys 0.019s
I20260709 12:13:00.507735 28954 leader_election.cc:290] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
W20260709 12:13:00.508893 28405 leader_election.cc:343] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.505980 28561 raft_consensus.cc:359] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.510277 28561 raft_consensus.cc:385] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.510601 28561 raft_consensus.cc:740] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.511411 28561 consensus_queue.cc:260] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.522269 28561 ts_tablet_manager.cc:1434] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:13:00.535409 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:00.536381 28442 raft_consensus.cc:2468] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:13:00.543553 28563 raft_consensus.cc:359] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.544661 28563 raft_consensus.cc:385] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.545017 28563 raft_consensus.cc:740] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.518764 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:00.552620 28561 tablet_bootstrap.cc:492] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:00.554380 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:00.550263 28564 raft_consensus.cc:359] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:00.556576 28564 raft_consensus.cc:385] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.545915 28563 consensus_queue.cc:260] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.556988 28564 raft_consensus.cc:740] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.579104 28564 consensus_queue.cc:260] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:00.580775 28942 raft_consensus.cc:493] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.581367 28942 raft_consensus.cc:515] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.582327 28563 ts_tablet_manager.cc:1434] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.003s
I20260709 12:13:00.583518 28563 tablet_bootstrap.cc:492] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:00.583688 28942 leader_election.cc:290] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:00.591491 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:00.602931 28564 ts_tablet_manager.cc:1434] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.102s	user 0.005s	sys 0.003s
I20260709 12:13:00.612102 28885 raft_consensus.cc:493] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.612802 28885 raft_consensus.cc:515] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:13:00.618757 28407 consensus_peers.cc:597] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:00.621394 28259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 71330.7us
W20260709 12:13:00.623090 28408 leader_election.cc:343] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.623500 28408 leader_election.cc:304] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:00.624348 28259 leader_election.cc:304] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:00.629501 28561 tablet_bootstrap.cc:654] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.630237 28942 raft_consensus.cc:2804] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.650993 28564 tablet_bootstrap.cc:492] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4: Bootstrap starting.
I20260709 12:13:00.633963 28962 raft_consensus.cc:2749] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.654628 28885 leader_election.cc:290] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:00.655650 28562 tablet_bootstrap.cc:492] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:13:00.656200 28562 ts_tablet_manager.cc:1403] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.319s	user 0.043s	sys 0.046s
I20260709 12:13:00.644305 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:13:00.669963 28408 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:33813, user_credentials={real_user=slave}} blocked reactor thread for 46903.7us
I20260709 12:13:00.650398 28942 raft_consensus.cc:493] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.687994 28562 raft_consensus.cc:359] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:00.688771 28562 raft_consensus.cc:385] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.689041 28562 raft_consensus.cc:740] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.672878 28481 leader_election.cc:304] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:00.690667 28940 raft_consensus.cc:2749] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.656328 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:00.676688 28942 raft_consensus.cc:3060] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.695822 28563 tablet_bootstrap.cc:654] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:00.697202 28259 leader_election.cc:343] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.682802 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3311f3d8df44b1a7b5123aca90c564" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:00.702045 28562 consensus_queue.cc:260] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:00.706315 28286 raft_consensus.cc:2468] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:13:00.720207 28331 leader_election.cc:304] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:00.714704 28983 raft_consensus.cc:493] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.722054 28885 raft_consensus.cc:2804] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.722522 28885 raft_consensus.cc:493] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.722873 28885 raft_consensus.cc:3060] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.728826 28942 raft_consensus.cc:515] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.722095 28983 raft_consensus.cc:515] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:00.731096 28885 raft_consensus.cc:515] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.732414 28983 leader_election.cc:290] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:00.733173 28562 ts_tablet_manager.cc:1434] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 12:13:00.734402 28562 tablet_bootstrap.cc:492] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:13:00.734786 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3311f3d8df44b1a7b5123aca90c564" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:00.735458 28289 raft_consensus.cc:3060] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.736708 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3311f3d8df44b1a7b5123aca90c564" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:00.741057 28885 leader_election.cc:290] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:00.743098 28564 tablet_bootstrap.cc:654] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.743774 28289 raft_consensus.cc:2468] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:00.734890 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:00.745726 28331 leader_election.cc:304] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 
W20260709 12:13:00.745783 28407 leader_election.cc:343] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.745965 28334 leader_election.cc:304] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:00.747404 28984 raft_consensus.cc:2749] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.747992 28561 tablet_bootstrap.cc:492] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:13:00.748091 28885 raft_consensus.cc:2804] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.748602 28561 ts_tablet_manager.cc:1403] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.196s	user 0.023s	sys 0.038s
I20260709 12:13:00.749060 28885 raft_consensus.cc:697] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:00.750792 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3311f3d8df44b1a7b5123aca90c564" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:00.751395 28561 raft_consensus.cc:359] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.752122 28561 raft_consensus.cc:385] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.752388 28561 raft_consensus.cc:740] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.750005 28885 consensus_queue.cc:237] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.753535 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:00.753561 28962 consensus_queue.cc:1048] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:13:00.759539 28561 consensus_queue.cc:260] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.766472 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:00.767115 28442 raft_consensus.cc:3060] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:00.771205 28334 leader_election.cc:343] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.776736 28442 raft_consensus.cc:2468] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:13:00.777858 28259 leader_election.cc:304] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:00.777871 28563 tablet_bootstrap.cc:492] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:00.778777 28563 ts_tablet_manager.cc:1403] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.196s	user 0.010s	sys 0.009s
I20260709 12:13:00.782130 28562 tablet_bootstrap.cc:654] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:00.785327 28408 leader_election.cc:343] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.785980 28408 leader_election.cc:304] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:00.787206 28962 raft_consensus.cc:2749] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.788666 28366 raft_consensus.cc:3060] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.796087 28942 leader_election.cc:290] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:00.797297 28187 catalog_manager.cc:5697] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:00.798964 28561 ts_tablet_manager.cc:1434] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 12:13:00.802115 28985 raft_consensus.cc:2804] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.802611 28561 tablet_bootstrap.cc:492] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:00.802786 28985 raft_consensus.cc:697] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:00.803733 28985 consensus_queue.cc:237] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.808900 28989 raft_consensus.cc:493] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.809298 28561 tablet_bootstrap.cc:654] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.809403 28989 raft_consensus.cc:515] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.812968 28989 leader_election.cc:290] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:00.813896 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:13:00.815151 28258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:42205, user_credentials={real_user=slave}} blocked reactor thread for 58375.6us
W20260709 12:13:00.815548 28259 leader_election.cc:343] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:00.816090 28258 leader_election.cc:343] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.816884 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:00.817523 28441 raft_consensus.cc:2468] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:13:00.800042 28563 raft_consensus.cc:359] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.819413 28563 raft_consensus.cc:385] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.819839 28563 raft_consensus.cc:740] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.820751 28563 consensus_queue.cc:260] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.822889 28563 ts_tablet_manager.cc:1434] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 12:13:00.823979 28563 tablet_bootstrap.cc:492] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:00.825035 28259 leader_election.cc:304] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:00.826812 28942 raft_consensus.cc:2804] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.827332 28942 raft_consensus.cc:493] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.827800 28942 raft_consensus.cc:3060] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:00.832274 28258 leader_election.cc:343] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.840881 28258 leader_election.cc:304] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:00.842140 28982 raft_consensus.cc:2749] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:00.836638 28334 leader_election.cc:343] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.848151 28570 raft_consensus.cc:493] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.848637 28570 raft_consensus.cc:515] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:00.850806 28570 leader_election.cc:290] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:00.851918 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eec19560a14a8db0c4d338da3a1cba" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:00.854095 28562 tablet_bootstrap.cc:492] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:13:00.857594 28562 ts_tablet_manager.cc:1403] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.000s
W20260709 12:13:00.858207 28334 leader_election.cc:343] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.860956 28562 raft_consensus.cc:359] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.861749 28562 raft_consensus.cc:385] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.862043 28562 raft_consensus.cc:740] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.862900 28562 consensus_queue.cc:260] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:00.865442 28562 ts_tablet_manager.cc:1434] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:00.866617 28562 tablet_bootstrap.cc:492] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:13:00.868744 28561 tablet_bootstrap.cc:492] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: No bootstrap required, opened a new log
I20260709 12:13:00.869325 28561 ts_tablet_manager.cc:1403] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.004s
I20260709 12:13:00.873203 28562 tablet_bootstrap.cc:654] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.874050 28563 tablet_bootstrap.cc:654] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.874951 28513 raft_consensus.cc:3060] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.872947 28561 raft_consensus.cc:359] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.877647 28561 raft_consensus.cc:385] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.878013 28561 raft_consensus.cc:740] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.878886 28561 consensus_queue.cc:260] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.889489 28942 raft_consensus.cc:515] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.873224 28564 tablet_bootstrap.cc:492] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4: No bootstrap required, opened a new log
I20260709 12:13:00.938014 28564 ts_tablet_manager.cc:1403] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4: Time spent bootstrapping tablet: real 0.307s	user 0.012s	sys 0.001s
I20260709 12:13:00.897584 28561 ts_tablet_manager.cc:1434] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:13:00.899606 28562 tablet_bootstrap.cc:492] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:13:00.940726 28562 ts_tablet_manager.cc:1403] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.011s
I20260709 12:13:00.941381 28564 raft_consensus.cc:359] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.942173 28564 raft_consensus.cc:385] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.942540 28564 raft_consensus.cc:740] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.943230 28564 consensus_queue.cc:260] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:00.945660 28564 ts_tablet_manager.cc:1434] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:00.950747 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:00.951121 28942 leader_election.cc:290] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:00.951467 28440 raft_consensus.cc:3060] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.959576 28562 raft_consensus.cc:359] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.906560 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:00.965291 28366 raft_consensus.cc:3060] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.911433 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eec19560a14a8db0c4d338da3a1cba" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:00.970753 28442 raft_consensus.cc:2468] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:13:00.970846 28440 raft_consensus.cc:2468] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:13:00.923370 28512 raft_consensus.cc:3060] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.923781 28514 raft_consensus.cc:3060] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.901955 28563 tablet_bootstrap.cc:492] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:00.975359 28563 ts_tablet_manager.cc:1403] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.016s
I20260709 12:13:00.963028 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:00.930932 28989 raft_consensus.cc:493] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.978040 28563 raft_consensus.cc:359] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.978837 28563 raft_consensus.cc:385] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.979184 28563 raft_consensus.cc:740] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.980027 28563 consensus_queue.cc:260] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.978690 28989 raft_consensus.cc:515] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:00.982313 28989 leader_election.cc:290] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:00.982304 28563 ts_tablet_manager.cc:1434] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 12:13:00.982808 28334 leader_election.cc:304] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:00.985154 28570 raft_consensus.cc:2804] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.985776 28570 raft_consensus.cc:493] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.986332 28570 raft_consensus.cc:3060] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.987272 28259 leader_election.cc:304] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:00.988364 28366 raft_consensus.cc:2468] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:13:00.989009 28188 catalog_manager.cc:5697] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.997264 28562 raft_consensus.cc:385] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.989527 28989 raft_consensus.cc:2804] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.998696 28883 raft_consensus.cc:493] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:01.000515 28883 raft_consensus.cc:515] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.003556 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:01.006817 28989 raft_consensus.cc:697] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:01.007537 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:01.007756 28883 leader_election.cc:290] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:01.007797 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:01.009393 28563 tablet_bootstrap.cc:492] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:01.009569 28570 raft_consensus.cc:515] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.009963 28482 leader_election.cc:304] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:00.991395 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:01.011463 28883 raft_consensus.cc:2749] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:01.012703 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eec19560a14a8db0c4d338da3a1cba" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:01.012997 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eec19560a14a8db0c4d338da3a1cba" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:01.013375 28440 raft_consensus.cc:3060] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.008155 28562 raft_consensus.cc:740] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
W20260709 12:13:00.998878 28259 leader_election.cc:343] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.012313 28570 leader_election.cc:290] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:01.015125 28562 consensus_queue.cc:260] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:13:01.016716 28259 leader_election.cc:343] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.018087 28368 raft_consensus.cc:2468] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:13:01.018404 28562 ts_tablet_manager.cc:1434] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.004s
I20260709 12:13:01.007903 28989 consensus_queue.cc:237] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.019611 28562 tablet_bootstrap.cc:492] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:13:01.024927 28440 raft_consensus.cc:2468] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:01.026539 28334 leader_election.cc:304] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:01.026973 28562 tablet_bootstrap.cc:654] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.027395 28570 raft_consensus.cc:2804] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.027902 28570 raft_consensus.cc:697] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:01.028615 28570 consensus_queue.cc:237] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.035598 28258 leader_election.cc:304] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:01.036109 28563 tablet_bootstrap.cc:654] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:01.035809 28334 leader_election.cc:343] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.037837 28942 raft_consensus.cc:2804] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.038437 28942 raft_consensus.cc:493] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.038867 28942 raft_consensus.cc:3060] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.047678 28815 raft_consensus.cc:493] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.048310 28815 raft_consensus.cc:515] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.061743 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3311f3d8df44b1a7b5123aca90c564" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:01.063771 28815 leader_election.cc:290] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:01.069047 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad3311f3d8df44b1a7b5123aca90c564" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:01.070353 28285 raft_consensus.cc:2393] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:13:01.080614 28479 leader_election.cc:304] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:01.082463 28815 raft_consensus.cc:3060] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.119777 28563 tablet_bootstrap.cc:492] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:01.120687 28563 ts_tablet_manager.cc:1403] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.112s	user 0.007s	sys 0.009s
I20260709 12:13:01.147367 28563 raft_consensus.cc:359] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.166433 28563 raft_consensus.cc:385] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.167771 28563 raft_consensus.cc:740] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
W20260709 12:13:01.168408 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:01.168608 28563 consensus_queue.cc:260] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.171868 28563 ts_tablet_manager.cc:1434] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.002s
I20260709 12:13:01.172987 28563 tablet_bootstrap.cc:492] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:01.162535 28815 raft_consensus.cc:2749] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.164558 28942 raft_consensus.cc:515] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.181757 28563 tablet_bootstrap.cc:654] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.182307 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:01.181622 28942 leader_election.cc:290] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:01.183881 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
W20260709 12:13:01.184126 28259 leader_election.cc:343] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.184581 28368 raft_consensus.cc:3060] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.189579 28839 consensus_queue.cc:1048] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.192425 28368 raft_consensus.cc:2468] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:13:01.193867 28258 leader_election.cc:304] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:01.195111 28942 raft_consensus.cc:2804] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.195871 28942 raft_consensus.cc:697] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:01.196789 28942 consensus_queue.cc:237] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.198763 28513 raft_consensus.cc:3060] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.240406 28562 tablet_bootstrap.cc:492] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:13:01.241030 28562 ts_tablet_manager.cc:1403] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.222s	user 0.039s	sys 0.059s
I20260709 12:13:01.245651 28562 raft_consensus.cc:359] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:01.246425 28562 raft_consensus.cc:385] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.246718 28562 raft_consensus.cc:740] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.247289 28188 catalog_manager.cc:5697] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.250732 28562 consensus_queue.cc:260] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:01.276310 28562 ts_tablet_manager.cc:1434] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:13:01.279799 28562 tablet_bootstrap.cc:492] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:13:01.299039 28562 tablet_bootstrap.cc:654] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.300362 28989 consensus_queue.cc:1048] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.303745 28989 raft_consensus.cc:493] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.304275 28989 raft_consensus.cc:515] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.306392 28989 leader_election.cc:290] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:01.309047 28563 tablet_bootstrap.cc:492] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:01.309686 28563 ts_tablet_manager.cc:1403] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.137s	user 0.032s	sys 0.038s
I20260709 12:13:01.312813 28562 tablet_bootstrap.cc:492] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:13:01.313377 28562 ts_tablet_manager.cc:1403] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 12:13:01.316242 28562 raft_consensus.cc:359] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.316903 28562 raft_consensus.cc:385] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.317195 28562 raft_consensus.cc:740] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.317492 28831 raft_consensus.cc:493] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.318029 28831 raft_consensus.cc:515] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.317885 28562 consensus_queue.cc:260] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.320801 28562 ts_tablet_manager.cc:1434] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:13:01.321321 28831 leader_election.cc:290] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:01.321837 28562 tablet_bootstrap.cc:492] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d: Bootstrap starting.
I20260709 12:13:01.323359 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
W20260709 12:13:01.325158 28408 leader_election.cc:343] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.327445 28563 raft_consensus.cc:359] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.328260 28563 raft_consensus.cc:385] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.328576 28562 tablet_bootstrap.cc:654] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.330755 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:01.328567 28563 raft_consensus.cc:740] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.331593 28286 raft_consensus.cc:2468] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 0.
I20260709 12:13:01.332262 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:01.332003 28563 consensus_queue.cc:260] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.333662 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:01.334369 28442 raft_consensus.cc:2468] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 0.
I20260709 12:13:01.334559 28563 ts_tablet_manager.cc:1434] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:13:01.335638 28563 tablet_bootstrap.cc:492] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:01.336915 28405 leader_election.cc:304] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:01.337815 28989 consensus_queue.cc:1048] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.339134 28882 raft_consensus.cc:2804] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.339543 28882 raft_consensus.cc:493] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.339910 28882 raft_consensus.cc:3060] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.341681 28563 tablet_bootstrap.cc:654] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.345016 28259 leader_election.cc:304] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:01.347512 28777 raft_consensus.cc:2804] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.347595 28839 consensus_queue.cc:1048] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.348249 28777 raft_consensus.cc:493] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.348764 28777 raft_consensus.cc:3060] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.356570 28986 raft_consensus.cc:493] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:01.359059 28259 leader_election.cc:343] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.359338 28986 raft_consensus.cc:515] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.363336 28986 leader_election.cc:290] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:01.371798 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eec19560a14a8db0c4d338da3a1cba" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:01.372737 28441 raft_consensus.cc:2393] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:13:01.376675 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eec19560a14a8db0c4d338da3a1cba" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:01.390161 28482 leader_election.cc:304] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:01.391960 28883 raft_consensus.cc:3060] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.414876 28883 raft_consensus.cc:2749] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.426978 28882 raft_consensus.cc:515] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.430367 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:01.453801 28777 raft_consensus.cc:515] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.456461 28285 raft_consensus.cc:2393] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ce5f603caa48ababe023df3a36c0b4 in current term 1: Already voted for candidate 24654af7758f4a5ebc3e3a8fba0b617a in this term.
I20260709 12:13:01.456826 29025 consensus_queue.cc:1048] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.459744 28188 catalog_manager.cc:5697] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.455237 28882 leader_election.cc:290] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:01.467556 28562 tablet_bootstrap.cc:492] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d: No bootstrap required, opened a new log
I20260709 12:13:01.468164 28562 ts_tablet_manager.cc:1403] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d: Time spent bootstrapping tablet: real 0.147s	user 0.034s	sys 0.021s
I20260709 12:13:01.468329 28777 leader_election.cc:290] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:01.469568 28570 raft_consensus.cc:493] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.470134 28570 raft_consensus.cc:515] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.471263 28562 raft_consensus.cc:359] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.471971 28562 raft_consensus.cc:385] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.472257 28562 raft_consensus.cc:740] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.472283 28570 leader_election.cc:290] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:01.472301 28563 tablet_bootstrap.cc:492] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:01.472995 28562 consensus_queue.cc:260] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.474706 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:01.473971 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:01.480120 28289 raft_consensus.cc:2468] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:13:01.478878 28839 raft_consensus.cc:493] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.473436 28563 ts_tablet_manager.cc:1403] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.138s	user 0.021s	sys 0.027s
I20260709 12:13:01.481467 28839 raft_consensus.cc:515] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
W20260709 12:13:01.480901 28259 consensus_peers.cc:597] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.483880 28839 leader_election.cc:290] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:01.477015 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
W20260709 12:13:01.486140 28334 leader_election.cc:343] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.475937 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:01.487648 28442 raft_consensus.cc:2393] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 24654af7758f4a5ebc3e3a8fba0b617a in current term 1: Already voted for candidate f4ce5f603caa48ababe023df3a36c0b4 in this term.
I20260709 12:13:01.488659 28331 leader_election.cc:304] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:01.488716 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415e5a1b64b14a7d8cc7ec3b64f5cc26" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:01.490945 28839 raft_consensus.cc:2804] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.475633 28562 ts_tablet_manager.cc:1434] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:01.491346 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415e5a1b64b14a7d8cc7ec3b64f5cc26" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:01.491472 28839 raft_consensus.cc:493] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.492306 28839 raft_consensus.cc:3060] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.486182 28563 raft_consensus.cc:359] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.493146 28563 raft_consensus.cc:385] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.493458 28563 raft_consensus.cc:740] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.494158 28563 consensus_queue.cc:260] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.497975 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:01.501020 28334 leader_election.cc:304] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:01.501876 28885 raft_consensus.cc:2749] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.501200 28563 ts_tablet_manager.cc:1434] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:13:01.504151 28563 tablet_bootstrap.cc:492] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:01.506098 28839 raft_consensus.cc:515] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:13:01.504014 28408 leader_election.cc:343] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.509106 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:01.509223 28408 leader_election.cc:304] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
W20260709 12:13:01.510665 28334 leader_election.cc:343] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.510735 28990 raft_consensus.cc:2749] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.512235 28563 tablet_bootstrap.cc:654] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.519237 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:01.520277 28289 raft_consensus.cc:3060] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:01.523167 28259 leader_election.cc:343] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.523720 28259 leader_election.cc:304] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:01.523855 28839 leader_election.cc:290] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:01.525252 29026 raft_consensus.cc:2749] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.525107 28885 consensus_queue.cc:1048] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.528247 29024 raft_consensus.cc:493] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.528841 29024 raft_consensus.cc:515] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.531607 29024 leader_election.cc:290] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:01.537142 28286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:01.539532 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:01.543516 28482 leader_election.cc:304] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:01.544829 29024 raft_consensus.cc:2749] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.552517 28570 consensus_queue.cc:1048] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.562131 28190 catalog_manager.cc:5697] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 1, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 1 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.565264 28289 raft_consensus.cc:2468] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:01.581410 28331 leader_election.cc:304] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:01.582346 28839 raft_consensus.cc:2804] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.582937 28839 raft_consensus.cc:697] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:01.583771 28839 consensus_queue.cc:237] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.588632 28563 tablet_bootstrap.cc:492] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:01.589352 28563 ts_tablet_manager.cc:1403] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.085s	user 0.034s	sys 0.032s
I20260709 12:13:01.592147 28563 raft_consensus.cc:359] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.593708 28563 raft_consensus.cc:385] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.594019 28563 raft_consensus.cc:740] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.595070 28563 consensus_queue.cc:260] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.598300 28563 ts_tablet_manager.cc:1434] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:13:01.599556 28563 tablet_bootstrap.cc:492] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:01.605293 28563 tablet_bootstrap.cc:654] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.610589 28366 raft_consensus.cc:3060] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.616995 28563 tablet_bootstrap.cc:492] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:01.617682 28563 ts_tablet_manager.cc:1403] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.009s
I20260709 12:13:01.620220 28563 raft_consensus.cc:359] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.620976 28563 raft_consensus.cc:385] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.621325 28563 raft_consensus.cc:740] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.622196 28563 consensus_queue.cc:260] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.623673 28839 raft_consensus.cc:493] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.624284 28839 raft_consensus.cc:515] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.625028 28563 ts_tablet_manager.cc:1434] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:01.626147 28563 tablet_bootstrap.cc:492] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:01.627815 28189 catalog_manager.cc:5697] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.630200 28839 leader_election.cc:290] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:01.631354 29024 raft_consensus.cc:493] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.631883 29024 raft_consensus.cc:515] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.633935 29024 leader_election.cc:290] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:01.634608 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:01.636152 28563 tablet_bootstrap.cc:654] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:01.636307 28334 leader_election.cc:343] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.636864 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:01.637730 28289 raft_consensus.cc:2393] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:13:01.646198 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:01.647748 28440 raft_consensus.cc:2468] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 0.
I20260709 12:13:01.648939 28334 leader_election.cc:304] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:01.650090 28839 raft_consensus.cc:2804] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.650543 28839 raft_consensus.cc:493] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.650949 28839 raft_consensus.cc:3060] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.657734 29024 raft_consensus.cc:493] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.658336 29024 raft_consensus.cc:515] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:01.658839 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:01.660514 29024 leader_election.cc:290] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:01.661336 28481 leader_election.cc:304] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:01.661670 28289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:01.662667 28289 raft_consensus.cc:2393] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate 24654af7758f4a5ebc3e3a8fba0b617a in this term.
I20260709 12:13:01.663371 29024 raft_consensus.cc:3060] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.663523 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:01.664501 28440 raft_consensus.cc:2393] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate f4ce5f603caa48ababe023df3a36c0b4 in this term.
I20260709 12:13:01.665541 28482 leader_election.cc:304] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:01.666365 28986 raft_consensus.cc:3060] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.670914 29024 raft_consensus.cc:2749] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.672850 28563 tablet_bootstrap.cc:492] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:01.673493 28563 ts_tablet_manager.cc:1403] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.010s
I20260709 12:13:01.677939 28986 raft_consensus.cc:2749] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.692523 28563 raft_consensus.cc:359] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.693424 28563 raft_consensus.cc:385] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:01.693620 28259 consensus_peers.cc:597] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a -> Peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Couldn't send request to peer 1be5ce5bff4b443ea67188eb0de32215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.693783 28563 raft_consensus.cc:740] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.694648 28563 consensus_queue.cc:260] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:01.697037 28563 ts_tablet_manager.cc:1434] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 12:13:01.698364 28563 tablet_bootstrap.cc:492] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215: Bootstrap starting.
I20260709 12:13:01.700467 28839 raft_consensus.cc:515] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.703191 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:01.703807 28440 raft_consensus.cc:3060] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.704998 28563 tablet_bootstrap.cc:654] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.712913 28440 raft_consensus.cc:2468] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:01.713285 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:01.713728 28563 tablet_bootstrap.cc:492] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215: No bootstrap required, opened a new log
I20260709 12:13:01.714272 28563 ts_tablet_manager.cc:1403] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:13:01.714639 28839 leader_election.cc:290] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
W20260709 12:13:01.714897 28334 leader_election.cc:343] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.716763 28334 leader_election.cc:304] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:01.716985 28563 raft_consensus.cc:359] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.717697 28563 raft_consensus.cc:385] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.717993 28563 raft_consensus.cc:740] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.718386 28885 raft_consensus.cc:2804] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.718931 28885 raft_consensus.cc:697] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:01.718967 28563 consensus_queue.cc:260] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.719887 28885 consensus_queue.cc:237] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.721306 28563 ts_tablet_manager.cc:1434] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:01.732185 28191 catalog_manager.cc:5697] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 0 to 1, leader changed from <none> to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 1 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.815127 28942 consensus_queue.cc:1048] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.837097 29024 raft_consensus.cc:493] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.837641 29024 raft_consensus.cc:515] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:01.839792 29024 leader_election.cc:290] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:01.840373 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:01.840642 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:01.841660 28440 raft_consensus.cc:2393] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 1: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:13:01.842643 28482 leader_election.cc:304] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:01.843294 29024 raft_consensus.cc:3060] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.850733 29024 raft_consensus.cc:2749] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.917773 28513 raft_consensus.cc:3060] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.065722 29024 raft_consensus.cc:493] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.066231 29024 raft_consensus.cc:515] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:02.068382 29024 leader_election.cc:290] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:02.069110 28285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:02.069360 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:02.070732 28479 leader_election.cc:304] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:02.071380 29024 raft_consensus.cc:2749] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.075356 28885 consensus_queue.cc:1048] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.092290 28839 consensus_queue.cc:1048] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.184420 28513 raft_consensus.cc:3060] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:02.214704 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:02.298733 28570 consensus_queue.cc:1048] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.311473 28839 consensus_queue.cc:1048] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:03.253316 28238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:03.346863 29048 raft_consensus.cc:493] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.347399 29048 raft_consensus.cc:515] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:03.349514 29048 leader_election.cc:290] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:03.350230 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:03.350476 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:03.350939 28440 raft_consensus.cc:2468] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:13:03.351267 28512 raft_consensus.cc:2468] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 1.
I20260709 12:13:03.352203 28259 leader_election.cc:304] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:03.353605 29048 raft_consensus.cc:2804] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:03.353966 29048 raft_consensus.cc:493] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.354307 29048 raft_consensus.cc:3060] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.361483 29048 raft_consensus.cc:515] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:03.363322 29048 leader_election.cc:290] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:03.363783 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:03.364197 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:03.364454 28440 raft_consensus.cc:3060] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.364825 28512 raft_consensus.cc:3060] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.371493 28440 raft_consensus.cc:2468] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:03.372597 28259 leader_election.cc:304] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:03.372958 28512 raft_consensus.cc:2468] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:03.373286 29048 raft_consensus.cc:2804] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:03.373813 29048 raft_consensus.cc:697] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:03.374600 29048 consensus_queue.cc:237] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:03.384088 28190 catalog_manager.cc:5697] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 0 to 2, leader changed from <none> to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.901201 28512 raft_consensus.cc:1275] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:03.904336 29025 consensus_queue.cc:1048] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.911758 20705 tablet_server.cc:179] TabletServer@127.20.56.65:0 shutting down...
I20260709 12:13:03.926636 28440 raft_consensus.cc:1275] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:13:03.930069 28479 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:03.932833 29025 consensus_queue.cc:1048] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:03.942745 28405 consensus_peers.cc:597] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:03.953436 28405 consensus_peers.cc:597] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:03.977483 28479 consensus_peers.cc:597] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:03.985486 28405 consensus_peers.cc:597] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:03.986223 28405 consensus_peers.cc:597] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.003453 28479 consensus_peers.cc:597] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.011945 28479 consensus_peers.cc:597] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.018122 28405 consensus_peers.cc:597] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.019243 28331 consensus_peers.cc:597] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.021076 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:04.021938 20705 tablet_replica.cc:333] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.022876 20705 raft_consensus.cc:2243] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.023910 20705 raft_consensus.cc:2272] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.026261 20705 tablet_replica.cc:333] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.027034 20705 raft_consensus.cc:2243] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.027529 20705 raft_consensus.cc:2272] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.029966 20705 tablet_replica.cc:333] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.030843 20705 raft_consensus.cc:2243] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:04.031070 28331 consensus_peers.cc:597] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.032790 20705 raft_consensus.cc:2272] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.035214 20705 tablet_replica.cc:333] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.035877 20705 raft_consensus.cc:2243] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.036331 20705 raft_consensus.cc:2272] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.038647 20705 tablet_replica.cc:333] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.039418 20705 raft_consensus.cc:2243] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.039884 20705 raft_consensus.cc:2272] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.041917 20705 tablet_replica.cc:333] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.042578 20705 raft_consensus.cc:2243] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.043370 20705 raft_consensus.cc:2272] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.045838 20705 tablet_replica.cc:333] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.046684 20705 raft_consensus.cc:2243] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.047192 20705 raft_consensus.cc:2272] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.049628 20705 tablet_replica.cc:333] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.050455 20705 raft_consensus.cc:2243] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.052155 20705 raft_consensus.cc:2272] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:04.052449 28405 consensus_peers.cc:597] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.054306 20705 tablet_replica.cc:333] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.055148 20705 raft_consensus.cc:2243] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.055991 20705 raft_consensus.cc:2272] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.058866 20705 tablet_replica.cc:333] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.059715 20705 raft_consensus.cc:2243] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.060242 20705 raft_consensus.cc:2272] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.062741 20705 tablet_replica.cc:333] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.063647 20705 raft_consensus.cc:2243] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.064518 20705 raft_consensus.cc:2272] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.066793 20705 tablet_replica.cc:333] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.067400 20705 raft_consensus.cc:2243] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.068150 20705 raft_consensus.cc:2272] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.070711 20705 tablet_replica.cc:333] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.071527 20705 raft_consensus.cc:2243] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.072069 20705 raft_consensus.cc:2272] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.074733 20705 tablet_replica.cc:333] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.075639 20705 raft_consensus.cc:2243] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.076185 20705 raft_consensus.cc:2272] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.078122 20705 tablet_replica.cc:333] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.078826 20705 raft_consensus.cc:2243] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.079206 20705 raft_consensus.cc:2272] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.081374 20705 tablet_replica.cc:333] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.082000 20705 raft_consensus.cc:2243] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.082499 20705 raft_consensus.cc:2272] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.084741 20705 tablet_replica.cc:333] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.085469 20705 raft_consensus.cc:2243] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.085976 20705 raft_consensus.cc:2272] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:04.087788 28405 consensus_peers.cc:597] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.088352 20705 tablet_replica.cc:333] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.089032 20705 raft_consensus.cc:2243] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.089462 20705 raft_consensus.cc:2272] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.091347 20705 tablet_replica.cc:333] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.091941 20705 raft_consensus.cc:2243] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.092738 20705 raft_consensus.cc:2272] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.094584 20705 tablet_replica.cc:333] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.095171 20705 raft_consensus.cc:2243] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.095957 20705 raft_consensus.cc:2272] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.097847 20705 tablet_replica.cc:333] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.098603 20705 raft_consensus.cc:2243] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.099401 20705 raft_consensus.cc:2272] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.101403 20705 tablet_replica.cc:333] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.102015 20705 raft_consensus.cc:2243] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.102857 20705 raft_consensus.cc:2272] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.104776 20705 tablet_replica.cc:333] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.105335 20705 raft_consensus.cc:2243] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.105827 20705 raft_consensus.cc:2272] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.107710 20705 tablet_replica.cc:333] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.108278 20705 raft_consensus.cc:2243] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.108728 20705 raft_consensus.cc:2272] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.110606 20705 tablet_replica.cc:333] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.111361 20705 raft_consensus.cc:2243] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.111840 20705 raft_consensus.cc:2272] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.113989 20705 tablet_replica.cc:333] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.114728 20705 raft_consensus.cc:2243] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.115106 20705 raft_consensus.cc:2272] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.116927 20705 tablet_replica.cc:333] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.117456 20705 raft_consensus.cc:2243] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.118196 20705 raft_consensus.cc:2272] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.120133 20705 tablet_replica.cc:333] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.120951 20705 raft_consensus.cc:2243] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.121932 20705 raft_consensus.cc:2272] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:04.123595 28331 consensus_peers.cc:597] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.124714 20705 tablet_replica.cc:333] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.125610 20705 raft_consensus.cc:2243] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.126132 20705 raft_consensus.cc:2272] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.128695 20705 tablet_replica.cc:333] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.129437 20705 raft_consensus.cc:2243] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.130604 20705 raft_consensus.cc:2272] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.133514 20705 tablet_replica.cc:333] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
W20260709 12:13:04.134006 28405 consensus_peers.cc:597] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.134214 20705 raft_consensus.cc:2243] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.135249 20705 raft_consensus.cc:2272] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.137583 20705 tablet_replica.cc:333] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.138314 20705 raft_consensus.cc:2243] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.138883 20705 raft_consensus.cc:2272] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.141065 20705 tablet_replica.cc:333] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.141651 20705 raft_consensus.cc:2243] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.142112 20705 raft_consensus.cc:2272] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.144819 20705 tablet_replica.cc:333] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.145618 20705 raft_consensus.cc:2243] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.146126 20705 raft_consensus.cc:2272] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.148878 20705 tablet_replica.cc:333] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.149596 20705 raft_consensus.cc:2243] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.150110 20705 raft_consensus.cc:2272] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.151901 20705 tablet_replica.cc:333] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.152375 20705 raft_consensus.cc:2243] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.152743 20705 raft_consensus.cc:2272] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.154701 20705 tablet_replica.cc:333] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.155256 20705 raft_consensus.cc:2243] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.155984 20705 raft_consensus.cc:2272] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.157832 20705 tablet_replica.cc:333] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.158300 20705 raft_consensus.cc:2243] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.158725 20705 raft_consensus.cc:2272] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.160492 20705 tablet_replica.cc:333] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.160974 20705 raft_consensus.cc:2243] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.161326 20705 raft_consensus.cc:2272] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.163060 20705 tablet_replica.cc:333] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.163525 20705 raft_consensus.cc:2243] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.163972 20705 raft_consensus.cc:2272] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.166316 20705 tablet_replica.cc:333] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.166921 20705 raft_consensus.cc:2243] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.167711 20705 raft_consensus.cc:2272] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.169596 20705 tablet_replica.cc:333] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.170143 20705 raft_consensus.cc:2243] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.170603 20705 raft_consensus.cc:2272] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.172546 20705 tablet_replica.cc:333] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.173209 20705 raft_consensus.cc:2243] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.173674 20705 raft_consensus.cc:2272] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.175540 20705 tablet_replica.cc:333] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.176213 20705 raft_consensus.cc:2243] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:04.177141 20705 raft_consensus.cc:2272] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.179558 20705 tablet_replica.cc:333] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: stopping tablet replica
I20260709 12:13:04.180099 20705 raft_consensus.cc:2243] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.180543 20705 raft_consensus.cc:2272] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:04.186708 28331 consensus_peers.cc:597] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.205601 28331 consensus_peers.cc:597] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.215044 28405 consensus_peers.cc:597] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.229164 28405 consensus_peers.cc:597] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.236079 28405 consensus_peers.cc:597] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.240414 28479 consensus_peers.cc:597] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.241956 28405 consensus_peers.cc:597] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.249339 20705 tablet_server.cc:196] TabletServer@127.20.56.65:0 shutdown complete.
W20260709 12:13:04.286355 28479 consensus_peers.cc:597] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.299806 28405 consensus_peers.cc:597] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.328821 28479 consensus_peers.cc:597] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:04.329361 28479 consensus_peers.cc:597] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.333022 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:04.341331 29067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:04.342734 29068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:04.343429 29070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:04.343773 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:04.347723 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:04.348004 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:04.348209 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599184348188 us; error 0 us; skew 500 ppm
I20260709 12:13:04.348881 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:04.351724 20705 webserver.cc:533] Webserver started at http://127.20.56.65:35411/ using document root <none> and password file <none>
I20260709 12:13:04.352232 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:04.352537 20705 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:13:04.357832 20705 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:13:04.368930 29075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:04.370029 20705 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:13:04.370457 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
format_stamp: "Formatted at 2026-07-09 12:12:50 on dist-test-slave-2dwh"
I20260709 12:13:04.371012 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:04.386116 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:04.387409 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 12:13:04.404947 28405 consensus_peers.cc:597] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.420943 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:13:04.433385 28405 consensus_peers.cc:597] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.434159 29084 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:13:04.717235 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:13:04.717553 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.285s	user 0.007s	sys 0.002s
I20260709 12:13:04.717888 20705 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:13:04.724575 29084 tablet_bootstrap.cc:492] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.738555 29084 tablet_bootstrap.cc:492] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.739331 29084 tablet_bootstrap.cc:492] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:04.739880 29084 ts_tablet_manager.cc:1403] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:13:04.741881 29084 raft_consensus.cc:359] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.742414 29084 raft_consensus.cc:740] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.743170 29084 consensus_queue.cc:260] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.745280 29084 ts_tablet_manager.cc:1434] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.005s
I20260709 12:13:04.745970 29084 tablet_bootstrap.cc:492] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.771117 29084 tablet_bootstrap.cc:492] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.772099 29084 tablet_bootstrap.cc:492] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:04.772753 29084 ts_tablet_manager.cc:1403] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 12:13:04.775324 29084 raft_consensus.cc:359] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:04.775981 29084 raft_consensus.cc:740] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.776654 29084 consensus_queue.cc:260] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:04.778491 29084 ts_tablet_manager.cc:1434] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:13:04.779284 29084 tablet_bootstrap.cc:492] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.795395 29084 tablet_bootstrap.cc:492] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.796326 29084 tablet_bootstrap.cc:492] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:04.797145 29084 ts_tablet_manager.cc:1403] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:13:04.799779 29084 raft_consensus.cc:359] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:04.800433 29084 raft_consensus.cc:740] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.801079 29084 consensus_queue.cc:260] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:04.802919 29084 ts_tablet_manager.cc:1434] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:04.803740 29084 tablet_bootstrap.cc:492] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.832613 29084 tablet_bootstrap.cc:492] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.833571 29084 tablet_bootstrap.cc:492] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:04.834190 29084 ts_tablet_manager.cc:1403] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 12:13:04.841482 29084 raft_consensus.cc:359] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:04.842165 29084 raft_consensus.cc:740] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.844835 29084 consensus_queue.cc:260] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:04.849789 29084 ts_tablet_manager.cc:1434] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:04.850602 29084 tablet_bootstrap.cc:492] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.875749 29084 tablet_bootstrap.cc:492] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.876515 29084 tablet_bootstrap.cc:492] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:04.877050 29084 ts_tablet_manager.cc:1403] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.004s
I20260709 12:13:04.878829 29084 raft_consensus.cc:359] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:04.879334 29084 raft_consensus.cc:740] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.879987 29084 consensus_queue.cc:260] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:04.881441 29084 ts_tablet_manager.cc:1434] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:04.882109 29084 tablet_bootstrap.cc:492] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.893013 29084 tablet_bootstrap.cc:492] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.893980 29084 tablet_bootstrap.cc:492] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:04.894639 29084 ts_tablet_manager.cc:1403] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:13:04.900007 29084 raft_consensus.cc:359] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:04.900695 29084 raft_consensus.cc:740] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.901342 29084 consensus_queue.cc:260] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:04.904248 29084 ts_tablet_manager.cc:1434] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 12:13:04.905071 29084 tablet_bootstrap.cc:492] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.922070 29084 tablet_bootstrap.cc:492] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.923146 29084 tablet_bootstrap.cc:492] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:04.923879 29084 ts_tablet_manager.cc:1403] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:13:04.926343 29084 raft_consensus.cc:359] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.927062 29084 raft_consensus.cc:740] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.927727 29084 consensus_queue.cc:260] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.929450 29084 ts_tablet_manager.cc:1434] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:13:04.930279 29084 tablet_bootstrap.cc:492] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.942087 29084 tablet_bootstrap.cc:492] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.943019 29084 tablet_bootstrap.cc:492] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:04.943619 29084 ts_tablet_manager.cc:1403] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:13:04.946020 29084 raft_consensus.cc:359] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.946681 29084 raft_consensus.cc:740] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.947382 29084 consensus_queue.cc:260] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.949155 29084 ts_tablet_manager.cc:1434] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:04.949968 29084 tablet_bootstrap.cc:492] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.964510 29084 tablet_bootstrap.cc:492] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.965462 29084 tablet_bootstrap.cc:492] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:04.966136 29084 ts_tablet_manager.cc:1403] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 12:13:04.967975 29084 raft_consensus.cc:359] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.968547 29084 raft_consensus.cc:740] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.969162 29084 consensus_queue.cc:260] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.970407 29082 raft_consensus.cc:493] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:04.970796 29084 ts_tablet_manager.cc:1434] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:04.971030 29082 raft_consensus.cc:515] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.971666 29084 tablet_bootstrap.cc:492] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:04.974030 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
W20260709 12:13:04.978808 28479 leader_election.cc:336] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111)
I20260709 12:13:04.979321 28479 leader_election.cc:304] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:04.980095 29080 raft_consensus.cc:2749] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:04.978210 29082 leader_election.cc:290] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:04.991693 20705 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:13:04.992167 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.274s	user 0.242s	sys 0.013s
I20260709 12:13:04.992267 29080 raft_consensus.cc:493] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:04.992784 29080 raft_consensus.cc:515] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:04.996515 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:04.997123 29084 tablet_bootstrap.cc:492] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:04.999650 29080 leader_election.cc:290] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.004904 29084 tablet_bootstrap.cc:492] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.005676 29084 ts_tablet_manager.cc:1403] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.016s
W20260709 12:13:05.006444 28479 leader_election.cc:336] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111)
I20260709 12:13:05.006915 28479 leader_election.cc:304] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:05.007818 29080 raft_consensus.cc:2749] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:05.008175 29084 raft_consensus.cc:359] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.008972 29084 raft_consensus.cc:740] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.009718 29084 consensus_queue.cc:260] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.012121 29084 ts_tablet_manager.cc:1434] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:05.012948 29084 tablet_bootstrap.cc:492] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.036374 29084 tablet_bootstrap.cc:492] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.037379 29084 tablet_bootstrap.cc:492] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.038054 29084 ts_tablet_manager.cc:1403] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 12:13:05.040426 29084 raft_consensus.cc:359] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.041146 29084 raft_consensus.cc:740] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.041977 29084 consensus_queue.cc:260] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.043934 29084 ts_tablet_manager.cc:1434] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:05.044706 29084 tablet_bootstrap.cc:492] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.060451 29084 tablet_bootstrap.cc:492] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.061501 29084 tablet_bootstrap.cc:492] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.062173 29084 ts_tablet_manager.cc:1403] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 12:13:05.064208 29084 raft_consensus.cc:359] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.064742 29084 raft_consensus.cc:740] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.065429 29084 consensus_queue.cc:260] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.067111 29084 ts_tablet_manager.cc:1434] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:05.067845 29084 tablet_bootstrap.cc:492] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.085974 29084 tablet_bootstrap.cc:492] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.087009 29084 tablet_bootstrap.cc:492] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.087644 29084 ts_tablet_manager.cc:1403] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:13:05.089756 29084 raft_consensus.cc:359] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.090520 29084 raft_consensus.cc:740] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.091288 29084 consensus_queue.cc:260] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.093554 29084 ts_tablet_manager.cc:1434] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:05.094468 29084 tablet_bootstrap.cc:492] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.099922 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:41545
I20260709 12:13:05.100049 29157 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:41545 every 8 connection(s)
I20260709 12:13:05.112546 29084 tablet_bootstrap.cc:492] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.116053 29084 tablet_bootstrap.cc:492] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.118398 29084 ts_tablet_manager.cc:1403] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 12:13:05.119832 29080 raft_consensus.cc:493] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.120597 29080 raft_consensus.cc:515] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.121343 29084 raft_consensus.cc:359] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.122510 29084 raft_consensus.cc:740] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.123219 29084 consensus_queue.cc:260] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.123559 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:05.125402 29084 ts_tablet_manager.cc:1434] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:05.125757 29080 leader_election.cc:290] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.126343 29084 tablet_bootstrap.cc:492] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.157152 29084 tablet_bootstrap.cc:492] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.158254 29084 tablet_bootstrap.cc:492] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.160096 29084 ts_tablet_manager.cc:1403] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.023s
I20260709 12:13:05.162842 29084 raft_consensus.cc:359] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.163564 29084 raft_consensus.cc:740] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.164296 29084 consensus_queue.cc:260] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.166299 29084 ts_tablet_manager.cc:1434] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:13:05.167045 29084 tablet_bootstrap.cc:492] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.178325 29158 heartbeater.cc:344] Connected to a master server at 127.20.56.126:36629
I20260709 12:13:05.178856 29158 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:05.179852 29158 heartbeater.cc:507] Master 127.20.56.126:36629 requested a full tablet report, sending...
I20260709 12:13:05.199008 28191 ts_manager.cc:194] Re-registered known tserver with Master: 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.199461 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
W20260709 12:13:05.204268 28479 leader_election.cc:343] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.206713 29082 raft_consensus.cc:493] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.207369 29082 raft_consensus.cc:515] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.204830 28479 leader_election.cc:304] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:05.209411 29082 leader_election.cc:290] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.209599 29080 raft_consensus.cc:2749] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:05.212448 29084 tablet_bootstrap.cc:492] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.213455 29084 tablet_bootstrap.cc:492] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.214134 29084 ts_tablet_manager.cc:1403] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.027s
I20260709 12:13:05.214897 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:05.216790 29084 raft_consensus.cc:359] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.217561 29084 raft_consensus.cc:740] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.218488 29080 raft_consensus.cc:493] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.218284 29084 consensus_queue.cc:260] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.219022 29080 raft_consensus.cc:515] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.220698 29084 ts_tablet_manager.cc:1434] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:05.221586 29084 tablet_bootstrap.cc:492] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.222013 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.222312 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
W20260709 12:13:05.223804 28479 leader_election.cc:343] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.224215 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.224229 28479 leader_election.cc:304] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:05.227553 29082 raft_consensus.cc:2749] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:05.227612 28479 leader_election.cc:343] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.228236 29080 leader_election.cc:290] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.228456 28479 leader_election.cc:304] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:05.230017 29080 raft_consensus.cc:2749] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:05.236307 29084 tablet_bootstrap.cc:492] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.237115 29084 tablet_bootstrap.cc:492] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.237668 29084 ts_tablet_manager.cc:1403] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:13:05.239701 29084 raft_consensus.cc:359] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.240242 29084 raft_consensus.cc:740] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.240808 29084 consensus_queue.cc:260] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.242300 29084 ts_tablet_manager.cc:1434] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:05.243209 29084 tablet_bootstrap.cc:492] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.248745 28191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42872
I20260709 12:13:05.253710 29158 heartbeater.cc:499] Master 127.20.56.126:36629 was elected leader, sending a full tablet report...
I20260709 12:13:05.257174 29064 raft_consensus.cc:493] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.257491 29084 tablet_bootstrap.cc:492] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.257812 29064 raft_consensus.cc:515] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.258366 29084 tablet_bootstrap.cc:492] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.259088 29084 ts_tablet_manager.cc:1403] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:13:05.260398 29064 leader_election.cc:290] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.261549 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.261772 29084 raft_consensus.cc:359] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.261876 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.262276 28515 raft_consensus.cc:2468] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:05.262532 29084 raft_consensus.cc:740] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.263257 29084 consensus_queue.cc:260] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
W20260709 12:13:05.263638 28331 leader_election.cc:343] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.264771 28334 leader_election.cc:304] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:05.265403 29084 ts_tablet_manager.cc:1434] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:05.265542 28570 raft_consensus.cc:2804] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.265970 28570 raft_consensus.cc:493] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.266376 29084 tablet_bootstrap.cc:492] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.266283 28570 raft_consensus.cc:3060] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.270718 29092 raft_consensus.cc:493] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.271340 29092 raft_consensus.cc:515] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.274192 29062 raft_consensus.cc:493] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.274946 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.275589 28515 raft_consensus.cc:2468] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:13:05.276702 28408 leader_election.cc:304] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:05.274772 29062 raft_consensus.cc:515] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.277521 28882 raft_consensus.cc:2804] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.278204 28882 raft_consensus.cc:493] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.278661 28882 raft_consensus.cc:3060] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.279225 29062 leader_election.cc:290] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.276067 29092 leader_election.cc:290] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.284782 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
W20260709 12:13:05.287163 28405 leader_election.cc:343] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.289184 29046 raft_consensus.cc:493] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.290879 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:05.289964 29046 raft_consensus.cc:515] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.296010 29046 leader_election.cc:290] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.296981 28407 leader_election.cc:304] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:05.297925 29046 raft_consensus.cc:2749] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:05.305611 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.277511 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.308851 29132 raft_consensus.cc:2468] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:13:05.316447 29064 raft_consensus.cc:493] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.316684 29092 raft_consensus.cc:493] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.317077 29064 raft_consensus.cc:515] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.317346 29092 raft_consensus.cc:515] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.318953 29084 tablet_bootstrap.cc:492] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.319620 29092 leader_election.cc:290] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.319932 29084 tablet_bootstrap.cc:492] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.320115 29064 leader_election.cc:290] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:05.320698 29084 ts_tablet_manager.cc:1403] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.004s
I20260709 12:13:05.322597 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.323311 28515 raft_consensus.cc:2468] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:13:05.325604 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:05.326288 28442 raft_consensus.cc:2468] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:05.327075 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.328603 28408 leader_election.cc:304] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:05.329412 29084 raft_consensus.cc:359] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
W20260709 12:13:05.330101 28331 leader_election.cc:343] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.330631 29080 raft_consensus.cc:493] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.331166 29080 raft_consensus.cc:515] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.329377 29092 raft_consensus.cc:2804] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.332072 29092 raft_consensus.cc:493] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.332460 29092 raft_consensus.cc:3060] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.333310 29080 leader_election.cc:290] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.334743 29062 raft_consensus.cc:493] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.335273 29062 raft_consensus.cc:515] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.337754 28882 raft_consensus.cc:515] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.339313 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:05.337771 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.343653 29132 raft_consensus.cc:2468] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:13:05.344983 28479 leader_election.cc:304] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:05.345850 29080 raft_consensus.cc:2804] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.346506 29062 leader_election.cc:290] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.346561 29082 raft_consensus.cc:493] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.347426 29082 raft_consensus.cc:515] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.349198 28882 leader_election.cc:290] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.349572 29082 leader_election.cc:290] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.330295 29084 raft_consensus.cc:740] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.350474 28334 leader_election.cc:304] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:05.350732 29084 consensus_queue.cc:260] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.351397 28885 raft_consensus.cc:493] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.351953 28885 raft_consensus.cc:515] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.352180 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:05.352180 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:05.352586 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.352948 28515 raft_consensus.cc:3060] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.354192 28885 leader_election.cc:290] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
W20260709 12:13:05.354081 28479 leader_election.cc:343] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.352247 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:05.357223 28479 leader_election.cc:304] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:05.355858 29130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.358039 29082 raft_consensus.cc:2749] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:05.359046 28331 leader_election.cc:343] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.359491 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.359686 28885 raft_consensus.cc:493] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.360250 28885 raft_consensus.cc:515] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.346582 29080 raft_consensus.cc:493] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.361539 29080 raft_consensus.cc:3060] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.354918 29064 raft_consensus.cc:2804] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.362346 29064 raft_consensus.cc:493] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.362798 29064 raft_consensus.cc:3060] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.363801 29084 ts_tablet_manager.cc:1434] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.004s
I20260709 12:13:05.365643 29084 tablet_bootstrap.cc:492] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.365831 29130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.366523 29130 raft_consensus.cc:2468] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:05.364629 28515 raft_consensus.cc:2468] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 2.
I20260709 12:13:05.339618 28570 raft_consensus.cc:515] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.367607 28331 leader_election.cc:304] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:05.367792 28408 leader_election.cc:304] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:05.368637 29046 raft_consensus.cc:2804] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.369100 29046 raft_consensus.cc:697] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 2 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:13:05.369920 29046 consensus_queue.cc:237] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.370736 28885 leader_election.cc:290] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:05.371304 28885 raft_consensus.cc:493] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.371779 28885 raft_consensus.cc:515] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.372812 29130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.379894 29129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.385602 29024 raft_consensus.cc:493] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.386181 29024 raft_consensus.cc:515] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.392271 29024 leader_election.cc:290] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.393606 29129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.397486 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.373991 28885 leader_election.cc:290] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.398277 29129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22aef3d88a14b85bdb3763051f26d0f" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.398996 29129 raft_consensus.cc:3060] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.400262 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:05.400942 28442 raft_consensus.cc:2468] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:13:05.397559 29130 raft_consensus.cc:2468] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:13:05.402381 28570 leader_election.cc:290] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.402931 29024 raft_consensus.cc:493] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.403335 28482 leader_election.cc:304] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:05.403429 29024 raft_consensus.cc:515] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.404481 29082 raft_consensus.cc:2804] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.404868 29082 raft_consensus.cc:493] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.405213 29082 raft_consensus.cc:3060] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.406159 29024 leader_election.cc:290] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.346001 29092 raft_consensus.cc:515] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.406339 29064 raft_consensus.cc:515] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.398952 28885 raft_consensus.cc:2804] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.407522 28885 raft_consensus.cc:493] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.410997 28885 raft_consensus.cc:3060] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.412539 29130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.413445 29080 raft_consensus.cc:515] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.410149 29129 raft_consensus.cc:2468] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 2.
I20260709 12:13:05.408385 29092 leader_election.cc:290] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.413551 29130 raft_consensus.cc:2468] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:13:05.418665 28479 leader_election.cc:304] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:05.419243 29024 raft_consensus.cc:493] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.419849 29024 raft_consensus.cc:515] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.408533 29064 leader_election.cc:290] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:05.422899 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:05.422024 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:05.425119 28885 raft_consensus.cc:515] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.425343 29178 raft_consensus.cc:2804] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.426026 29178 raft_consensus.cc:493] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.426524 29178 raft_consensus.cc:3060] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.428117 29024 leader_election.cc:290] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.428543 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:05.429224 28515 raft_consensus.cc:3060] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.429642 29130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
W20260709 12:13:05.433990 28479 leader_election.cc:343] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.434551 29084 tablet_bootstrap.cc:492] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.435695 29084 tablet_bootstrap.cc:492] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.436519 29084 ts_tablet_manager.cc:1403] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.000s
I20260709 12:13:05.427264 28885 leader_election.cc:290] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:05.435573 29080 leader_election.cc:290] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.439109 29130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.440244 29130 raft_consensus.cc:3060] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.439936 29084 raft_consensus.cc:359] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.440917 29084 raft_consensus.cc:740] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.441917 29084 consensus_queue.cc:260] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.444010 29082 raft_consensus.cc:515] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.446621 29082 leader_election.cc:290] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.447538 29084 ts_tablet_manager.cc:1434] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:13:05.448544 29084 tablet_bootstrap.cc:492] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:05.450363 29130 raft_consensus.cc:2468] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:05.450832 29178 raft_consensus.cc:515] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.453195 29178 leader_election.cc:290] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
W20260709 12:13:05.490204 28331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 122415us
I20260709 12:13:05.492465 28334 leader_election.cc:304] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:05.508548 28882 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.509810 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:05.510833 28570 raft_consensus.cc:493] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.510185 28882 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.511364 28442 raft_consensus.cc:2468] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:05.511658 28570 raft_consensus.cc:515] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.513926 28882 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.513922 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:05.514339 28570 leader_election.cc:290] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.515079 28441 raft_consensus.cc:3060] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.515451 28885 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.516526 28885 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.537206 28885 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
W20260709 12:13:05.537629 28334 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:33813, user_credentials={real_user=slave}} blocked reactor thread for 45770.1us
I20260709 12:13:05.538911 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:05.539809 28442 raft_consensus.cc:3060] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.539987 29092 raft_consensus.cc:493] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.540256 29082 raft_consensus.cc:493] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.540971 29092 raft_consensus.cc:515] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.541106 29082 raft_consensus.cc:515] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.547356 29129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.548369 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.548288 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f42083a394141ba0bc9cd40ea7f40" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.568068 29132 raft_consensus.cc:3060] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.564447 29092 leader_election.cc:290] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.569944 28515 raft_consensus.cc:2468] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 2.
I20260709 12:13:05.550061 28479 leader_election.cc:304] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:05.549150 28482 leader_election.cc:304] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:05.551307 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.551438 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50082d48fcb84e1487323de1942cbbda" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.551656 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8664110bc84069a332ebad298106ac" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.552489 29064 raft_consensus.cc:2749] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:05.553364 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.556954 29046 raft_consensus.cc:493] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.562923 29174 raft_consensus.cc:493] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.566186 29129 raft_consensus.cc:2468] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:05.590027 28441 raft_consensus.cc:2468] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:05.590559 28442 raft_consensus.cc:2468] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:05.596661 29174 raft_consensus.cc:515] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.598843 29124 raft_consensus.cc:3060] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.600454 29174 leader_election.cc:290] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.602648 29125 raft_consensus.cc:3060] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.604394 29179 raft_consensus.cc:2804] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:05.604945 29179 raft_consensus.cc:493] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
W20260709 12:13:05.603009 28405 leader_election.cc:343] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.605611 29179 raft_consensus.cc:3060] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:05.607272 28479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 57674.8us
I20260709 12:13:05.607859 29184 raft_consensus.cc:493] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.608762 29184 raft_consensus.cc:515] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.609552 29080 raft_consensus.cc:493] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.610335 29080 raft_consensus.cc:515] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.593900 29046 raft_consensus.cc:515] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.612507 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.612984 29080 leader_election.cc:290] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.613406 29128 raft_consensus.cc:2468] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:13:05.615567 28479 leader_election.cc:304] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:05.617215 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.613481 29046 leader_election.cc:290] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
W20260709 12:13:05.619779 28482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 71056.4us
I20260709 12:13:05.594170 29131 raft_consensus.cc:3060] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:05.626143 28479 leader_election.cc:343] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.622270 29080 raft_consensus.cc:2804] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.629181 28512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.633397 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.633880 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.634040 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41a2a37b60547569fea429a0ebaf169" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:05.634202 28513 raft_consensus.cc:2468] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:05.634907 28515 raft_consensus.cc:3060] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.635243 28514 raft_consensus.cc:2468] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:13:05.637387 28512 raft_consensus.cc:2468] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:13:05.620697 28187 catalog_manager.cc:5697] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 2 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.643510 29082 leader_election.cc:290] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.644227 28515 raft_consensus.cc:2468] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 2.
I20260709 12:13:05.648650 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.649610 29126 raft_consensus.cc:2468] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:13:05.651288 28479 leader_election.cc:304] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:05.662760 29082 raft_consensus.cc:493] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.663795 29082 raft_consensus.cc:515] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.664000 29179 raft_consensus.cc:515] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.662959 29024 raft_consensus.cc:2804] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.629645 29080 raft_consensus.cc:493] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.665689 29024 raft_consensus.cc:493] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.668345 29024 raft_consensus.cc:3060] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.672107 29125 raft_consensus.cc:2468] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:05.672721 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c08416cd39400bab947ef583ee460e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:05.673432 28441 raft_consensus.cc:3060] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.675026 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:05.675907 28440 raft_consensus.cc:3060] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.676244 29080 raft_consensus.cc:3060] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.682520 28438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:05.683350 28438 raft_consensus.cc:2468] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:05.678798 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16779d1254f44e36b7db87097319a69e" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:05.689014 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.685904 29179 leader_election.cc:290] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.694624 28482 leader_election.cc:304] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
W20260709 12:13:05.695508 28482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 66822.5us
I20260709 12:13:05.696455 28482 leader_election.cc:304] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:05.699455 28438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:05.700367 28438 raft_consensus.cc:2468] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:13:05.700619 29179 raft_consensus.cc:2804] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.701753 28408 leader_election.cc:304] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:05.702474 29185 raft_consensus.cc:2804] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.702942 28408 leader_election.cc:304] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:05.681277 28441 raft_consensus.cc:2468] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 2.
I20260709 12:13:05.717783 28408 leader_election.cc:304] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
W20260709 12:13:05.747345 28405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 114982us
I20260709 12:13:05.748169 29024 raft_consensus.cc:515] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.755743 29178 raft_consensus.cc:2804] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.759357 28513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.760483 28513 raft_consensus.cc:2468] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:05.760805 29181 raft_consensus.cc:493] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.761739 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.761664 29181 raft_consensus.cc:515] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.759542 29183 raft_consensus.cc:2804] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.719632 29184 leader_election.cc:290] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.771243 28440 raft_consensus.cc:2468] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 2.
I20260709 12:13:05.743928 29179 raft_consensus.cc:697] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:05.774142 29024 leader_election.cc:290] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.744506 29185 raft_consensus.cc:697] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:05.764763 29183 raft_consensus.cc:493] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.777050 28482 leader_election.cc:304] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:05.758579 29046 raft_consensus.cc:2804] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.782610 29182 raft_consensus.cc:2804] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.783417 29182 raft_consensus.cc:493] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.783963 29182 raft_consensus.cc:3060] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.778935 29183 raft_consensus.cc:3060] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:05.800716 28479 leader_election.cc:343] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:05.802115 28479 leader_election.cc:343] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.807883 29046 raft_consensus.cc:697] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
W20260709 12:13:05.821063 28331 leader_election.cc:343] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.823859 28331 leader_election.cc:304] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:05.825074 29190 raft_consensus.cc:2804] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:05.825282 28331 leader_election.cc:343] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.825599 29190 raft_consensus.cc:493] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.826057 29190 raft_consensus.cc:3060] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.829290 29174 raft_consensus.cc:2804] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.829926 29174 raft_consensus.cc:493] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.830400 29174 raft_consensus.cc:3060] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.837430 29130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:05.838423 29130 raft_consensus.cc:3060] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.900310 29181 leader_election.cc:290] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:05.901520 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:05.935029 28363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:05.937297 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:05.937727 29183 raft_consensus.cc:515] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.940091 29183 leader_election.cc:290] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.940001 28364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:05.904277 29084 tablet_bootstrap.cc:492] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:05.907136 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.907270 29046 consensus_queue.cc:237] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.908778 29129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:05.911005 29124 raft_consensus.cc:2468] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 2.
I20260709 12:13:05.819864 29173 raft_consensus.cc:493] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.843276 29185 consensus_queue.cc:237] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.843508 29179 consensus_queue.cc:237] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.915024 29132 raft_consensus.cc:2468] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 2.
I20260709 12:13:05.916625 29082 leader_election.cc:290] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:05.923358 29080 raft_consensus.cc:515] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.914062 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
W20260709 12:13:05.928062 28405 leader_election.cc:343] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.930596 28334 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:05.935163 28365 raft_consensus.cc:2468] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:13:05.905435 29131 raft_consensus.cc:2468] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:05.942668 28364 raft_consensus.cc:2468] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:13:05.942672 29178 raft_consensus.cc:697] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:05.966612 28405 leader_election.cc:304] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:05.969277 28334 leader_election.cc:304] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:05.977824 28885 raft_consensus.cc:2804] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.941320 29182 raft_consensus.cc:515] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:05.978449 28885 raft_consensus.cc:697] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:05.979799 28885 consensus_queue.cc:237] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.980499 29182 leader_election.cc:290] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.981243 29182 raft_consensus.cc:2749] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:05.963682 29126 raft_consensus.cc:2468] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:05.972692 29084 tablet_bootstrap.cc:492] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:05.972833 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:05.978333 28334 leader_election.cc:304] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:05.970181 29181 raft_consensus.cc:2804] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.984843 29181 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:05.985106 29175 raft_consensus.cc:2804] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.985363 29181 raft_consensus.cc:3060] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.985620 28334 leader_election.cc:304] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:05.985754 29175 raft_consensus.cc:697] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:05.986924 29175 consensus_queue.cc:237] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:05.991698 28570 raft_consensus.cc:2804] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.992290 28570 raft_consensus.cc:697] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:05.982602 28514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:05.935221 29174 raft_consensus.cc:515] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:05.993280 28570 consensus_queue.cc:237] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.031930 29084 ts_tablet_manager.cc:1403] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.584s	user 0.060s	sys 0.049s
I20260709 12:13:06.039710 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb63ff5948b2424688b706c82ee3f05b" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:06.040343 28442 raft_consensus.cc:3060] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:06.033200 28514 raft_consensus.cc:2468] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
W20260709 12:13:06.034296 28405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 106371us
I20260709 12:13:06.043002 28366 raft_consensus.cc:2393] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 2: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:13:06.048069 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:06.049556 29174 leader_election.cc:290] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:06.050595 28512 raft_consensus.cc:1275] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer f4ce5f603caa48ababe023df3a36c0b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:05.967002 29173 raft_consensus.cc:515] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.052804 28363 raft_consensus.cc:2468] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 1.
I20260709 12:13:06.053345 28481 leader_election.cc:304] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:06.053714 29173 leader_election.cc:290] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:05.977926 29178 consensus_queue.cc:237] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:06.057701 28442 raft_consensus.cc:2468] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 3.
I20260709 12:13:06.057510 29084 raft_consensus.cc:359] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:06.058619 28511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:06.055991 29194 raft_consensus.cc:2804] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:06.077032 29084 raft_consensus.cc:740] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.079885 28405 leader_election.cc:304] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:06.081881 29181 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
W20260709 12:13:06.087414 28331 leader_election.cc:343] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:06.091336 28405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 44453.5us
I20260709 12:13:06.092039 29180 raft_consensus.cc:2764] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:06.079840 29194 raft_consensus.cc:493] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:06.080646 28511 raft_consensus.cc:3060] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.092597 29129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:06.093016 29194 raft_consensus.cc:3060] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:06.095620 28334 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.68:33813, user_credentials={real_user=slave}} blocked reactor thread for 110098us
I20260709 12:13:06.089818 29084 consensus_queue.cc:260] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:06.098611 29084 ts_tablet_manager.cc:1434] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:13:06.098860 29181 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:06.097977 29190 raft_consensus.cc:515] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:06.100471 28516 raft_consensus.cc:2393] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ce5f603caa48ababe023df3a36c0b4 in current term 2: Already voted for candidate 1be5ce5bff4b443ea67188eb0de32215 in this term.
I20260709 12:13:06.114544 29171 raft_consensus.cc:493] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:06.115473 29171 raft_consensus.cc:515] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:06.120087 28334 leader_election.cc:304] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:06.123980 29084 tablet_bootstrap.cc:492] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
W20260709 12:13:06.128696 28479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 50618.5us
W20260709 12:13:06.131850 28331 leader_election.cc:343] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.136541 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:06.137224 29129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:06.137399 29122 raft_consensus.cc:2468] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 1.
I20260709 12:13:06.140126 28334 leader_election.cc:304] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:06.147367 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:06.147567 29174 raft_consensus.cc:2804] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:06.154242 28407 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:06.155718 29180 raft_consensus.cc:2804] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:06.156179 29180 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:06.156599 29180 raft_consensus.cc:3060] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.133497 29173 raft_consensus.cc:2804] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:06.158479 29173 raft_consensus.cc:493] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:06.159004 29173 raft_consensus.cc:3060] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.154315 29174 raft_consensus.cc:493] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:06.160300 29174 raft_consensus.cc:3060] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.161041 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:06.161761 29132 raft_consensus.cc:3060] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.162374 29171 leader_election.cc:290] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:06.169750 29174 raft_consensus.cc:515] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.170245 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:06.171064 29124 raft_consensus.cc:1275] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer f4ce5f603caa48ababe023df3a36c0b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.171756 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:06.172222 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:06.183630 28515 raft_consensus.cc:2393] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 2: Already voted for candidate 1be5ce5bff4b443ea67188eb0de32215 in this term.
I20260709 12:13:06.180900 29194 raft_consensus.cc:515] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.159866 29130 raft_consensus.cc:2468] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:06.191478 28363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:06.192256 28363 raft_consensus.cc:3060] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.191558 28190 catalog_manager.cc:5697] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.195967 29174 leader_election.cc:290] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:06.173758 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:06.198221 28516 raft_consensus.cc:2393] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 2: Already voted for candidate 1be5ce5bff4b443ea67188eb0de32215 in this term.
I20260709 12:13:06.175240 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
W20260709 12:13:06.174932 29205 log.cc:927] Time spent T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:13:06.198241 28479 leader_election.cc:304] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:06.205423 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:06.206203 28516 raft_consensus.cc:3060] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:06.181425 28405 leader_election.cc:343] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.196329 28190 catalog_manager.cc:5697] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.208438 28334 leader_election.cc:304] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:06.215355 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd7a6a734ce644a486516976d29d7854" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:06.215241 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:06.210506 28570 raft_consensus.cc:2749] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:06.219537 28366 raft_consensus.cc:3060] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.211459 29185 raft_consensus.cc:2804] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:06.221149 29185 raft_consensus.cc:697] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:06.222065 29185 consensus_queue.cc:237] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.226579 29190 leader_election.cc:290] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
W20260709 12:13:06.226773 28479 leader_election.cc:343] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.232053 28366 raft_consensus.cc:2468] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:06.233134 28481 leader_election.cc:304] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:06.209511 29194 leader_election.cc:290] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:06.225039 28511 raft_consensus.cc:2468] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ce5f603caa48ababe023df3a36c0b4 in term 2.
I20260709 12:13:06.228067 29080 leader_election.cc:290] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:06.238101 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:06.239603 28442 raft_consensus.cc:2468] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 1.
I20260709 12:13:06.235478 29179 raft_consensus.cc:2804] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:06.241168 28363 raft_consensus.cc:2468] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:06.243417 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:06.243991 28481 leader_election.cc:304] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
W20260709 12:13:06.244989 28479 leader_election.cc:343] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.242314 29179 raft_consensus.cc:697] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
W20260709 12:13:06.250993 28405 leader_election.cc:343] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.252219 29084 tablet_bootstrap.cc:492] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.249953 29179 consensus_queue.cc:237] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.257676 29194 raft_consensus.cc:2804] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:06.258481 29194 raft_consensus.cc:697] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:06.259675 28188 catalog_manager.cc:5697] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 2 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.263602 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:06.263435 28188 catalog_manager.cc:5697] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 2 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.255472 29132 raft_consensus.cc:2468] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:06.264643 29180 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:06.272688 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:06.273429 29125 raft_consensus.cc:3060] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.253993 29084 tablet_bootstrap.cc:492] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:06.275245 29084 ts_tablet_manager.cc:1403] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.152s	user 0.018s	sys 0.011s
I20260709 12:13:06.269642 28188 catalog_manager.cc:5697] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 2 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.270187 29173 raft_consensus.cc:515] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.261170 29194 consensus_queue.cc:237] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.278972 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5100047ea944e6b83b2f8380c39aea" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:06.280972 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:06.281801 28441 raft_consensus.cc:2393] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b94463539fe9492dbae13ef77b3cc58d in current term 2: Already voted for candidate f4ce5f603caa48ababe023df3a36c0b4 in this term.
I20260709 12:13:06.285076 28516 raft_consensus.cc:2468] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 2.
I20260709 12:13:06.286450 28334 leader_election.cc:304] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:06.287990 29046 consensus_queue.cc:1048] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.289482 29174 raft_consensus.cc:2804] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:06.290092 29174 raft_consensus.cc:697] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:06.291079 29174 consensus_queue.cc:237] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.299124 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:06.299495 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:06.300427 29126 raft_consensus.cc:2393] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ce5f603caa48ababe023df3a36c0b4 in current term 2: Already voted for candidate 1be5ce5bff4b443ea67188eb0de32215 in this term.
I20260709 12:13:06.301648 29182 consensus_queue.cc:1048] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:06.304247 28331 leader_election.cc:343] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.305059 29125 raft_consensus.cc:2468] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 2.
I20260709 12:13:06.296514 28408 leader_election.cc:304] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
W20260709 12:13:06.306246 28405 leader_election.cc:343] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.306802 29180 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
W20260709 12:13:06.308904 28405 leader_election.cc:343] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.309897 28405 leader_election.cc:304] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:06.310072 29046 raft_consensus.cc:2804] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:06.310676 29046 raft_consensus.cc:697] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 LEADER]: Becoming Leader. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:13:06.310782 28882 raft_consensus.cc:2749] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:06.311635 29046 consensus_queue.cc:237] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:06.312770 28331 leader_election.cc:304] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:06.314137 28363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:06.325492 29084 raft_consensus.cc:359] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.326239 29084 raft_consensus.cc:740] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.326879 29084 consensus_queue.cc:260] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:06.328289 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:06.328992 28516 raft_consensus.cc:3060] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.330227 28511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "f4ce5f603caa48ababe023df3a36c0b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:06.331964 28482 leader_election.cc:304] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:06.332895 29192 raft_consensus.cc:2804] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:06.333154 28363 raft_consensus.cc:2393] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ce5f603caa48ababe023df3a36c0b4 in current term 2: Already voted for candidate b94463539fe9492dbae13ef77b3cc58d in this term.
I20260709 12:13:06.333437 29192 raft_consensus.cc:697] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 3 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
W20260709 12:13:06.338203 28331 leader_election.cc:343] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.315580 29064 raft_consensus.cc:2749] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:06.340514 28190 catalog_manager.cc:5697] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 2 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.345047 28334 leader_election.cc:304] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:06.348311 28885 raft_consensus.cc:2804] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:06.348820 28885 raft_consensus.cc:493] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:06.349246 28885 raft_consensus.cc:3060] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.354697 28440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:06.355651 28440 raft_consensus.cc:2393] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1be5ce5bff4b443ea67188eb0de32215 in current term 2: Already voted for candidate f4ce5f603caa48ababe023df3a36c0b4 in this term.
I20260709 12:13:06.334400 29192 consensus_queue.cc:237] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:06.337900 29173 leader_election.cc:290] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:06.363729 29084 ts_tablet_manager.cc:1434] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
I20260709 12:13:06.373744 28516 raft_consensus.cc:2468] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 2.
I20260709 12:13:06.375743 28334 leader_election.cc:304] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:06.376991 29174 raft_consensus.cc:2804] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:06.383082 28482 leader_election.cc:304] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:06.406481 29194 raft_consensus.cc:2749] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:06.410163 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8c55ad801343058a6dd2912c0ec74f" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
W20260709 12:13:06.411283 28405 consensus_peers.cc:597] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:06.412128 28405 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:06.413286 28405 leader_election.cc:304] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ce5f603caa48ababe023df3a36c0b4; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:06.413604 29092 raft_consensus.cc:2749] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:06.414795 28882 raft_consensus.cc:3060] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.416308 28331 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:06.417380 28570 raft_consensus.cc:2804] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:06.422871 28570 raft_consensus.cc:697] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:06.423600 28885 raft_consensus.cc:515] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:06.424011 28570 consensus_queue.cc:237] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:06.431622 29084 tablet_bootstrap.cc:492] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:06.421897 29174 raft_consensus.cc:697] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:06.436583 29174 consensus_queue.cc:237] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
W20260709 12:13:06.444751 28331 leader_election.cc:343] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.450306 28191 catalog_manager.cc:5697] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.453989 28882 raft_consensus.cc:2749] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:06.455900 28885 leader_election.cc:290] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Requested vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:06.491488 28191 catalog_manager.cc:5697] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.493979 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:06.494668 28441 raft_consensus.cc:3060] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:06.499215 28191 catalog_manager.cc:5697] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.517620 28441 raft_consensus.cc:2468] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 2.
I20260709 12:13:06.518903 28334 leader_election.cc:304] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:06.519687 28885 raft_consensus.cc:2804] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:06.520175 28885 raft_consensus.cc:697] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:06.523068 28885 consensus_queue.cc:237] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:06.524525 29130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
W20260709 12:13:06.528692 28331 leader_election.cc:343] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.529630 28191 catalog_manager.cc:5697] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.539078 29124 raft_consensus.cc:1275] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.561422 28440 raft_consensus.cc:1275] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.563359 29185 consensus_queue.cc:1048] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.567752 28190 catalog_manager.cc:5697] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67). New cstate: current_term: 2 leader_uuid: "f4ce5f603caa48ababe023df3a36c0b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.574746 28441 raft_consensus.cc:1275] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.576930 29192 consensus_queue.cc:1048] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.581703 29131 raft_consensus.cc:1275] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.585170 28570 consensus_queue.cc:1048] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:06.604789 28331 consensus_peers.cc:597] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:06.605816 28331 consensus_peers.cc:597] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.667521 28438 raft_consensus.cc:1275] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.678191 28442 raft_consensus.cc:1275] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.624670 29190 consensus_queue.cc:1048] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:13:06.691639 29131 raft_consensus.cc:1275] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.701469 29132 raft_consensus.cc:1275] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer f4ce5f603caa48ababe023df3a36c0b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:06.724668 28407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:42205, user_credentials={real_user=slave}} blocked reactor thread for 46891.4us
I20260709 12:13:06.737397 28513 raft_consensus.cc:1275] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer f4ce5f603caa48ababe023df3a36c0b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:06.747713 29217 log.cc:927] Time spent T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:13:06.729554 29185 consensus_queue.cc:1048] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:13:06.776403 29173 consensus_queue.cc:1048] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.778574 29222 consensus_queue.cc:1048] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.791473 29125 raft_consensus.cc:1275] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.799008 29084 tablet_bootstrap.cc:492] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.800094 29084 tablet_bootstrap.cc:492] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:06.801718 28368 raft_consensus.cc:1275] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.812368 29194 consensus_queue.cc:1048] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:06.825340 29084 ts_tablet_manager.cc:1403] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.402s	user 0.019s	sys 0.021s
I20260709 12:13:06.843953 28441 raft_consensus.cc:1275] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:06.824271 28331 consensus_peers.cc:597] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:06.850771 28331 consensus_peers.cc:597] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.846997 28188 catalog_manager.cc:5697] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 2 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.857100 28188 catalog_manager.cc:5697] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 2 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.861496 28513 raft_consensus.cc:1275] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.865867 28188 catalog_manager.cc:5697] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 2 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:06.888713 28405 consensus_peers.cc:597] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:06.872231 28188 catalog_manager.cc:5697] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 1 to 2, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 2 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.906929 28441 raft_consensus.cc:1275] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:06.912321 28570 consensus_queue.cc:1048] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.910326 28191 catalog_manager.cc:5697] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 2 to 3, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 3 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.872341 29179 consensus_queue.cc:1048] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:13:06.984938 28334 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 70574.1us
W20260709 12:13:06.988083 28479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 69887.8us
I20260709 12:13:06.874294 29230 consensus_queue.cc:1048] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 12:13:06.989322 28479 consensus_peers.cc:597] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:06.917272 28511 raft_consensus.cc:1275] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:06.912725 29126 raft_consensus.cc:1275] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:07.006835 28482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 135394us
W20260709 12:13:07.009721 29202 log.cc:927] Time spent T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:13:07.011308 29231 consensus_queue.cc:1048] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.163s
I20260709 12:13:07.011955 28364 raft_consensus.cc:1275] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:07.018994 29232 consensus_queue.cc:1048] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:07.027031 28407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:42205, user_credentials={real_user=slave}} blocked reactor thread for 96991us
I20260709 12:13:07.028582 29084 raft_consensus.cc:359] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:07.033788 29084 raft_consensus.cc:740] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.034799 29084 consensus_queue.cc:260] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:07.037422 29084 ts_tablet_manager.cc:1434] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.191s	user 0.020s	sys 0.037s
I20260709 12:13:07.019037 28367 raft_consensus.cc:1275] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:07.013803 29046 consensus_queue.cc:1048] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:13:07.048259 29124 raft_consensus.cc:1275] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:07.052328 29084 tablet_bootstrap.cc:492] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
W20260709 12:13:07.064671 28479 consensus_peers.cc:597] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:07.081600 28479 consensus_peers.cc:597] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:07.082881 28479 consensus_peers.cc:597] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:07.083885 29179 consensus_queue.cc:1048] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.032581 29230 consensus_queue.cc:1048] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 12:13:07.116755 28408 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.68:33813, user_credentials={real_user=slave}} blocked reactor thread for 168496us
W20260709 12:13:07.117106 28405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 212499us
I20260709 12:13:07.124065 28515 raft_consensus.cc:1275] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer f4ce5f603caa48ababe023df3a36c0b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:07.112555 29222 consensus_queue.cc:1048] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:13:07.140568 28882 consensus_queue.cc:1048] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:13:07.134843 28435 raft_consensus.cc:1275] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:07.188494 28479 consensus_peers.cc:597] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.146834 29241 consensus_queue.cc:1048] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:13:07.166082 29185 consensus_queue.cc:1048] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:13:07.225731 28482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 89003.9us
I20260709 12:13:07.232664 29187 consensus_queue.cc:1048] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 12:13:07.295950 28405 consensus_peers.cc:597] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.349355 28433 raft_consensus.cc:1275] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:07.353314 28514 raft_consensus.cc:1275] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:07.384132 28885 consensus_queue.cc:1048] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.394178 29221 consensus_queue.cc:1048] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:13:07.409704 29129 raft_consensus.cc:3060] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:07.418992 29255 log.cc:927] Time spent T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4: Append to log took a long time: real 0.197s	user 0.001s	sys 0.002s
W20260709 12:13:07.432205 29254 log.cc:927] Time spent T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4: Append to log took a long time: real 0.220s	user 0.002s	sys 0.000s
I20260709 12:13:07.447324 29084 tablet_bootstrap.cc:492] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.448395 29084 tablet_bootstrap.cc:492] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
W20260709 12:13:07.450119 28405 consensus_peers.cc:597] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:07.450649 28405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 94212.6us
I20260709 12:13:07.453536 29084 ts_tablet_manager.cc:1403] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.414s	user 0.018s	sys 0.028s
W20260709 12:13:07.466229 28331 consensus_peers.cc:597] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.471393 29131 raft_consensus.cc:1275] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:07.479739 28331 consensus_peers.cc:597] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:07.479569 28405 consensus_peers.cc:597] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:07.513235 28405 consensus_peers.cc:597] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:07.517819 29262 log.cc:927] Time spent T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:13:07.678160 28334 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 144616us
W20260709 12:13:07.732545 28405 consensus_peers.cc:597] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:07.742336 28405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41545, user_credentials={real_user=slave}} blocked reactor thread for 205624us
W20260709 12:13:07.772689 28405 consensus_peers.cc:597] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:07.785859 29181 consensus_queue.cc:1048] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.786032 29084 raft_consensus.cc:359] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:07.786773 29084 raft_consensus.cc:740] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.787570 29084 consensus_queue.cc:260] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
W20260709 12:13:07.796713 28331 consensus_peers.cc:597] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:07.788655 29267 log.cc:927] Time spent T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:13:07.809405 29269 log.cc:927] Time spent T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:13:07.817195 29268 log.cc:927] Time spent T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:13:07.858806 28331 consensus_peers.cc:597] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:07.911069 29084 ts_tablet_manager.cc:1434] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.452s	user 0.010s	sys 0.000s
I20260709 12:13:07.912231 29084 tablet_bootstrap.cc:492] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:07.941519 29282 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.942328 29282 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.029942 29282 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
W20260709 12:13:08.060480 28405 consensus_peers.cc:597] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:08.061673 29221 raft_consensus.cc:493] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.065011 29221 raft_consensus.cc:515] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.067696 29221 leader_election.cc:290] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:08.082010 28510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1be5ce5bff4b443ea67188eb0de32215" is_pre_election: true
I20260709 12:13:08.087558 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc60c63aa0fa4aff83e4d3b918c9fc05" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
W20260709 12:13:08.111513 29276 log.cc:927] Time spent T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d: Append to log took a long time: real 0.269s	user 0.013s	sys 0.004s
I20260709 12:13:08.118449 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b94463539fe9492dbae13ef77b3cc58d" is_pre_election: true
I20260709 12:13:08.126296 28188 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40940 (request call id 107) took 1313 ms. Trace:
I20260709 12:13:08.126893 28188 rpcz_store.cc:276] 0709 12:13:06.812527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.812694 (+   167us) service_pool.cc:224] Handling call
0709 12:13:08.126210 (+1313516us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:07.184333 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:07.184883 (+   550us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:07.184917 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:13:07.184929 (+    12us) tablet.cc:662] Decoding operations
0709 12:13:07.185499 (+   570us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:07.185548 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:07.185600 (+    52us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:07.185967 (+   367us) tablet.cc:701] Row locks acquired
0709 12:13:07.185979 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:13:07.186122 (+   143us) write_op.cc:270] Start()
0709 12:13:07.188236 (+  2114us) write_op.cc:276] Timestamp: P: 1783599187186079 usec, L: 0
0709 12:13:07.188293 (+    57us) op_driver.cc:348] REPLICATION: starting
0709 12:13:07.231027 (+ 42734us) log.cc:844] Serialized 1693 byte log entry
0709 12:13:07.239520 (+  8493us) op_driver.cc:464] REPLICATION: finished
0709 12:13:07.239961 (+   441us) write_op.cc:301] APPLY: starting
0709 12:13:07.240034 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:07.240179 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:07.240294 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:07.240892 (+   598us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:07.241072 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:13:07.241124 (+    52us) write_op.cc:312] APPLY: finished
0709 12:13:07.241366 (+   242us) log.cc:844] Serialized 40 byte log entry
0709 12:13:07.241531 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:07.241633 (+   102us) write_op.cc:454] Released schema lock
0709 12:13:07.241679 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:07.242012 (+   333us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:07.242038 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":187969,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":257,"apply.run_cpu_time_us":2019,"apply.run_wall_time_us":2019,"num_ops":4,"prepare.queue_time_us":170620,"prepare.run_cpu_time_us":3512,"prepare.run_wall_time_us":48373,"replication_time_us":48999}]]}
I20260709 12:13:08.170056 28334 leader_election.cc:304] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d; no voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:08.221513 29221 raft_consensus.cc:2749] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:08.266162 28434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:08.276381 29079 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a; no voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4
I20260709 12:13:08.291397 29172 raft_consensus.cc:2749] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:08.308961 29084 tablet_bootstrap.cc:492] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.310078 29084 tablet_bootstrap.cc:492] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.310801 29084 ts_tablet_manager.cc:1403] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.399s	user 0.027s	sys 0.053s
I20260709 12:13:08.313539 29084 raft_consensus.cc:359] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.314220 29084 raft_consensus.cc:740] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.314985 29084 consensus_queue.cc:260] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.317159 29084 ts_tablet_manager.cc:1434] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:13:08.318610 29084 tablet_bootstrap.cc:492] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.346670 29084 tablet_bootstrap.cc:492] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.347617 29084 tablet_bootstrap.cc:492] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.348302 29084 ts_tablet_manager.cc:1403] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.030s	user 0.025s	sys 0.001s
I20260709 12:13:08.351675 29084 raft_consensus.cc:359] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.352340 29084 raft_consensus.cc:740] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.353092 29084 consensus_queue.cc:260] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.355206 29084 ts_tablet_manager.cc:1434] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:13:08.356022 29084 tablet_bootstrap.cc:492] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.369751 29084 tablet_bootstrap.cc:492] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.370772 29084 tablet_bootstrap.cc:492] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.371493 29084 ts_tablet_manager.cc:1403] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 12:13:08.373967 29084 raft_consensus.cc:359] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.374693 29084 raft_consensus.cc:740] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.375533 29128 raft_consensus.cc:3060] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.375808 29084 consensus_queue.cc:260] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.378031 29084 ts_tablet_manager.cc:1434] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:13:08.379015 29084 tablet_bootstrap.cc:492] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.445816 29084 tablet_bootstrap.cc:492] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.446874 29084 tablet_bootstrap.cc:492] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.447970 29084 ts_tablet_manager.cc:1403] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.045s
I20260709 12:13:08.451671 29084 raft_consensus.cc:359] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.453608 29084 raft_consensus.cc:740] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.454438 29084 consensus_queue.cc:260] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.456722 29084 ts_tablet_manager.cc:1434] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:08.457623 29084 tablet_bootstrap.cc:492] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.488443 29084 tablet_bootstrap.cc:492] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.489464 29084 tablet_bootstrap.cc:492] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.490206 29084 ts_tablet_manager.cc:1403] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.007s
I20260709 12:13:08.492893 29084 raft_consensus.cc:359] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.493626 29084 raft_consensus.cc:740] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.494462 29084 consensus_queue.cc:260] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.497900 29084 ts_tablet_manager.cc:1434] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:13:08.499552 29084 tablet_bootstrap.cc:492] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.516844 29084 tablet_bootstrap.cc:492] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.518095 29084 tablet_bootstrap.cc:492] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.518899 29084 ts_tablet_manager.cc:1403] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:13:08.521690 29084 raft_consensus.cc:359] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.522470 29084 raft_consensus.cc:740] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.523293 29084 consensus_queue.cc:260] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.524976 29084 ts_tablet_manager.cc:1434] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:08.526769 29084 tablet_bootstrap.cc:492] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.542203 29084 tablet_bootstrap.cc:492] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.543267 29084 tablet_bootstrap.cc:492] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.544011 29084 ts_tablet_manager.cc:1403] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 12:13:08.546222 29084 raft_consensus.cc:359] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.546896 29084 raft_consensus.cc:740] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.547549 29084 consensus_queue.cc:260] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.549801 29084 ts_tablet_manager.cc:1434] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:08.550825 29084 tablet_bootstrap.cc:492] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.566272 29084 tablet_bootstrap.cc:492] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.567353 29084 tablet_bootstrap.cc:492] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.568107 29084 ts_tablet_manager.cc:1403] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:13:08.568187 29194 raft_consensus.cc:493] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.568770 29194 raft_consensus.cc:515] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.571033 29084 raft_consensus.cc:359] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.571880 29084 raft_consensus.cc:740] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.572713 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" is_pre_election: true
I20260709 12:13:08.572606 29084 consensus_queue.cc:260] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.572821 29124 raft_consensus.cc:3060] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:08.574035 28479 leader_election.cc:343] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:08.574958 29084 ts_tablet_manager.cc:1434] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:08.577349 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4" is_pre_election: true
I20260709 12:13:08.578058 28441 raft_consensus.cc:2468] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:08.576104 29084 tablet_bootstrap.cc:492] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.581652 28482 leader_election.cc:304] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:08.582993 29185 raft_consensus.cc:2804] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:08.583422 29185 raft_consensus.cc:493] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.583868 29185 raft_consensus.cc:3060] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:08.571465 29194 leader_election.cc:290] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:08.605481 29084 tablet_bootstrap.cc:492] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.606654 29084 tablet_bootstrap.cc:492] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.606652 29185 raft_consensus.cc:515] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.607846 29084 ts_tablet_manager.cc:1403] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.005s
I20260709 12:13:08.610267 29185 leader_election.cc:290] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545)
I20260709 12:13:08.610594 29084 raft_consensus.cc:359] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.611513 29084 raft_consensus.cc:740] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.612347 29084 consensus_queue.cc:260] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.613914 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
I20260709 12:13:08.614661 29128 raft_consensus.cc:3060] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:08.614640 29084 ts_tablet_manager.cc:1434] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:13:08.619375 29084 tablet_bootstrap.cc:492] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.623225 29128 raft_consensus.cc:2468] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 3.
I20260709 12:13:08.624641 28479 leader_election.cc:304] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:08.625536 29185 raft_consensus.cc:2804] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:08.626103 29185 raft_consensus.cc:697] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:08.627126 29185 consensus_queue.cc:237] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.629317 29124 raft_consensus.cc:3060] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.634830 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1868e15012414126a99e7722148f94c4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:08.635504 28441 raft_consensus.cc:3060] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:08.640719 28441 raft_consensus.cc:2468] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 3.
I20260709 12:13:08.673602 29084 tablet_bootstrap.cc:492] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.673444 28190 catalog_manager.cc:5697] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 3, leader changed from 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 3 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.674686 29084 tablet_bootstrap.cc:492] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.675412 29084 ts_tablet_manager.cc:1403] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.008s
I20260709 12:13:08.679375 29084 raft_consensus.cc:359] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.680143 29084 raft_consensus.cc:740] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.681080 29084 consensus_queue.cc:260] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.683969 29084 ts_tablet_manager.cc:1434] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:08.684821 29084 tablet_bootstrap.cc:492] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.706619 29084 tablet_bootstrap.cc:492] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.707564 29084 tablet_bootstrap.cc:492] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.708194 29084 ts_tablet_manager.cc:1403] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.001s
I20260709 12:13:08.710276 29084 raft_consensus.cc:359] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.710846 29084 raft_consensus.cc:740] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.711427 29084 consensus_queue.cc:260] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.712976 29084 ts_tablet_manager.cc:1434] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:08.713918 29084 tablet_bootstrap.cc:492] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.727964 29084 tablet_bootstrap.cc:492] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.729593 29084 tablet_bootstrap.cc:492] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.730271 29084 ts_tablet_manager.cc:1403] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:13:08.732827 29084 raft_consensus.cc:359] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.733374 29084 raft_consensus.cc:740] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.734045 29084 consensus_queue.cc:260] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.737025 29084 ts_tablet_manager.cc:1434] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:08.739421 29124 raft_consensus.cc:3060] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.739575 29084 tablet_bootstrap.cc:492] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.762071 29084 tablet_bootstrap.cc:492] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.763005 29084 tablet_bootstrap.cc:492] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.763634 29084 ts_tablet_manager.cc:1403] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 12:13:08.766109 29084 raft_consensus.cc:359] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.767077 29084 raft_consensus.cc:740] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.767731 29084 consensus_queue.cc:260] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.771978 29084 ts_tablet_manager.cc:1434] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:08.772873 29084 tablet_bootstrap.cc:492] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.798254 29084 tablet_bootstrap.cc:492] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.799419 29084 tablet_bootstrap.cc:492] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.800117 29084 ts_tablet_manager.cc:1403] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 12:13:08.802400 29084 raft_consensus.cc:359] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.803140 29084 raft_consensus.cc:740] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.803870 29084 consensus_queue.cc:260] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.806042 29084 ts_tablet_manager.cc:1434] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:08.807199 29084 tablet_bootstrap.cc:492] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.829568 29084 tablet_bootstrap.cc:492] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.830282 29084 tablet_bootstrap.cc:492] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.830889 29084 ts_tablet_manager.cc:1403] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 12:13:08.832963 29084 raft_consensus.cc:359] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.833549 29084 raft_consensus.cc:740] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.834179 29084 consensus_queue.cc:260] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.836063 29084 ts_tablet_manager.cc:1434] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:08.837404 29084 tablet_bootstrap.cc:492] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.846025 29128 raft_consensus.cc:3060] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.850375 29084 tablet_bootstrap.cc:492] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.851260 29084 tablet_bootstrap.cc:492] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.851936 29084 ts_tablet_manager.cc:1403] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:13:08.854549 29084 raft_consensus.cc:359] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.855213 29084 raft_consensus.cc:740] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.855870 29084 consensus_queue.cc:260] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.857486 29084 ts_tablet_manager.cc:1434] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:08.858361 29084 tablet_bootstrap.cc:492] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.872586 29084 tablet_bootstrap.cc:492] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.873525 29084 tablet_bootstrap.cc:492] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.874191 29084 ts_tablet_manager.cc:1403] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:13:08.876830 29084 raft_consensus.cc:359] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.877562 29084 raft_consensus.cc:740] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.878253 29084 consensus_queue.cc:260] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.880363 29084 ts_tablet_manager.cc:1434] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:08.881274 29084 tablet_bootstrap.cc:492] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.898100 29084 tablet_bootstrap.cc:492] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.898991 29084 tablet_bootstrap.cc:492] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.899725 29084 ts_tablet_manager.cc:1403] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:13:08.902348 29084 raft_consensus.cc:359] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.903079 29084 raft_consensus.cc:740] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.903841 29084 consensus_queue.cc:260] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.905927 29084 ts_tablet_manager.cc:1434] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:08.906797 29084 tablet_bootstrap.cc:492] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.923125 29084 tablet_bootstrap.cc:492] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.923949 29084 tablet_bootstrap.cc:492] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.924515 29084 ts_tablet_manager.cc:1403] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:13:08.926535 29084 raft_consensus.cc:359] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.927065 29084 raft_consensus.cc:740] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.927644 29084 consensus_queue.cc:260] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:08.929378 29084 ts_tablet_manager.cc:1434] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:08.930838 29084 tablet_bootstrap.cc:492] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.948299 29084 tablet_bootstrap.cc:492] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.949292 29084 tablet_bootstrap.cc:492] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.950035 29084 ts_tablet_manager.cc:1403] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.005s
I20260709 12:13:08.952703 29084 raft_consensus.cc:359] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.953435 29084 raft_consensus.cc:740] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.954100 29084 consensus_queue.cc:260] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:08.955940 29084 ts_tablet_manager.cc:1434] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:13:08.957077 29084 tablet_bootstrap.cc:492] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap starting.
I20260709 12:13:08.971238 29084 tablet_bootstrap.cc:492] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.972218 29084 tablet_bootstrap.cc:492] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: Bootstrap complete.
I20260709 12:13:08.972798 29084 ts_tablet_manager.cc:1403] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:13:08.974848 29084 raft_consensus.cc:359] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.975366 29084 raft_consensus.cc:740] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.976027 29084 consensus_queue.cc:260] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:08.977708 29084 ts_tablet_manager.cc:1434] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:09.154251 28438 raft_consensus.cc:1275] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:09.155777 29185 consensus_queue.cc:1048] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.167900 29128 raft_consensus.cc:1275] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:09.169595 29178 consensus_queue.cc:1048] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.360226 29124 raft_consensus.cc:3060] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.401278 29124 raft_consensus.cc:3060] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.105515 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:15.158841 28515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c089a99cd334841849bfd25380410fb"
dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45118
I20260709 12:13:15.159498 28515 raft_consensus.cc:606] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:15.179744 28368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4"
dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
mode: GRACEFUL
new_leader_uuid: "1be5ce5bff4b443ea67188eb0de32215"
 from {username='slave'} at 127.0.0.1:33548
I20260709 12:13:15.180270 28368 raft_consensus.cc:606] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Received request to transfer leadership to TS 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:15.182787 28515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a"
dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45118
I20260709 12:13:15.183291 28515 raft_consensus.cc:606] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:15.185750 28515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576"
dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45118
I20260709 12:13:15.186305 28515 raft_consensus.cc:606] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:15.199381 28434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78"
dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45962
I20260709 12:13:15.200063 28434 raft_consensus.cc:606] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:15.202731 28368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df473093e079470ca1369b516368ab05"
dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:33548
I20260709 12:13:15.203198 28368 raft_consensus.cc:606] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:15.204245 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:15.205699 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:15.206633 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:15.242952 29348 raft_consensus.cc:993] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.243516 29343 raft_consensus.cc:1081] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.245071 29131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42574
I20260709 12:13:15.245579 29131 raft_consensus.cc:493] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.245908 29131 raft_consensus.cc:3060] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.250480 29131 raft_consensus.cc:515] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:15.252892 29131 leader_election.cc:290] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:15.254817 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:15.255566 28368 raft_consensus.cc:3060] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.262311 28368 raft_consensus.cc:2468] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:15.263468 29078 leader_election.cc:304] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:15.266724 29357 raft_consensus.cc:2804] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:15.266873 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8449846c74a54c40a37e2b241c98f91a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:15.267541 28515 raft_consensus.cc:3055] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:15.267941 28515 raft_consensus.cc:740] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:15.268244 29357 raft_consensus.cc:697] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:15.269335 29357 consensus_queue.cc:237] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:15.270098 28515 consensus_queue.cc:260] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:15.271888 28515 raft_consensus.cc:3060] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.280203 28515 raft_consensus.cc:2468] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:15.281396 28190 catalog_manager.cc:5697] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 2 to 3, leader changed from 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 3 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.289243 29342 raft_consensus.cc:993] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d: : Instructing follower 1be5ce5bff4b443ea67188eb0de32215 to start an election
I20260709 12:13:15.289798 29342 raft_consensus.cc:1081] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Signalling peer 1be5ce5bff4b443ea67188eb0de32215 to start an election
I20260709 12:13:15.291452 28515 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4"
dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
 from {username='slave'} at 127.0.0.1:57346
I20260709 12:13:15.292084 28515 raft_consensus.cc:493] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.292409 28515 raft_consensus.cc:3060] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.298957 28515 raft_consensus.cc:515] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:15.300942 28515 leader_election.cc:290] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:15.301532 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:15.301940 28434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3ee9b579654f3b8a3ad484468fa8e4" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:15.302218 28368 raft_consensus.cc:3055] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.302582 28368 raft_consensus.cc:740] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:15.302657 28434 raft_consensus.cc:3060] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.303403 28368 consensus_queue.cc:260] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:15.304679 28368 raft_consensus.cc:3060] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.310072 28434 raft_consensus.cc:2468] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:15.311298 28482 leader_election.cc:304] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:15.312057 29348 raft_consensus.cc:2804] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.313905 29348 raft_consensus.cc:697] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:15.314522 28368 raft_consensus.cc:2468] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:15.314828 29348 consensus_queue.cc:237] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:15.323390 29350 raft_consensus.cc:993] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.323868 29342 raft_consensus.cc:1081] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.325387 29131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df473093e079470ca1369b516368ab05"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42600
I20260709 12:13:15.325237 28190 catalog_manager.cc:5697] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 2, leader changed from b94463539fe9492dbae13ef77b3cc58d (127.20.56.66) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.325999 29131 raft_consensus.cc:493] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.326445 29131 raft_consensus.cc:3060] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.338286 29131 raft_consensus.cc:515] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:15.343844 29131 leader_election.cc:290] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:15.344007 28434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:15.344681 28434 raft_consensus.cc:3060] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.351213 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df473093e079470ca1369b516368ab05" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:15.352629 28368 raft_consensus.cc:3055] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:15.352936 28368 raft_consensus.cc:740] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:15.353703 28368 consensus_queue.cc:260] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:15.355185 28368 raft_consensus.cc:3060] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.356098 28434 raft_consensus.cc:2468] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:15.357182 29079 leader_election.cc:304] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:15.357843 29357 raft_consensus.cc:2804] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:15.358278 29357 raft_consensus.cc:697] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:15.359031 29357 consensus_queue.cc:237] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:15.360723 28368 raft_consensus.cc:2468] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:15.370200 29364 raft_consensus.cc:993] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.370782 29364 raft_consensus.cc:1081] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.369292 28190 catalog_manager.cc:5697] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 2 to 3, leader changed from b94463539fe9492dbae13ef77b3cc58d (127.20.56.66) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 3 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.373675 29124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42574
I20260709 12:13:15.374156 29124 raft_consensus.cc:493] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.374382 29124 raft_consensus.cc:3060] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.381179 29124 raft_consensus.cc:515] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:15.382810 29124 leader_election.cc:290] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:15.383378 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:15.383615 28510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f96d100bb7432592bc9f8aa85db576" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:15.383998 28441 raft_consensus.cc:3060] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.384325 28510 raft_consensus.cc:3055] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:15.384718 28510 raft_consensus.cc:740] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:15.385478 28510 consensus_queue.cc:260] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:15.386739 28510 raft_consensus.cc:3060] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:15.389981 28441 raft_consensus.cc:2468] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:15.391019 29079 leader_election.cc:304] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:15.391793 29357 raft_consensus.cc:2804] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:15.392334 29357 raft_consensus.cc:697] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:15.393270 29357 consensus_queue.cc:237] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:15.393803 28510 raft_consensus.cc:2468] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:15.405539 28190 catalog_manager.cc:5697] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 2 to 3, leader changed from 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 3 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.482141 29343 raft_consensus.cc:993] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.482692 29348 raft_consensus.cc:1081] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.484295 29131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c089a99cd334841849bfd25380410fb"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42574
I20260709 12:13:15.484848 29131 raft_consensus.cc:493] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.485213 29131 raft_consensus.cc:3060] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.490161 29131 raft_consensus.cc:515] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:15.491847 29131 leader_election.cc:290] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:15.492549 28434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c089a99cd334841849bfd25380410fb" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:15.492699 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c089a99cd334841849bfd25380410fb" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:15.493709 28434 raft_consensus.cc:3060] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.493728 28515 raft_consensus.cc:3055] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.494314 28515 raft_consensus.cc:740] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:15.495093 28515 consensus_queue.cc:260] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:15.496230 28515 raft_consensus.cc:3060] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.499626 28434 raft_consensus.cc:2468] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:15.501701 28515 raft_consensus.cc:2468] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:15.501130 29079 leader_election.cc:304] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:15.502936 29357 raft_consensus.cc:2804] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.503441 29357 raft_consensus.cc:697] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:15.504287 29357 consensus_queue.cc:237] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:15.516443 28190 catalog_manager.cc:5697] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 1 to 2, leader changed from 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.703163 29046 raft_consensus.cc:993] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.704228 29046 raft_consensus.cc:1081] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:15.706902 29124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42584
I20260709 12:13:15.707813 29124 raft_consensus.cc:493] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.710443 29124 raft_consensus.cc:3060] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.727154 29124 raft_consensus.cc:515] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:15.737046 29124 leader_election.cc:290] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:15.739509 28510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:15.739517 28434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e086c7173346b4938961a48ccb2a78" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:15.740895 28510 raft_consensus.cc:3060] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.741446 28434 raft_consensus.cc:3055] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.741925 28434 raft_consensus.cc:740] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:13:15.743172 28434 consensus_queue.cc:260] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:15.744099 28365 raft_consensus.cc:1275] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.744544 28368 raft_consensus.cc:1275] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:15.746662 28434 raft_consensus.cc:3060] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.747123 29357 consensus_queue.cc:1048] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:15.746351 29364 consensus_queue.cc:1048] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:15.763854 28434 raft_consensus.cc:2468] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:15.765982 29079 leader_election.cc:304] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:15.767490 29357 raft_consensus.cc:2804] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.768857 29357 raft_consensus.cc:697] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:15.770632 29357 consensus_queue.cc:237] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:15.808907 28434 raft_consensus.cc:1275] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:15.810695 29358 consensus_queue.cc:1048] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:15.847777 28362 raft_consensus.cc:1275] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:15.860522 28187 catalog_manager.cc:5697] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 1 to 2, leader changed from f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.871793 28510 raft_consensus.cc:2468] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:15.857245 29357 consensus_queue.cc:1048] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:13:15.922868 28441 raft_consensus.cc:1275] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.929912 29364 consensus_queue.cc:1048] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:15.940044 29079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:39727, user_credentials={real_user=slave}} blocked reactor thread for 50962.1us
I20260709 12:13:15.963385 28441 raft_consensus.cc:1275] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:15.965229 28510 raft_consensus.cc:1275] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:15.986608 29379 consensus_queue.cc:1048] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:15.989436 29379 consensus_queue.cc:1048] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:16.026613 28515 raft_consensus.cc:1275] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:16.028623 29382 consensus_queue.cc:1048] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:16.065680 28510 raft_consensus.cc:1275] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.084000 29358 consensus_queue.cc:1048] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.123027 28441 raft_consensus.cc:1275] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.127849 29382 consensus_queue.cc:1048] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.247638 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:16.261396 28441 raft_consensus.cc:1275] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.263144 29379 consensus_queue.cc:1048] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.277733 28515 raft_consensus.cc:1275] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.279253 29379 consensus_queue.cc:1048] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.302127 28365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3645480b1e2b453682244c34a005703d"
dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:33548
I20260709 12:13:16.302870 28365 raft_consensus.cc:606] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:16.306908 28365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293"
dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:33548
I20260709 12:13:16.307613 28365 raft_consensus.cc:606] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:16.310845 28434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9"
dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45962
I20260709 12:13:16.311398 28434 raft_consensus.cc:606] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:16.314462 28515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d"
dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45118
I20260709 12:13:16.314947 28515 raft_consensus.cc:606] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:16.317793 28365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a"
dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:33548
I20260709 12:13:16.318385 28365 raft_consensus.cc:606] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:16.319547 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:16.320858 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:16.321880 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:16.453758 29046 raft_consensus.cc:993] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.458144 29347 raft_consensus.cc:1081] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.459959 29128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42584
I20260709 12:13:16.460482 29128 raft_consensus.cc:493] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:16.460911 29128 raft_consensus.cc:3060] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:16.467577 29128 raft_consensus.cc:515] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:16.469322 29128 leader_election.cc:290] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:16.470278 28434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:16.470443 28509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a822aa07b6a04f6e83685d3f67ed26d9" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:16.471726 28434 raft_consensus.cc:3055] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:16.472064 28434 raft_consensus.cc:740] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:13:16.472080 28509 raft_consensus.cc:3060] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:16.472995 28434 consensus_queue.cc:260] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:16.474287 28434 raft_consensus.cc:3060] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:16.480430 28509 raft_consensus.cc:2468] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:16.481786 29079 leader_election.cc:304] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:16.482036 28434 raft_consensus.cc:2468] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:16.482586 29379 raft_consensus.cc:2804] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:16.483119 29379 raft_consensus.cc:697] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:16.484023 29379 consensus_queue.cc:237] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:16.492808 28191 catalog_manager.cc:5697] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 2 to 3, leader changed from f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 3 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:16.507375 29350 raft_consensus.cc:993] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.507987 29381 raft_consensus.cc:1081] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.509573 29128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42600
I20260709 12:13:16.510042 29128 raft_consensus.cc:493] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:16.510324 29128 raft_consensus.cc:3060] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.517800 29128 raft_consensus.cc:515] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:16.520892 29128 leader_election.cc:290] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:16.521092 28509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:16.521831 28509 raft_consensus.cc:3060] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.528501 28509 raft_consensus.cc:2468] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:16.521088 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a87d2111494acab0739a6431f79b3a" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:16.529668 29079 leader_election.cc:304] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:16.529834 28365 raft_consensus.cc:3055] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:16.530228 28365 raft_consensus.cc:740] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:16.530567 29379 raft_consensus.cc:2804] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:16.531256 29379 raft_consensus.cc:697] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:16.531090 28365 consensus_queue.cc:260] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:16.532472 28365 raft_consensus.cc:3060] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.532330 29379 consensus_queue.cc:237] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:16.538990 28365 raft_consensus.cc:2468] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:16.547925 28191 catalog_manager.cc:5697] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 1 to 2, leader changed from b94463539fe9492dbae13ef77b3cc58d (127.20.56.66) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.579562 29350 raft_consensus.cc:993] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.580035 29381 raft_consensus.cc:1081] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.581601 29128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3645480b1e2b453682244c34a005703d"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42600
I20260709 12:13:16.582013 29128 raft_consensus.cc:493] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:16.582234 29128 raft_consensus.cc:3060] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:16.587013 29128 raft_consensus.cc:515] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:16.591017 29128 leader_election.cc:290] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:16.591216 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:16.591922 28441 raft_consensus.cc:3060] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:16.591133 28364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3645480b1e2b453682244c34a005703d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:16.592729 28364 raft_consensus.cc:3055] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:16.593021 28364 raft_consensus.cc:740] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:16.593896 28364 consensus_queue.cc:260] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:16.595196 28364 raft_consensus.cc:3060] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:16.602161 28441 raft_consensus.cc:2468] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:16.603159 28364 raft_consensus.cc:2468] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 3.
I20260709 12:13:16.603298 29079 leader_election.cc:304] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:16.604198 29379 raft_consensus.cc:2804] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:16.604687 29379 raft_consensus.cc:697] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:16.606056 29379 consensus_queue.cc:237] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:16.616700 28191 catalog_manager.cc:5697] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 2 to 3, leader changed from b94463539fe9492dbae13ef77b3cc58d (127.20.56.66) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 3 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.632741 29364 raft_consensus.cc:993] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.633380 29343 raft_consensus.cc:1081] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.635200 29131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42574
I20260709 12:13:16.635685 29131 raft_consensus.cc:493] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:16.635963 29131 raft_consensus.cc:3060] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.642637 29131 raft_consensus.cc:515] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:16.645143 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:16.645807 28515 raft_consensus.cc:3055] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:16.646098 28515 raft_consensus.cc:740] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:16.646298 29131 leader_election.cc:290] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:16.646811 28515 consensus_queue.cc:260] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:16.647804 28515 raft_consensus.cc:3060] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.650832 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7829e294fab4d1187889634a3fca00d" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:16.651392 28365 raft_consensus.cc:3060] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.654750 28515 raft_consensus.cc:2468] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:16.656064 29079 leader_election.cc:304] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:16.657763 29357 raft_consensus.cc:2804] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:16.658214 29357 raft_consensus.cc:697] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:16.659179 29357 consensus_queue.cc:237] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:16.661106 28365 raft_consensus.cc:2468] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:16.669960 28191 catalog_manager.cc:5697] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 1 to 2, leader changed from 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.786739 29350 raft_consensus.cc:993] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.787220 29381 raft_consensus.cc:1081] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:16.788682 29128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42600
I20260709 12:13:16.789147 29128 raft_consensus.cc:493] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:16.789439 29128 raft_consensus.cc:3060] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.794889 29128 raft_consensus.cc:515] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:16.796623 29128 leader_election.cc:290] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:16.799127 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:16.798350 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ccf65866fb4d91aee23f2b55e9c293" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:16.800156 28515 raft_consensus.cc:3060] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.802775 28365 raft_consensus.cc:3055] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:16.803146 28365 raft_consensus.cc:740] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:16.804991 28365 consensus_queue.cc:260] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:16.806349 28365 raft_consensus.cc:3060] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.812744 28365 raft_consensus.cc:2468] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:16.812835 28515 raft_consensus.cc:2468] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:16.813948 29078 leader_election.cc:304] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:16.814762 29379 raft_consensus.cc:2804] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:16.815192 29379 raft_consensus.cc:697] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:16.816087 29379 consensus_queue.cc:237] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:16.825816 28191 catalog_manager.cc:5697] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 1 to 2, leader changed from b94463539fe9492dbae13ef77b3cc58d (127.20.56.66) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.973762 28515 raft_consensus.cc:1275] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:16.975206 29379 consensus_queue.cc:1048] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:16.986903 28441 raft_consensus.cc:1275] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:16.993865 29357 consensus_queue.cc:1048] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:17.026928 28510 raft_consensus.cc:1275] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.030336 29409 consensus_queue.cc:1048] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:17.059275 28365 raft_consensus.cc:1275] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.060983 29406 consensus_queue.cc:1048] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:17.092906 28365 raft_consensus.cc:1275] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:17.094486 29379 consensus_queue.cc:1048] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:17.109541 28434 raft_consensus.cc:1275] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:17.111040 29406 consensus_queue.cc:1048] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:17.112332 28510 raft_consensus.cc:1275] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.114193 29406 consensus_queue.cc:1048] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:17.159191 28365 raft_consensus.cc:1275] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.160753 29406 consensus_queue.cc:1048] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:17.278532 28365 raft_consensus.cc:1275] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.279847 29406 consensus_queue.cc:1048] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:17.290468 28515 raft_consensus.cc:1275] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.292198 29406 consensus_queue.cc:1048] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:17.362579 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:17.420678 28441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d8ee4c616f484ca8ad342b1c3e38f7"
dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45962
I20260709 12:13:17.421188 28441 raft_consensus.cc:606] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:17.423679 28441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366"
dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45962
I20260709 12:13:17.424147 28441 raft_consensus.cc:606] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:17.426713 28441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978"
dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
mode: GRACEFUL
new_leader_uuid: "1be5ce5bff4b443ea67188eb0de32215"
 from {username='slave'} at 127.0.0.1:45962
I20260709 12:13:17.427253 28441 raft_consensus.cc:606] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Received request to transfer leadership to TS 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:17.429441 28441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b"
dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45962
I20260709 12:13:17.429881 28441 raft_consensus.cc:606] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:17.430898 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:17.432061 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:17.432654 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:17.465476 29347 raft_consensus.cc:993] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:17.466082 29347 raft_consensus.cc:1081] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:17.468050 29128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42584
I20260709 12:13:17.468604 29128 raft_consensus.cc:493] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.468978 29128 raft_consensus.cc:3060] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.475579 29128 raft_consensus.cc:515] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:17.477356 29128 leader_election.cc:290] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:17.478212 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:17.478881 28441 raft_consensus.cc:3055] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.479161 28441 raft_consensus.cc:740] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:13:17.479403 28510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fcb1aed94e25b3402ef6cda0df9b" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:17.479859 28441 consensus_queue.cc:260] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:17.480064 28510 raft_consensus.cc:3060] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.481161 28441 raft_consensus.cc:3060] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.487118 28510 raft_consensus.cc:2468] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:17.487709 28441 raft_consensus.cc:2468] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:17.489022 29079 leader_election.cc:304] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:17.489821 29379 raft_consensus.cc:2804] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.490331 29379 raft_consensus.cc:697] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:17.491243 29379 consensus_queue.cc:237] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:17.501406 28189 catalog_manager.cc:5697] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 1 to 2, leader changed from f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.561333 29046 raft_consensus.cc:993] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4: : Instructing follower 1be5ce5bff4b443ea67188eb0de32215 to start an election
I20260709 12:13:17.561856 29354 raft_consensus.cc:1081] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Signalling peer 1be5ce5bff4b443ea67188eb0de32215 to start an election
I20260709 12:13:17.563354 28510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978"
dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
 from {username='slave'} at 127.0.0.1:57322
I20260709 12:13:17.563813 28510 raft_consensus.cc:493] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.564101 28510 raft_consensus.cc:3060] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.568885 28510 raft_consensus.cc:515] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:17.570677 28510 leader_election.cc:290] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:17.571864 28441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:17.571695 28364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:17.572448 28441 raft_consensus.cc:3055] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.572515 28364 raft_consensus.cc:3060] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.572873 28441 raft_consensus.cc:740] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:13:17.573734 28441 consensus_queue.cc:260] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:17.575064 28441 raft_consensus.cc:3060] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.580209 28364 raft_consensus.cc:2468] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:17.580603 29046 raft_consensus.cc:993] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:17.581231 29046 raft_consensus.cc:1081] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:17.582036 28481 leader_election.cc:304] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:17.583036 29128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60d8ee4c616f484ca8ad342b1c3e38f7"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42584
I20260709 12:13:17.583702 29128 raft_consensus.cc:493] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.584621 29128 raft_consensus.cc:3060] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.585515 28441 raft_consensus.cc:2468] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:17.583292 29343 raft_consensus.cc:2804] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.586807 29343 raft_consensus.cc:697] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:17.587836 29343 consensus_queue.cc:237] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:17.590293 29128 raft_consensus.cc:515] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:17.593510 29128 leader_election.cc:290] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:17.594453 28364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d8ee4c616f484ca8ad342b1c3e38f7" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:17.595198 28364 raft_consensus.cc:3060] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.597028 28438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d8ee4c616f484ca8ad342b1c3e38f7" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:17.599050 28438 raft_consensus.cc:3055] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.599375 28438 raft_consensus.cc:740] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:13:17.600291 28438 consensus_queue.cc:260] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:17.601982 28438 raft_consensus.cc:3060] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.603962 28189 catalog_manager.cc:5697] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 2, leader changed from f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.605214 28364 raft_consensus.cc:2468] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:17.606624 29078 leader_election.cc:304] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d; no voters: 
I20260709 12:13:17.607506 29379 raft_consensus.cc:2804] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.608011 29379 raft_consensus.cc:697] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:17.608979 29379 consensus_queue.cc:237] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } }
I20260709 12:13:17.610034 28438 raft_consensus.cc:2468] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:17.620303 28189 catalog_manager.cc:5697] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 1 to 2, leader changed from f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.739377 29421 raft_consensus.cc:993] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:17.739889 29421 raft_consensus.cc:1081] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:17.741530 29128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42584
I20260709 12:13:17.742146 29128 raft_consensus.cc:493] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.742549 29128 raft_consensus.cc:3060] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.749567 29128 raft_consensus.cc:515] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:17.751293 29128 leader_election.cc:290] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:17.752007 28438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:17.752357 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "682d7ecbc3044139871db2d4bf0e3366" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:17.753567 28515 raft_consensus.cc:3060] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.752895 28438 raft_consensus.cc:3055] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.754272 28438 raft_consensus.cc:740] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ce5f603caa48ababe023df3a36c0b4, State: Running, Role: LEADER
I20260709 12:13:17.755384 28438 consensus_queue.cc:260] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:17.757006 28438 raft_consensus.cc:3060] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.761718 28515 raft_consensus.cc:2468] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:17.763100 28438 raft_consensus.cc:2468] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:17.763257 29079 leader_election.cc:304] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:17.764271 29379 raft_consensus.cc:2804] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.764801 29379 raft_consensus.cc:697] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:17.765733 29379 consensus_queue.cc:237] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } }
I20260709 12:13:17.776669 28189 catalog_manager.cc:5697] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 1 to 2, leader changed from f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.039453 28510 raft_consensus.cc:1275] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.040647 29379 consensus_queue.cc:1048] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.042898 28365 raft_consensus.cc:1275] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.048710 29379 consensus_queue.cc:1048] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:18.077042 28441 raft_consensus.cc:1275] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.081598 29406 consensus_queue.cc:1048] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:18.113422 28438 raft_consensus.cc:1275] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.115374 29406 consensus_queue.cc:1048] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:13:18.152602 28365 raft_consensus.cc:1275] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.154109 29343 consensus_queue.cc:1048] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.158936 28434 raft_consensus.cc:1275] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.162561 29343 consensus_queue.cc:1048] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:18.179483 28510 raft_consensus.cc:1275] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.181264 29437 consensus_queue.cc:1048] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.276755 28434 raft_consensus.cc:1275] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.286727 29437 consensus_queue.cc:1048] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:18.294358 28481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:42205, user_credentials={real_user=slave}} blocked reactor thread for 59789.3us
I20260709 12:13:18.473248 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.512598 28515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978"
dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
mode: GRACEFUL
new_leader_uuid: "b94463539fe9492dbae13ef77b3cc58d"
 from {username='slave'} at 127.0.0.1:45118
I20260709 12:13:18.513228 28515 raft_consensus.cc:606] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Received request to transfer leadership to TS b94463539fe9492dbae13ef77b3cc58d
I20260709 12:13:18.514473 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:18.515875 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:18.516484 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.654345 29430 raft_consensus.cc:993] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215: : Instructing follower b94463539fe9492dbae13ef77b3cc58d to start an election
I20260709 12:13:18.654999 29364 raft_consensus.cc:1081] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Signalling peer b94463539fe9492dbae13ef77b3cc58d to start an election
I20260709 12:13:18.656409 28364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978"
dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
 from {username='slave'} at 127.0.0.1:57086
I20260709 12:13:18.656810 28364 raft_consensus.cc:493] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.657030 28364 raft_consensus.cc:3060] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:18.662521 28364 raft_consensus.cc:515] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:18.664888 28364 leader_election.cc:290] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 3 election: Requested vote from peers f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727), 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813)
I20260709 12:13:18.665441 28434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:18.665795 28515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcfa392d0584f04a0336c49ccd20978" candidate_uuid: "b94463539fe9492dbae13ef77b3cc58d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:18.666150 28434 raft_consensus.cc:3060] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:18.666401 28515 raft_consensus.cc:3055] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:18.666779 28515 raft_consensus.cc:740] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:18.667438 28515 consensus_queue.cc:260] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:18.668365 28515 raft_consensus.cc:3060] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:18.671377 28434 raft_consensus.cc:2468] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 3.
I20260709 12:13:18.672706 28334 leader_election.cc:304] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b94463539fe9492dbae13ef77b3cc58d, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:18.673156 28515 raft_consensus.cc:2468] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94463539fe9492dbae13ef77b3cc58d in term 3.
I20260709 12:13:18.673413 29422 raft_consensus.cc:2804] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:18.673939 29422 raft_consensus.cc:697] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 3 LEADER]: Becoming Leader. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:18.674799 29422 consensus_queue.cc:237] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:18.683878 28191 catalog_manager.cc:5697] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d reported cstate change: term changed from 2 to 3, leader changed from 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68) to b94463539fe9492dbae13ef77b3cc58d (127.20.56.66). New cstate: current_term: 3 leader_uuid: "b94463539fe9492dbae13ef77b3cc58d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.091832 28434 raft_consensus.cc:1275] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:19.092934 29400 consensus_queue.cc:1048] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:19.106241 28515 raft_consensus.cc:1275] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Refusing update from remote peer b94463539fe9492dbae13ef77b3cc58d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:19.109127 29454 consensus_queue.cc:1048] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:19.555693 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.597528 28364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6"
dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
mode: GRACEFUL
new_leader_uuid: "1be5ce5bff4b443ea67188eb0de32215"
 from {username='slave'} at 127.0.0.1:33548
I20260709 12:13:19.598119 28364 raft_consensus.cc:606] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Received request to transfer leadership to TS 1be5ce5bff4b443ea67188eb0de32215
I20260709 12:13:19.599910 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:19.601657 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:19.602440 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.790009 29400 raft_consensus.cc:993] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d: : Instructing follower 1be5ce5bff4b443ea67188eb0de32215 to start an election
I20260709 12:13:19.790534 29457 raft_consensus.cc:1081] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Signalling peer 1be5ce5bff4b443ea67188eb0de32215 to start an election
I20260709 12:13:19.792055 28510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6"
dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
 from {username='slave'} at 127.0.0.1:57346
I20260709 12:13:19.792704 28510 raft_consensus.cc:493] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.793123 28510 raft_consensus.cc:3060] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.799525 28510 raft_consensus.cc:515] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:19.801082 28510 leader_election.cc:290] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Requested vote from peers b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205), f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727)
I20260709 12:13:19.801729 28365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:19.802054 28438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad52a0462bc74b89b194589649de08d6" candidate_uuid: "1be5ce5bff4b443ea67188eb0de32215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4ce5f603caa48ababe023df3a36c0b4"
I20260709 12:13:19.802376 28365 raft_consensus.cc:3055] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.802806 28365 raft_consensus.cc:740] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b94463539fe9492dbae13ef77b3cc58d, State: Running, Role: LEADER
I20260709 12:13:19.802786 28438 raft_consensus.cc:3060] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.803681 28365 consensus_queue.cc:260] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:19.804948 28365 raft_consensus.cc:3060] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.810575 28438 raft_consensus.cc:2468] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:19.811923 28482 leader_election.cc:304] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, f4ce5f603caa48ababe023df3a36c0b4; no voters: 
I20260709 12:13:19.812693 29451 raft_consensus.cc:2804] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.812841 28365 raft_consensus.cc:2468] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be5ce5bff4b443ea67188eb0de32215 in term 2.
I20260709 12:13:19.813184 29451 raft_consensus.cc:697] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Becoming Leader. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:19.814133 29451 consensus_queue.cc:237] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } }
I20260709 12:13:19.823802 28189 catalog_manager.cc:5697] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 reported cstate change: term changed from 1 to 2, leader changed from b94463539fe9492dbae13ef77b3cc58d (127.20.56.66) to 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68). New cstate: current_term: 2 leader_uuid: "1be5ce5bff4b443ea67188eb0de32215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.219635 28437 raft_consensus.cc:1275] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.220790 29464 consensus_queue.cc:1048] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ce5f603caa48ababe023df3a36c0b4" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 39727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.232134 28365 raft_consensus.cc:1275] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 1be5ce5bff4b443ea67188eb0de32215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.234997 29464 consensus_queue.cc:1048] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.643386 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.692728 28515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698"
dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
mode: GRACEFUL
new_leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:45118
I20260709 12:13:20.693347 28515 raft_consensus.cc:606] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Received request to transfer leadership to TS 24654af7758f4a5ebc3e3a8fba0b617a
I20260709 12:13:20.694440 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:20.695586 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:20.696190 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.177235 29364 raft_consensus.cc:993] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215: : Instructing follower 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:21.177759 29464 raft_consensus.cc:1081] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Signalling peer 24654af7758f4a5ebc3e3a8fba0b617a to start an election
I20260709 12:13:21.179281 29128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698"
dest_uuid: "24654af7758f4a5ebc3e3a8fba0b617a"
 from {username='slave'} at 127.0.0.1:42574
I20260709 12:13:21.179752 29128 raft_consensus.cc:493] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.180044 29128 raft_consensus.cc:3060] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.186687 29128 raft_consensus.cc:515] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:21.188898 29128 leader_election.cc:290] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Requested vote from peers 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68:33813), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:21.191874 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b94463539fe9492dbae13ef77b3cc58d"
I20260709 12:13:21.192523 28368 raft_consensus.cc:3060] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.194571 28510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87893c2fc5894370a4e3427f4e429698" candidate_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1be5ce5bff4b443ea67188eb0de32215"
I20260709 12:13:21.195220 28510 raft_consensus.cc:3055] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.195498 28510 raft_consensus.cc:740] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1be5ce5bff4b443ea67188eb0de32215, State: Running, Role: LEADER
I20260709 12:13:21.196216 28510 consensus_queue.cc:260] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:21.197458 28510 raft_consensus.cc:3060] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.206468 28510 raft_consensus.cc:2468] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:21.207651 28368 raft_consensus.cc:2468] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24654af7758f4a5ebc3e3a8fba0b617a in term 2.
I20260709 12:13:21.207645 29079 leader_election.cc:304] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215, 24654af7758f4a5ebc3e3a8fba0b617a; no voters: 
I20260709 12:13:21.208657 29357 raft_consensus.cc:2804] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.209161 29357 raft_consensus.cc:697] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Becoming Leader. State: Replica: 24654af7758f4a5ebc3e3a8fba0b617a, State: Running, Role: LEADER
I20260709 12:13:21.209916 29357 consensus_queue.cc:237] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:21.219321 28191 catalog_manager.cc:5697] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a reported cstate change: term changed from 1 to 2, leader changed from 1be5ce5bff4b443ea67188eb0de32215 (127.20.56.68) to 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65). New cstate: current_term: 2 leader_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.646734 28515 raft_consensus.cc:1275] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.647727 29406 consensus_queue.cc:1048] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.657898 28368 raft_consensus.cc:1275] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Refusing update from remote peer 24654af7758f4a5ebc3e3a8fba0b617a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.659584 29357 consensus_queue.cc:1048] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.741199 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.779526 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:21.780542 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:21.781045 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.817847 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.852854 20705 tablet_server.cc:179] TabletServer@127.20.56.65:41545 shutting down...
W20260709 12:13:21.874405 28479 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 68 similar messages]
W20260709 12:13:21.891919 28479 consensus_peers.cc:597] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.901952 28331 consensus_peers.cc:597] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.908782 28405 consensus_peers.cc:597] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.910537 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:21.911388 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.912084 20705 raft_consensus.cc:2243] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:21.913043 20705 raft_consensus.cc:2272] T 87893c2fc5894370a4e3427f4e429698 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:21.917520 28405 consensus_peers.cc:597] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.918553 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.919517 20705 raft_consensus.cc:2243] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:21.920305 20705 raft_consensus.cc:2272] T c7829e294fab4d1187889634a3fca00d P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.922390 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.923030 20705 raft_consensus.cc:2243] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.923435 20705 raft_consensus.cc:2272] T b596443671174eda93522f0319b083f4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.925665 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.926304 20705 raft_consensus.cc:2243] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.926771 20705 raft_consensus.cc:2272] T d763609f275142958e76408fb898f06c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.929613 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.930559 20705 raft_consensus.cc:2243] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.931038 20705 raft_consensus.cc:2272] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.933314 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.933902 20705 raft_consensus.cc:2243] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.934309 20705 raft_consensus.cc:2272] T cfd7b4ba0d53419e909c0c82013ee595 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.936304 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.936951 20705 raft_consensus.cc:2243] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.937410 20705 raft_consensus.cc:2272] T 1868e15012414126a99e7722148f94c4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.940033 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.940655 20705 raft_consensus.cc:2243] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:21.941391 20705 raft_consensus.cc:2272] T 3645480b1e2b453682244c34a005703d P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.943593 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.944213 20705 raft_consensus.cc:2243] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.944692 20705 raft_consensus.cc:2272] T 46f5691a910e47d185a194b58c0354ec P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.946935 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.947513 20705 raft_consensus.cc:2243] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.947983 20705 raft_consensus.cc:2272] T 9c5100047ea944e6b83b2f8380c39aea P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.950845 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.951823 20705 raft_consensus.cc:2243] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.952313 20705 raft_consensus.cc:2272] T 14c08416cd39400bab947ef583ee460e P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:21.953706 28405 consensus_peers.cc:597] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.955251 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.955969 20705 raft_consensus.cc:2243] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:21.956724 20705 raft_consensus.cc:2272] T 682d7ecbc3044139871db2d4bf0e3366 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.958781 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.959383 20705 raft_consensus.cc:2243] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.959825 20705 raft_consensus.cc:2272] T 0e8c55ad801343058a6dd2912c0ec74f P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.961823 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.962385 20705 raft_consensus.cc:2243] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.962831 20705 raft_consensus.cc:2272] T cd7a6a734ce644a486516976d29d7854 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.964769 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.965318 20705 raft_consensus.cc:2243] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:21.966082 20705 raft_consensus.cc:2272] T 60d8ee4c616f484ca8ad342b1c3e38f7 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.968336 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.969180 20705 raft_consensus.cc:2243] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.969699 20705 raft_consensus.cc:2272] T 812a02f7b3bf4f248ce40cb391061654 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.972525 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.973152 20705 raft_consensus.cc:2243] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:21.974026 20705 raft_consensus.cc:2272] T 8449846c74a54c40a37e2b241c98f91a P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.976688 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.977437 20705 raft_consensus.cc:2243] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.977942 20705 raft_consensus.cc:2272] T 16779d1254f44e36b7db87097319a69e P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:21.986177 28479 consensus_peers.cc:597] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.986918 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.987869 20705 raft_consensus.cc:2243] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.988394 20705 raft_consensus.cc:2272] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:21.988691 28405 consensus_peers.cc:597] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.991580 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.992856 20705 raft_consensus.cc:2243] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.993479 20705 raft_consensus.cc:2272] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:21.996268 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:21.997121 20705 raft_consensus.cc:2243] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:21.997534 20705 raft_consensus.cc:2272] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.000486 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.001308 20705 raft_consensus.cc:2243] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.001801 20705 raft_consensus.cc:2272] T 26b53fc8bee74341af2a3b4395afbb61 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.004117 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.004848 20705 raft_consensus.cc:2243] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.005753 20705 raft_consensus.cc:2272] T a822aa07b6a04f6e83685d3f67ed26d9 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.007783 28479 consensus_peers.cc:597] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.008543 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.009282 20705 raft_consensus.cc:2243] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.010154 20705 raft_consensus.cc:2272] T df473093e079470ca1369b516368ab05 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.012981 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.013767 20705 raft_consensus.cc:2243] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.014732 20705 raft_consensus.cc:2272] T 85e086c7173346b4938961a48ccb2a78 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.015669 28405 consensus_peers.cc:597] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.016038 28479 consensus_peers.cc:597] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.017459 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.018157 20705 raft_consensus.cc:2243] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.018567 20705 raft_consensus.cc:2272] T cf1e398ade0f49ea882023d45c3ca9dc P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.020643 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.021196 20705 raft_consensus.cc:2243] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.021953 20705 raft_consensus.cc:2272] T 0c089a99cd334841849bfd25380410fb P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.023849 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.024391 20705 raft_consensus.cc:2243] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.024821 20705 raft_consensus.cc:2272] T bb308f551c2c483eacd2ca20c16ec438 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.027273 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.027858 20705 raft_consensus.cc:2243] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.028688 20705 raft_consensus.cc:2272] T e5a87d2111494acab0739a6431f79b3a P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.031250 20705 tablet_replica.cc:333] stopping tablet replica
W20260709 12:13:22.032059 28331 consensus_peers.cc:597] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.032066 20705 raft_consensus.cc:2243] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.032809 20705 raft_consensus.cc:2272] T 50082d48fcb84e1487323de1942cbbda P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.034911 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.035765 20705 raft_consensus.cc:2243] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.036207 20705 raft_consensus.cc:2272] T cb63ff5948b2424688b706c82ee3f05b P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.038231 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.038817 20705 raft_consensus.cc:2243] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.039199 20705 raft_consensus.cc:2272] T bdd3950d455743f28ecbf1aa7548dc02 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.041314 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.041868 20705 raft_consensus.cc:2243] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.042686 20705 raft_consensus.cc:2272] T c549fcb1aed94e25b3402ef6cda0df9b P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.044703 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.045271 20705 raft_consensus.cc:2243] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.045635 20705 raft_consensus.cc:2272] T ad3311f3d8df44b1a7b5123aca90c564 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.047734 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.048365 20705 raft_consensus.cc:2243] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.048836 20705 raft_consensus.cc:2272] T 5c8664110bc84069a332ebad298106ac P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.051029 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.051563 20705 raft_consensus.cc:2243] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.051962 20705 raft_consensus.cc:2272] T e41a2a37b60547569fea429a0ebaf169 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.054579 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.055294 20705 raft_consensus.cc:2243] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.056265 20705 raft_consensus.cc:2272] T 84f96d100bb7432592bc9f8aa85db576 P 24654af7758f4a5ebc3e3a8fba0b617a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.059010 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.059772 20705 raft_consensus.cc:2243] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.060245 20705 raft_consensus.cc:2272] T d7e80e45a85c4f95a89fbcd97a133177 P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.060283 28405 consensus_peers.cc:597] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.062618 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.063174 20705 raft_consensus.cc:2243] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.063686 20705 raft_consensus.cc:2272] T d22aef3d88a14b85bdb3763051f26d0f P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.066257 20705 tablet_replica.cc:333] stopping tablet replica
W20260709 12:13:22.066931 28405 consensus_peers.cc:597] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.066998 20705 raft_consensus.cc:2243] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.067728 20705 raft_consensus.cc:2272] T 376f42083a394141ba0bc9cd40ea7f40 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.069847 28405 consensus_peers.cc:597] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.070647 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.071350 20705 raft_consensus.cc:2243] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:22.071725 28479 consensus_peers.cc:597] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.071832 20705 raft_consensus.cc:2272] T 2a539209b26a46fa8275b3913fc0371c P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.074664 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.075230 20705 raft_consensus.cc:2243] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.075635 20705 raft_consensus.cc:2272] T cd7f53771e4d49d49b819836af06d45f P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.077818 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.078305 20705 raft_consensus.cc:2243] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.079073 20705 raft_consensus.cc:2272] T 61ccf65866fb4d91aee23f2b55e9c293 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.081058 28331 consensus_peers.cc:597] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.081346 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.081954 20705 raft_consensus.cc:2243] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.082451 20705 raft_consensus.cc:2272] T 75b9e10e4b584dd0bdc388ba5535e94a P 24654af7758f4a5ebc3e3a8fba0b617a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.085255 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:22.085856 20705 raft_consensus.cc:2243] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:22.085918 28479 consensus_peers.cc:597] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.086383 20705 raft_consensus.cc:2272] T d549a198d01a4258a83fe8e713a96f94 P 24654af7758f4a5ebc3e3a8fba0b617a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.095048 28479 consensus_peers.cc:597] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.109740 28405 consensus_peers.cc:597] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.126271 28479 consensus_peers.cc:597] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.159525 28479 consensus_peers.cc:597] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.160151 28479 consensus_peers.cc:597] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.163153 20705 tablet_server.cc:196] TabletServer@127.20.56.65:41545 shutdown complete.
W20260709 12:13:22.193997 28405 consensus_peers.cc:597] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.213583 28331 consensus_peers.cc:597] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.247648 20705 tablet_server.cc:179] TabletServer@127.20.56.66:0 shutting down...
W20260709 12:13:22.251214 28331 consensus_peers.cc:597] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.277684 28331 consensus_peers.cc:597] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.292337 28405 consensus_peers.cc:597] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.300930 28481 consensus_peers.cc:597] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.306922 28407 consensus_peers.cc:597] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.307410 28331 consensus_peers.cc:597] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.307982 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:22.308936 20705 tablet_replica.cc:333] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.310060 20705 raft_consensus.cc:2243] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.310722 20705 raft_consensus.cc:2272] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.312479 28407 consensus_peers.cc:597] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.313752 20705 tablet_replica.cc:333] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.314775 20705 raft_consensus.cc:2243] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.315325 20705 raft_consensus.cc:2272] T ad52a0462bc74b89b194589649de08d6 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.316391 28405 consensus_peers.cc:597] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.317700 20705 tablet_replica.cc:333] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.318382 20705 raft_consensus.cc:2243] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.318858 20705 raft_consensus.cc:2272] T 3645480b1e2b453682244c34a005703d P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.320964 28407 consensus_peers.cc:597] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.321321 20705 tablet_replica.cc:333] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.322067 20705 raft_consensus.cc:2243] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.322566 20705 raft_consensus.cc:2272] T d763609f275142958e76408fb898f06c P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.324633 20705 tablet_replica.cc:333] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.325143 20705 raft_consensus.cc:2243] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.326036 20705 raft_consensus.cc:2272] T ad3311f3d8df44b1a7b5123aca90c564 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.328332 20705 tablet_replica.cc:333] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.328959 20705 raft_consensus.cc:2243] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.329840 20705 raft_consensus.cc:2272] T 5ac6a84976de403eba7d0dc88138e12a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.331162 28481 consensus_peers.cc:597] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.332224 20705 tablet_replica.cc:333] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.332993 20705 raft_consensus.cc:2243] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.334036 20705 raft_consensus.cc:2272] T 0e8c55ad801343058a6dd2912c0ec74f P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.336771 20705 tablet_replica.cc:333] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.337529 20705 raft_consensus.cc:2243] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.338496 20705 raft_consensus.cc:2272] T d6eec19560a14a8db0c4d338da3a1cba P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.341276 20705 tablet_replica.cc:333] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.342073 20705 raft_consensus.cc:2243] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.342631 20705 raft_consensus.cc:2272] T e5a87d2111494acab0739a6431f79b3a P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.345634 20705 tablet_replica.cc:333] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.346525 20705 raft_consensus.cc:2243] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.347033 20705 raft_consensus.cc:2272] T d7e80e45a85c4f95a89fbcd97a133177 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.348201 28405 consensus_peers.cc:597] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 -> Peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Couldn't send request to peer 24654af7758f4a5ebc3e3a8fba0b617a. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.348408 28407 consensus_peers.cc:597] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.349784 20705 tablet_replica.cc:333] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
W20260709 12:13:22.349960 28481 consensus_peers.cc:597] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.350802 20705 raft_consensus.cc:2243] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.351353 20705 raft_consensus.cc:2272] T 87893c2fc5894370a4e3427f4e429698 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.354569 20705 tablet_replica.cc:333] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.355170 20705 raft_consensus.cc:2243] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.355706 20705 raft_consensus.cc:2272] T 812a02f7b3bf4f248ce40cb391061654 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.358466 20705 tablet_replica.cc:333] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.359128 20705 raft_consensus.cc:2243] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.359572 20705 raft_consensus.cc:2272] T 6a3ee9b579654f3b8a3ad484468fa8e4 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.362042 20705 tablet_replica.cc:333] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.362753 20705 raft_consensus.cc:2243] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.363191 20705 raft_consensus.cc:2272] T 60d8ee4c616f484ca8ad342b1c3e38f7 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.365660 20705 tablet_replica.cc:333] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.366511 20705 raft_consensus.cc:2243] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.367311 20705 raft_consensus.cc:2272] T 95d7c46e81fa49a29180a4eb5a184bdf P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.369235 20705 tablet_replica.cc:333] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.369846 20705 raft_consensus.cc:2243] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.370692 20705 raft_consensus.cc:2272] T e41a2a37b60547569fea429a0ebaf169 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.372879 20705 tablet_replica.cc:333] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.373660 20705 raft_consensus.cc:2243] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.374155 20705 raft_consensus.cc:2272] T df473093e079470ca1369b516368ab05 P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.376866 20705 tablet_replica.cc:333] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.377604 20705 raft_consensus.cc:2243] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.378149 20705 raft_consensus.cc:2272] T db65629d3046492494cc69476c4eec2a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.381017 20705 tablet_replica.cc:333] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.381764 20705 raft_consensus.cc:2243] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:22.381811 28481 consensus_peers.cc:597] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.382302 20705 raft_consensus.cc:2272] T 81456624ac7a4b579c782075291f8cbf P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.385087 20705 tablet_replica.cc:333] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.385627 20705 raft_consensus.cc:2243] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.386365 20705 raft_consensus.cc:2272] T d549a198d01a4258a83fe8e713a96f94 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.387632 28481 consensus_peers.cc:597] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.388473 20705 tablet_replica.cc:333] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.389096 20705 raft_consensus.cc:2243] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.389513 20705 raft_consensus.cc:2272] T 61ccf65866fb4d91aee23f2b55e9c293 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.391700 20705 tablet_replica.cc:333] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.393697 20705 raft_consensus.cc:2243] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.394222 20705 raft_consensus.cc:2272] T 75b9e10e4b584dd0bdc388ba5535e94a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.395335 28407 consensus_peers.cc:597] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.396728 20705 tablet_replica.cc:333] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.397622 20705 raft_consensus.cc:2243] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:22.397995 28407 consensus_peers.cc:597] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.398150 20705 raft_consensus.cc:2272] T cf1e398ade0f49ea882023d45c3ca9dc P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.401010 20705 tablet_replica.cc:333] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.401831 20705 raft_consensus.cc:2243] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.402312 20705 raft_consensus.cc:2272] T bb308f551c2c483eacd2ca20c16ec438 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.404522 28407 consensus_peers.cc:597] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.404909 20705 tablet_replica.cc:333] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.405567 20705 raft_consensus.cc:2243] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.406467 20705 raft_consensus.cc:2272] T f905442aa27c4a6390b8baca69e6b031 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.408859 20705 tablet_replica.cc:333] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.409575 20705 raft_consensus.cc:2243] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.409996 20705 raft_consensus.cc:2272] T 3b567deb01fe4f3fb96d69d4943fece9 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.411864 20705 tablet_replica.cc:333] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.412356 20705 raft_consensus.cc:2243] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.412693 20705 raft_consensus.cc:2272] T c7829e294fab4d1187889634a3fca00d P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.414630 20705 tablet_replica.cc:333] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.415159 20705 raft_consensus.cc:2243] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.415985 20705 raft_consensus.cc:2272] T 9c5100047ea944e6b83b2f8380c39aea P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.417951 20705 tablet_replica.cc:333] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.418586 20705 raft_consensus.cc:2243] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.419322 20705 raft_consensus.cc:2272] T 14c08416cd39400bab947ef583ee460e P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.421140 20705 tablet_replica.cc:333] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.421672 20705 raft_consensus.cc:2243] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.422508 20705 raft_consensus.cc:2272] T 7ecabc7c175741e28392767184e77da1 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.424549 20705 tablet_replica.cc:333] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.425016 20705 raft_consensus.cc:2243] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.425372 20705 raft_consensus.cc:2272] T cd7a6a734ce644a486516976d29d7854 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.427158 20705 tablet_replica.cc:333] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.427731 20705 raft_consensus.cc:2243] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.428463 20705 raft_consensus.cc:2272] T 7bcfa392d0584f04a0336c49ccd20978 P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.430428 20705 tablet_replica.cc:333] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.430948 20705 raft_consensus.cc:2243] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.431353 20705 raft_consensus.cc:2272] T 2a539209b26a46fa8275b3913fc0371c P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.433267 20705 tablet_replica.cc:333] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.433779 20705 raft_consensus.cc:2243] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.434177 20705 raft_consensus.cc:2272] T cd7f53771e4d49d49b819836af06d45f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.436365 20705 tablet_replica.cc:333] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.437079 20705 raft_consensus.cc:2243] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.438108 20705 raft_consensus.cc:2272] T bdd3950d455743f28ecbf1aa7548dc02 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.438642 28407 consensus_peers.cc:597] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.440740 20705 tablet_replica.cc:333] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.441466 20705 raft_consensus.cc:2243] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.442283 20705 raft_consensus.cc:2272] T 5b2c38e0d98e4333a355f887eeaf2f8f P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.443059 28481 consensus_peers.cc:597] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.444509 20705 tablet_replica.cc:333] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.445176 20705 raft_consensus.cc:2243] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.445955 20705 raft_consensus.cc:2272] T 16779d1254f44e36b7db87097319a69e P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.447814 20705 tablet_replica.cc:333] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.448352 20705 raft_consensus.cc:2243] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.448746 20705 raft_consensus.cc:2272] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.450703 20705 tablet_replica.cc:333] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.451218 20705 raft_consensus.cc:2243] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.451689 20705 raft_consensus.cc:2272] T cc60c63aa0fa4aff83e4d3b918c9fc05 P b94463539fe9492dbae13ef77b3cc58d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.453613 20705 tablet_replica.cc:333] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.454088 20705 raft_consensus.cc:2243] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.454507 20705 raft_consensus.cc:2272] T 850ee7c88fe1482985405700cf63d47a P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.456338 20705 tablet_replica.cc:333] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.456786 20705 raft_consensus.cc:2243] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.457137 20705 raft_consensus.cc:2272] T 8449846c74a54c40a37e2b241c98f91a P b94463539fe9492dbae13ef77b3cc58d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.459005 20705 tablet_replica.cc:333] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.459462 20705 raft_consensus.cc:2243] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.459816 20705 raft_consensus.cc:2272] T 46f5691a910e47d185a194b58c0354ec P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.461526 20705 tablet_replica.cc:333] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.461951 20705 raft_consensus.cc:2243] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.462293 20705 raft_consensus.cc:2272] T 26b53fc8bee74341af2a3b4395afbb61 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.463991 20705 tablet_replica.cc:333] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d: stopping tablet replica
I20260709 12:13:22.464409 20705 raft_consensus.cc:2243] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.464757 20705 raft_consensus.cc:2272] T e3bd7017cc434cb0b7084f3bd57bc5b4 P b94463539fe9492dbae13ef77b3cc58d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.480260 28407 consensus_peers.cc:597] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.513578 28407 consensus_peers.cc:597] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.524756 28481 connection.cc:573] client connection to 127.20.56.66:42205 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:13:22.528765 28481 consensus_peers.cc:597] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:42205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.545512 20705 tablet_server.cc:196] TabletServer@127.20.56.66:0 shutdown complete.
W20260709 12:13:22.548235 28481 consensus_peers.cc:597] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:42205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.639153 20705 tablet_server.cc:179] TabletServer@127.20.56.67:0 shutting down...
W20260709 12:13:22.650439 28482 consensus_peers.cc:597] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 -> Peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Couldn't send request to peer f4ce5f603caa48ababe023df3a36c0b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.651070 28482 consensus_peers.cc:597] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 -> Peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Couldn't send request to peer f4ce5f603caa48ababe023df3a36c0b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.664825 28407 consensus_peers.cc:597] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:42205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.691318 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:22.692283 20705 tablet_replica.cc:333] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.693885 20705 raft_consensus.cc:2243] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.694530 20705 raft_consensus.cc:2272] T ad52a0462bc74b89b194589649de08d6 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.697114 20705 tablet_replica.cc:333] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.697938 20705 raft_consensus.cc:2243] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.698458 20705 raft_consensus.cc:2272] T 3645480b1e2b453682244c34a005703d P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.700425 20705 tablet_replica.cc:333] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.701141 20705 raft_consensus.cc:2243] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.701552 20705 raft_consensus.cc:2272] T 50082d48fcb84e1487323de1942cbbda P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.703447 20705 tablet_replica.cc:333] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.704010 20705 raft_consensus.cc:2243] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.704541 20705 raft_consensus.cc:2272] T d6eec19560a14a8db0c4d338da3a1cba P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.707260 20705 tablet_replica.cc:333] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.708050 20705 raft_consensus.cc:2243] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.709002 20705 raft_consensus.cc:2272] T 415e5a1b64b14a7d8cc7ec3b64f5cc26 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.710316 28481 consensus_peers.cc:597] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:42205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.711630 20705 tablet_replica.cc:333] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.712448 20705 raft_consensus.cc:2243] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.712868 20705 raft_consensus.cc:2272] T 5ac6a84976de403eba7d0dc88138e12a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.715576 20705 tablet_replica.cc:333] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.716346 20705 raft_consensus.cc:2243] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.716856 20705 raft_consensus.cc:2272] T 85e086c7173346b4938961a48ccb2a78 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.718959 20705 tablet_replica.cc:333] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.719561 20705 raft_consensus.cc:2243] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.720620 20705 raft_consensus.cc:2272] T 26b53fc8bee74341af2a3b4395afbb61 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.723094 20705 tablet_replica.cc:333] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.723892 20705 raft_consensus.cc:2243] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.724376 20705 raft_consensus.cc:2272] T 7ecabc7c175741e28392767184e77da1 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.726552 20705 tablet_replica.cc:333] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.727110 20705 raft_consensus.cc:2243] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.727916 20705 raft_consensus.cc:2272] T d22aef3d88a14b85bdb3763051f26d0f P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.730094 20705 tablet_replica.cc:333] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.730695 20705 raft_consensus.cc:2243] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.731484 20705 raft_consensus.cc:2272] T d7e80e45a85c4f95a89fbcd97a133177 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.733403 20705 tablet_replica.cc:333] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.733964 20705 raft_consensus.cc:2243] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.734783 20705 raft_consensus.cc:2272] T 376f42083a394141ba0bc9cd40ea7f40 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.736661 20705 tablet_replica.cc:333] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.737217 20705 raft_consensus.cc:2243] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.737632 20705 raft_consensus.cc:2272] T 95d7c46e81fa49a29180a4eb5a184bdf P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.739957 20705 tablet_replica.cc:333] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.740779 20705 raft_consensus.cc:2243] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.741308 20705 raft_consensus.cc:2272] T 16779d1254f44e36b7db87097319a69e P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.743464 20705 tablet_replica.cc:333] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.744234 20705 raft_consensus.cc:2243] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:22.744783 28481 consensus_peers.cc:597] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 -> Peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Couldn't send request to peer b94463539fe9492dbae13ef77b3cc58d. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:42205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.745232 20705 raft_consensus.cc:2272] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.747303 20705 tablet_replica.cc:333] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.747850 20705 raft_consensus.cc:2243] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.748627 20705 raft_consensus.cc:2272] T 850ee7c88fe1482985405700cf63d47a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.750680 20705 tablet_replica.cc:333] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.751155 20705 raft_consensus.cc:2243] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.751513 20705 raft_consensus.cc:2272] T 2010116c72334e7f8f3a3bf9d7ea06d1 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.753562 20705 tablet_replica.cc:333] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.754060 20705 raft_consensus.cc:2243] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.754846 20705 raft_consensus.cc:2272] T 812a02f7b3bf4f248ce40cb391061654 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.756788 20705 tablet_replica.cc:333] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.757365 20705 raft_consensus.cc:2243] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.757802 20705 raft_consensus.cc:2272] T 6a3ee9b579654f3b8a3ad484468fa8e4 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.759584 20705 tablet_replica.cc:333] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.760118 20705 raft_consensus.cc:2243] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.760546 20705 raft_consensus.cc:2272] T 60d8ee4c616f484ca8ad342b1c3e38f7 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.762310 20705 tablet_replica.cc:333] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.762915 20705 raft_consensus.cc:2243] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.763689 20705 raft_consensus.cc:2272] T cf1e398ade0f49ea882023d45c3ca9dc P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.765514 20705 tablet_replica.cc:333] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.766077 20705 raft_consensus.cc:2243] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.766873 20705 raft_consensus.cc:2272] T bb308f551c2c483eacd2ca20c16ec438 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.768702 20705 tablet_replica.cc:333] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.769240 20705 raft_consensus.cc:2243] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.769651 20705 raft_consensus.cc:2272] T 0c089a99cd334841849bfd25380410fb P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.771797 20705 tablet_replica.cc:333] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.772531 20705 raft_consensus.cc:2243] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.773021 20705 raft_consensus.cc:2272] T a822aa07b6a04f6e83685d3f67ed26d9 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.773782 28482 consensus_peers.cc:597] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Couldn't send request to peer f4ce5f603caa48ababe023df3a36c0b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.774865 20705 tablet_replica.cc:333] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.775489 20705 raft_consensus.cc:2243] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.775933 20705 raft_consensus.cc:2272] T df473093e079470ca1369b516368ab05 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.777776 20705 tablet_replica.cc:333] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.778316 20705 raft_consensus.cc:2243] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.778764 20705 raft_consensus.cc:2272] T db65629d3046492494cc69476c4eec2a P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.780717 20705 tablet_replica.cc:333] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.781273 20705 raft_consensus.cc:2243] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.781685 20705 raft_consensus.cc:2272] T 81456624ac7a4b579c782075291f8cbf P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.783636 20705 tablet_replica.cc:333] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.784183 20705 raft_consensus.cc:2243] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.784669 20705 raft_consensus.cc:2272] T f905442aa27c4a6390b8baca69e6b031 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.786506 20705 tablet_replica.cc:333] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.787045 20705 raft_consensus.cc:2243] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.787442 20705 raft_consensus.cc:2272] T 3b567deb01fe4f3fb96d69d4943fece9 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.789391 20705 tablet_replica.cc:333] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.789935 20705 raft_consensus.cc:2243] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.790347 20705 raft_consensus.cc:2272] T 14c08416cd39400bab947ef583ee460e P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.792557 20705 tablet_replica.cc:333] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.793190 20705 raft_consensus.cc:2243] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.793617 20705 raft_consensus.cc:2272] T cb63ff5948b2424688b706c82ee3f05b P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.795549 20705 tablet_replica.cc:333] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.796094 20705 raft_consensus.cc:2243] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.796497 20705 raft_consensus.cc:2272] T c549fcb1aed94e25b3402ef6cda0df9b P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.798496 20705 tablet_replica.cc:333] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.799010 20705 raft_consensus.cc:2243] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.799415 20705 raft_consensus.cc:2272] T 5b2c38e0d98e4333a355f887eeaf2f8f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.801405 20705 tablet_replica.cc:333] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.801970 20705 raft_consensus.cc:2243] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.802430 20705 raft_consensus.cc:2272] T bdd3950d455743f28ecbf1aa7548dc02 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.804466 20705 tablet_replica.cc:333] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.805017 20705 raft_consensus.cc:2243] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.805827 20705 raft_consensus.cc:2272] T b596443671174eda93522f0319b083f4 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.807834 20705 tablet_replica.cc:333] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.808344 20705 raft_consensus.cc:2243] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.809111 20705 raft_consensus.cc:2272] T cfd7b4ba0d53419e909c0c82013ee595 P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.811017 20705 tablet_replica.cc:333] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.811538 20705 raft_consensus.cc:2243] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.811949 20705 raft_consensus.cc:2272] T 1868e15012414126a99e7722148f94c4 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.813836 20705 tablet_replica.cc:333] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.814481 20705 raft_consensus.cc:2243] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.814954 20705 raft_consensus.cc:2272] T 7bcfa392d0584f04a0336c49ccd20978 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.817008 20705 tablet_replica.cc:333] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.817551 20705 raft_consensus.cc:2243] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.817996 20705 raft_consensus.cc:2272] T 84f96d100bb7432592bc9f8aa85db576 P f4ce5f603caa48ababe023df3a36c0b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.819911 20705 tablet_replica.cc:333] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.820441 20705 raft_consensus.cc:2243] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.820905 20705 raft_consensus.cc:2272] T 5c8664110bc84069a332ebad298106ac P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.822149 28482 consensus_peers.cc:597] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 -> Peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Couldn't send request to peer f4ce5f603caa48ababe023df3a36c0b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.822826 20705 tablet_replica.cc:333] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.823421 20705 raft_consensus.cc:2243] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.824141 20705 raft_consensus.cc:2272] T 46f5691a910e47d185a194b58c0354ec P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.825970 20705 tablet_replica.cc:333] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.826503 20705 raft_consensus.cc:2243] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.827396 20705 raft_consensus.cc:2272] T 2a539209b26a46fa8275b3913fc0371c P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.829249 20705 tablet_replica.cc:333] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.829689 20705 raft_consensus.cc:2243] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.830379 20705 raft_consensus.cc:2272] T cd7f53771e4d49d49b819836af06d45f P f4ce5f603caa48ababe023df3a36c0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.832229 20705 tablet_replica.cc:333] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4: stopping tablet replica
I20260709 12:13:22.832636 20705 raft_consensus.cc:2243] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.832970 20705 raft_consensus.cc:2272] T 682d7ecbc3044139871db2d4bf0e3366 P f4ce5f603caa48ababe023df3a36c0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.854966 28482 consensus_peers.cc:597] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Couldn't send request to peer f4ce5f603caa48ababe023df3a36c0b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.874508 28482 consensus_peers.cc:597] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Couldn't send request to peer f4ce5f603caa48ababe023df3a36c0b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.886991 28482 consensus_peers.cc:597] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 -> Peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Couldn't send request to peer f4ce5f603caa48ababe023df3a36c0b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.908233 20705 tablet_server.cc:196] TabletServer@127.20.56.67:0 shutdown complete.
I20260709 12:13:22.986074 20705 tablet_server.cc:179] TabletServer@127.20.56.68:0 shutting down...
W20260709 12:13:23.002345 28482 consensus_peers.cc:597] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 -> Peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Couldn't send request to peer f4ce5f603caa48ababe023df3a36c0b4. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.039115 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:23.039774 20705 tablet_replica.cc:333] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.040549 20705 raft_consensus.cc:2243] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.041603 20705 raft_consensus.cc:2272] T ad52a0462bc74b89b194589649de08d6 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.044256 20705 tablet_replica.cc:333] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.044938 20705 raft_consensus.cc:2243] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.045410 20705 raft_consensus.cc:2272] T 9c5100047ea944e6b83b2f8380c39aea P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.047351 20705 tablet_replica.cc:333] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.047901 20705 raft_consensus.cc:2243] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.048429 20705 raft_consensus.cc:2272] T 5ac6a84976de403eba7d0dc88138e12a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.050753 20705 tablet_replica.cc:333] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.051437 20705 raft_consensus.cc:2243] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.051927 20705 raft_consensus.cc:2272] T a822aa07b6a04f6e83685d3f67ed26d9 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.053772 20705 tablet_replica.cc:333] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.054548 20705 raft_consensus.cc:2243] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.054970 20705 raft_consensus.cc:2272] T 85e086c7173346b4938961a48ccb2a78 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.056808 20705 tablet_replica.cc:333] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.057443 20705 raft_consensus.cc:2243] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.057917 20705 raft_consensus.cc:2272] T 0e8c55ad801343058a6dd2912c0ec74f P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.058706 28482 consensus_peers.cc:597] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 -> Peer f4ce5f603caa48ababe023df3a36c0b4 (127.20.56.67:39727): Couldn't send request to peer f4ce5f603caa48ababe023df3a36c0b4. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.67:39727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.060091 20705 tablet_replica.cc:333] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.060739 20705 raft_consensus.cc:2243] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.061550 20705 raft_consensus.cc:2272] T 6a3ee9b579654f3b8a3ad484468fa8e4 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.063517 20705 tablet_replica.cc:333] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.064051 20705 raft_consensus.cc:2243] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.064741 20705 raft_consensus.cc:2272] T d763609f275142958e76408fb898f06c P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.066664 20705 tablet_replica.cc:333] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.067168 20705 raft_consensus.cc:2243] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.067550 20705 raft_consensus.cc:2272] T d22aef3d88a14b85bdb3763051f26d0f P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.069463 20705 tablet_replica.cc:333] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.069962 20705 raft_consensus.cc:2243] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.070737 20705 raft_consensus.cc:2272] T 50082d48fcb84e1487323de1942cbbda P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.072571 20705 tablet_replica.cc:333] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.073065 20705 raft_consensus.cc:2243] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.073396 20705 raft_consensus.cc:2272] T d6eec19560a14a8db0c4d338da3a1cba P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.075407 20705 tablet_replica.cc:333] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.075904 20705 raft_consensus.cc:2243] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.076261 20705 raft_consensus.cc:2272] T e5a87d2111494acab0739a6431f79b3a P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.077942 20705 tablet_replica.cc:333] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.078512 20705 raft_consensus.cc:2243] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.078887 20705 raft_consensus.cc:2272] T 376f42083a394141ba0bc9cd40ea7f40 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.080799 20705 tablet_replica.cc:333] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.081351 20705 raft_consensus.cc:2243] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.081702 20705 raft_consensus.cc:2272] T 1c8dc12e1a8c4cceab2d9e2b404fff28 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.083559 20705 tablet_replica.cc:333] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.084043 20705 raft_consensus.cc:2243] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.084719 20705 raft_consensus.cc:2272] T cc60c63aa0fa4aff83e4d3b918c9fc05 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.086480 20705 tablet_replica.cc:333] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.087062 20705 raft_consensus.cc:2243] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.087422 20705 raft_consensus.cc:2272] T 850ee7c88fe1482985405700cf63d47a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.089382 20705 tablet_replica.cc:333] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.089851 20705 raft_consensus.cc:2243] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.090564 20705 raft_consensus.cc:2272] T 2010116c72334e7f8f3a3bf9d7ea06d1 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.092275 20705 tablet_replica.cc:333] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.092924 20705 raft_consensus.cc:2243] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.093837 20705 raft_consensus.cc:2272] T db65629d3046492494cc69476c4eec2a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.095976 20705 tablet_replica.cc:333] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.096525 20705 raft_consensus.cc:2243] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.097304 20705 raft_consensus.cc:2272] T 81456624ac7a4b579c782075291f8cbf P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.099179 20705 tablet_replica.cc:333] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.099713 20705 raft_consensus.cc:2243] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.100129 20705 raft_consensus.cc:2272] T 0c089a99cd334841849bfd25380410fb P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.101866 20705 tablet_replica.cc:333] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.102396 20705 raft_consensus.cc:2243] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.102937 20705 raft_consensus.cc:2272] T 95d7c46e81fa49a29180a4eb5a184bdf P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.104781 20705 tablet_replica.cc:333] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.105311 20705 raft_consensus.cc:2243] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.105736 20705 raft_consensus.cc:2272] T 84f96d100bb7432592bc9f8aa85db576 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.107709 20705 tablet_replica.cc:333] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.108250 20705 raft_consensus.cc:2243] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.108655 20705 raft_consensus.cc:2272] T e41a2a37b60547569fea429a0ebaf169 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.110390 20705 tablet_replica.cc:333] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.111030 20705 raft_consensus.cc:2243] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.111461 20705 raft_consensus.cc:2272] T d549a198d01a4258a83fe8e713a96f94 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.113121 20705 tablet_replica.cc:333] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.113659 20705 raft_consensus.cc:2243] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.114106 20705 raft_consensus.cc:2272] T 61ccf65866fb4d91aee23f2b55e9c293 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.115860 20705 tablet_replica.cc:333] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.116384 20705 raft_consensus.cc:2243] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.117264 20705 raft_consensus.cc:2272] T 75b9e10e4b584dd0bdc388ba5535e94a P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.119256 20705 tablet_replica.cc:333] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.119786 20705 raft_consensus.cc:2243] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.120188 20705 raft_consensus.cc:2272] T f905442aa27c4a6390b8baca69e6b031 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.121979 20705 tablet_replica.cc:333] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.122551 20705 raft_consensus.cc:2243] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.123446 20705 raft_consensus.cc:2272] T 3b567deb01fe4f3fb96d69d4943fece9 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.125625 20705 tablet_replica.cc:333] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.126500 20705 raft_consensus.cc:2243] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.127048 20705 raft_consensus.cc:2272] T 7bcfa392d0584f04a0336c49ccd20978 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.129528 20705 tablet_replica.cc:333] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.130204 20705 raft_consensus.cc:2243] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.130692 20705 raft_consensus.cc:2272] T 7ecabc7c175741e28392767184e77da1 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.132979 20705 tablet_replica.cc:333] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.133671 20705 raft_consensus.cc:2243] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.134718 20705 raft_consensus.cc:2272] T cd7a6a734ce644a486516976d29d7854 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.137188 20705 tablet_replica.cc:333] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.137921 20705 raft_consensus.cc:2243] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.138461 20705 raft_consensus.cc:2272] T b596443671174eda93522f0319b083f4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.140734 20705 tablet_replica.cc:333] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.141281 20705 raft_consensus.cc:2243] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.141691 20705 raft_consensus.cc:2272] T cfd7b4ba0d53419e909c0c82013ee595 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.143632 20705 tablet_replica.cc:333] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.144275 20705 raft_consensus.cc:2243] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.145069 20705 raft_consensus.cc:2272] T 1868e15012414126a99e7722148f94c4 P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.147018 20705 tablet_replica.cc:333] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.147539 20705 raft_consensus.cc:2243] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.148311 20705 raft_consensus.cc:2272] T e3bd7017cc434cb0b7084f3bd57bc5b4 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.150218 20705 tablet_replica.cc:333] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.150779 20705 raft_consensus.cc:2243] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.151175 20705 raft_consensus.cc:2272] T 682d7ecbc3044139871db2d4bf0e3366 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.152981 20705 tablet_replica.cc:333] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.153502 20705 raft_consensus.cc:2243] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.154294 20705 raft_consensus.cc:2272] T cb63ff5948b2424688b706c82ee3f05b P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.156230 20705 tablet_replica.cc:333] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.156689 20705 raft_consensus.cc:2243] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.157034 20705 raft_consensus.cc:2272] T c549fcb1aed94e25b3402ef6cda0df9b P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.157373 29451 raft_consensus.cc:493] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24654af7758f4a5ebc3e3a8fba0b617a)
I20260709 12:13:23.157912 29451 raft_consensus.cc:515] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be5ce5bff4b443ea67188eb0de32215" member_type: VOTER last_known_addr { host: "127.20.56.68" port: 33813 } } peers { permanent_uuid: "24654af7758f4a5ebc3e3a8fba0b617a" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41545 } } peers { permanent_uuid: "b94463539fe9492dbae13ef77b3cc58d" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 42205 } }
I20260709 12:13:23.159571 20705 tablet_replica.cc:333] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.160131 29451 leader_election.cc:290] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545), b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205)
I20260709 12:13:23.160372 20705 raft_consensus.cc:2243] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.160934 20705 raft_consensus.cc:2272] T 5b2c38e0d98e4333a355f887eeaf2f8f P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.163467 20705 tablet_replica.cc:333] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
W20260709 12:13:23.164136 28481 leader_election.cc:336] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b94463539fe9492dbae13ef77b3cc58d (127.20.56.66:42205): Network error: Client connection negotiation failed: client connection to 127.20.56.66:42205: connect: Connection refused (error 111)
I20260709 12:13:23.164148 20705 raft_consensus.cc:2243] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:23.164827 28479 leader_election.cc:336] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 24654af7758f4a5ebc3e3a8fba0b617a (127.20.56.65:41545): Network error: Client connection negotiation failed: client connection to 127.20.56.65:41545: connect: Connection refused (error 111)
I20260709 12:13:23.165096 20705 raft_consensus.cc:2272] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.165246 28479 leader_election.cc:304] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be5ce5bff4b443ea67188eb0de32215; no voters: 24654af7758f4a5ebc3e3a8fba0b617a, b94463539fe9492dbae13ef77b3cc58d
W20260709 12:13:23.165892 28479 raft_consensus.cc:2686] T 87893c2fc5894370a4e3427f4e429698 P 1be5ce5bff4b443ea67188eb0de32215: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:13:23.167536 20705 tablet_replica.cc:333] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.168057 20705 raft_consensus.cc:2243] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.168430 20705 raft_consensus.cc:2272] T ad3311f3d8df44b1a7b5123aca90c564 P 1be5ce5bff4b443ea67188eb0de32215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.170269 20705 tablet_replica.cc:333] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.170789 20705 raft_consensus.cc:2243] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.171519 20705 raft_consensus.cc:2272] T 5c8664110bc84069a332ebad298106ac P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.173434 20705 tablet_replica.cc:333] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.173866 20705 raft_consensus.cc:2243] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.174253 20705 raft_consensus.cc:2272] T c7829e294fab4d1187889634a3fca00d P 1be5ce5bff4b443ea67188eb0de32215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.176139 20705 tablet_replica.cc:333] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215: stopping tablet replica
I20260709 12:13:23.176535 20705 raft_consensus.cc:2243] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.176870 20705 raft_consensus.cc:2272] T 8449846c74a54c40a37e2b241c98f91a P 1be5ce5bff4b443ea67188eb0de32215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.244825 20705 tablet_server.cc:196] TabletServer@127.20.56.68:0 shutdown complete.
I20260709 12:13:23.306428 20705 master.cc:562] Master@127.20.56.126:36629 shutting down...
I20260709 12:13:23.332546 20705 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.333137 20705 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.333472 20705 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5d6f8ce81bf04ba6a05adf7e2301c114: stopping tablet replica
I20260709 12:13:23.354851 20705 master.cc:584] Master@127.20.56.126:36629 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32820 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:13:23.442785 20705 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.56.126:41433
I20260709 12:13:23.443953 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:23.449255 29494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.450780 29497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.450896 29495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:23.451610 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:23.452625 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:23.452808 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:23.452922 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599203452911 us; error 0 us; skew 500 ppm
I20260709 12:13:23.453388 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:23.455703 20705 webserver.cc:533] Webserver started at http://127.20.56.126:34091/ using document root <none> and password file <none>
I20260709 12:13:23.456161 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:23.456313 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:23.456527 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:23.457600 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/master-0-root/instance:
uuid: "3e763c8d1951424d8ce73abf805ea859"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-2dwh"
I20260709 12:13:23.461982 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:13:23.465351 29502 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.466197 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:23.466522 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/master-0-root
uuid: "3e763c8d1951424d8ce73abf805ea859"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-2dwh"
I20260709 12:13:23.466833 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:23.490136 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:23.491405 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:23.528422 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.126:41433
I20260709 12:13:23.528548 29553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.126:41433 every 8 connection(s)
I20260709 12:13:23.532323 29554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:23.542945 29554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859: Bootstrap starting.
I20260709 12:13:23.547653 29554 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:23.551905 29554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859: No bootstrap required, opened a new log
I20260709 12:13:23.554035 29554 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e763c8d1951424d8ce73abf805ea859" member_type: VOTER }
I20260709 12:13:23.554481 29554 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:23.554694 29554 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e763c8d1951424d8ce73abf805ea859, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.555308 29554 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e763c8d1951424d8ce73abf805ea859" member_type: VOTER }
I20260709 12:13:23.555723 29554 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:23.555920 29554 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:23.556123 29554 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:23.560866 29554 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e763c8d1951424d8ce73abf805ea859" member_type: VOTER }
I20260709 12:13:23.561430 29554 leader_election.cc:304] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e763c8d1951424d8ce73abf805ea859; no voters: 
I20260709 12:13:23.562590 29554 leader_election.cc:290] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:23.562917 29557 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:23.564273 29557 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 1 LEADER]: Becoming Leader. State: Replica: 3e763c8d1951424d8ce73abf805ea859, State: Running, Role: LEADER
I20260709 12:13:23.564991 29557 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e763c8d1951424d8ce73abf805ea859" member_type: VOTER }
I20260709 12:13:23.565683 29554 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:23.569470 29558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e763c8d1951424d8ce73abf805ea859" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e763c8d1951424d8ce73abf805ea859" member_type: VOTER } }
I20260709 12:13:23.569557 29559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e763c8d1951424d8ce73abf805ea859. Latest consensus state: current_term: 1 leader_uuid: "3e763c8d1951424d8ce73abf805ea859" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e763c8d1951424d8ce73abf805ea859" member_type: VOTER } }
I20260709 12:13:23.570430 29559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:23.570430 29558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:23.577428 29563 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:23.585459 29563 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:23.586500 20705 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:23.594323 29563 catalog_manager.cc:1383] Generated new cluster ID: c99d752752bc4f279f3d51cc9d9fb221
I20260709 12:13:23.594671 29563 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:23.608994 29563 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:23.610313 29563 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:23.623754 29563 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859: Generated new TSK 0
I20260709 12:13:23.624408 29563 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:23.653780 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:23.659793 29575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.661079 29576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.665328 29578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:23.665365 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:23.666760 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:23.666998 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:23.667191 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599203667164 us; error 0 us; skew 500 ppm
I20260709 12:13:23.667719 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:23.670089 20705 webserver.cc:533] Webserver started at http://127.20.56.65:42565/ using document root <none> and password file <none>
I20260709 12:13:23.670643 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:23.670852 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:23.671128 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:23.672698 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-0-root/instance:
uuid: "2514b4a6525c4689a6d4263de3575285"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-2dwh"
I20260709 12:13:23.677141 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:13:23.680578 29583 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.681442 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:23.681804 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "2514b4a6525c4689a6d4263de3575285"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-2dwh"
I20260709 12:13:23.682061 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:23.700487 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:23.701673 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:23.703153 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:23.705422 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:23.705618 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.705909 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:23.706084 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.745249 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:42063
I20260709 12:13:23.745313 29645 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:42063 every 8 connection(s)
I20260709 12:13:23.750005 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:23.757704 29650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.761385 29651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.762771 29653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:23.763660 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:23.764726 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:23.764961 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:23.765172 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599203765154 us; error 0 us; skew 500 ppm
I20260709 12:13:23.765856 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:23.767103 29646 heartbeater.cc:344] Connected to a master server at 127.20.56.126:41433
I20260709 12:13:23.767566 29646 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:23.768616 29646 heartbeater.cc:507] Master 127.20.56.126:41433 requested a full tablet report, sending...
I20260709 12:13:23.768836 20705 webserver.cc:533] Webserver started at http://127.20.56.66:35983/ using document root <none> and password file <none>
I20260709 12:13:23.769543 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:23.769821 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:23.770123 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:23.771145 29519 ts_manager.cc:194] Registered new tserver with Master: 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063)
I20260709 12:13:23.771423 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-1-root/instance:
uuid: "89d6e213407d46c39f5ae74948d8abea"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-2dwh"
I20260709 12:13:23.773027 29519 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46018
I20260709 12:13:23.776491 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:13:23.780117 29658 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.780854 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:13:23.781155 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-1-root
uuid: "89d6e213407d46c39f5ae74948d8abea"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-2dwh"
I20260709 12:13:23.781431 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:23.800585 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:23.801810 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:23.803341 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:23.805558 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:23.805799 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.806034 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:23.806205 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.844913 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.66:34705
I20260709 12:13:23.845013 29720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.66:34705 every 8 connection(s)
I20260709 12:13:23.849815 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:23.857074 29724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:23.857795 29725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:23.860510 20705 server_base.cc:1061] running on GCE node
W20260709 12:13:23.861004 29727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:23.862196 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:23.862442 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:23.862645 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599203862624 us; error 0 us; skew 500 ppm
I20260709 12:13:23.863317 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:23.863487 29721 heartbeater.cc:344] Connected to a master server at 127.20.56.126:41433
I20260709 12:13:23.863973 29721 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:23.864944 29721 heartbeater.cc:507] Master 127.20.56.126:41433 requested a full tablet report, sending...
I20260709 12:13:23.866210 20705 webserver.cc:533] Webserver started at http://127.20.56.67:46543/ using document root <none> and password file <none>
I20260709 12:13:23.866863 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:23.867076 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:23.867352 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:23.867494 29519 ts_manager.cc:194] Registered new tserver with Master: 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:23.868600 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-2-root/instance:
uuid: "b085b580e39741da9402d86991cffcfd"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-2dwh"
I20260709 12:13:23.869213 29519 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46028
I20260709 12:13:23.873936 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:23.877512 29732 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.878345 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:13:23.878721 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-2-root
uuid: "b085b580e39741da9402d86991cffcfd"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-2dwh"
I20260709 12:13:23.879014 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:23.891299 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:23.892516 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:23.893980 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:23.896358 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:23.896588 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.896836 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:23.897010 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:23.937995 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.67:38781
I20260709 12:13:23.938134 29794 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.67:38781 every 8 connection(s)
I20260709 12:13:23.952831 29795 heartbeater.cc:344] Connected to a master server at 127.20.56.126:41433
I20260709 12:13:23.953312 29795 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:23.954082 29795 heartbeater.cc:507] Master 127.20.56.126:41433 requested a full tablet report, sending...
I20260709 12:13:23.956228 29519 ts_manager.cc:194] Registered new tserver with Master: b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:23.956367 20705 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015228635s
I20260709 12:13:23.958065 29519 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46036
I20260709 12:13:23.984122 29519 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46050:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:23.986964 29519 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:24.087038 29759 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2167548d8a47d2bf1635fb6a674f34 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:24.087469 29760 tablet_service.cc:1511] Processing CreateTablet for tablet 124fa3187e384bb1aa743eb25c7ef353 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:24.088815 29759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2167548d8a47d2bf1635fb6a674f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.089915 29758 tablet_service.cc:1511] Processing CreateTablet for tablet bb24a436d0b64405b521ed6763a1c52a (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:24.090642 29607 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfc0db03fe544c59677c3bd19b1d476 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:24.092672 29607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfc0db03fe544c59677c3bd19b1d476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.093477 29760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 124fa3187e384bb1aa743eb25c7ef353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.093348 29611 tablet_service.cc:1511] Processing CreateTablet for tablet 124fa3187e384bb1aa743eb25c7ef353 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:24.093727 29757 tablet_service.cc:1511] Processing CreateTablet for tablet e3ddd3202fef4a9ea16d74ad97f570c6 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:24.094866 29611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 124fa3187e384bb1aa743eb25c7ef353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.095116 29757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ddd3202fef4a9ea16d74ad97f570c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.095868 29606 tablet_service.cc:1511] Processing CreateTablet for tablet 863ad85c3ff64fb38d4a221c10ee6186 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:24.096509 29610 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2167548d8a47d2bf1635fb6a674f34 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:24.098482 29605 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc8cab458b546498e660456894d1295 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:24.099021 29609 tablet_service.cc:1511] Processing CreateTablet for tablet bb24a436d0b64405b521ed6763a1c52a (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:24.099608 29756 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfc0db03fe544c59677c3bd19b1d476 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:24.100972 29756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfc0db03fe544c59677c3bd19b1d476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.101414 29608 tablet_service.cc:1511] Processing CreateTablet for tablet e3ddd3202fef4a9ea16d74ad97f570c6 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:24.102627 29604 tablet_service.cc:1511] Processing CreateTablet for tablet b2358003b8ee4a9db783bf49bc3467fb (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:24.103206 29758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb24a436d0b64405b521ed6763a1c52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.103632 29755 tablet_service.cc:1511] Processing CreateTablet for tablet 863ad85c3ff64fb38d4a221c10ee6186 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:24.104981 29755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863ad85c3ff64fb38d4a221c10ee6186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.107609 29754 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc8cab458b546498e660456894d1295 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:24.108970 29754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc8cab458b546498e660456894d1295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.110795 29610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2167548d8a47d2bf1635fb6a674f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.114796 29608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ddd3202fef4a9ea16d74ad97f570c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.118234 29609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb24a436d0b64405b521ed6763a1c52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.121090 29604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2358003b8ee4a9db783bf49bc3467fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.122364 29605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc8cab458b546498e660456894d1295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.123111 29606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863ad85c3ff64fb38d4a221c10ee6186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.154165 29753 tablet_service.cc:1511] Processing CreateTablet for tablet b2358003b8ee4a9db783bf49bc3467fb (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:24.155715 29753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2358003b8ee4a9db783bf49bc3467fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.156029 29603 tablet_service.cc:1511] Processing CreateTablet for tablet 2f252a21f63b4c6680524bbfff117ff6 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:24.157567 29603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f252a21f63b4c6680524bbfff117ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.177928 29810 tablet_bootstrap.cc:492] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
I20260709 12:13:24.184198 29686 tablet_service.cc:1511] Processing CreateTablet for tablet 124fa3187e384bb1aa743eb25c7ef353 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:24.185865 29686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 124fa3187e384bb1aa743eb25c7ef353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.186707 29682 tablet_service.cc:1511] Processing CreateTablet for tablet 5cfc0db03fe544c59677c3bd19b1d476 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:24.187796 29685 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2167548d8a47d2bf1635fb6a674f34 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:24.188387 29682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cfc0db03fe544c59677c3bd19b1d476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.189358 29685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2167548d8a47d2bf1635fb6a674f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.190827 29681 tablet_service.cc:1511] Processing CreateTablet for tablet 863ad85c3ff64fb38d4a221c10ee6186 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:24.191867 29684 tablet_service.cc:1511] Processing CreateTablet for tablet bb24a436d0b64405b521ed6763a1c52a (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:24.192438 29681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863ad85c3ff64fb38d4a221c10ee6186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.193418 29684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb24a436d0b64405b521ed6763a1c52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.192495 29757 tablet_service.cc:1511] Processing CreateTablet for tablet 2f252a21f63b4c6680524bbfff117ff6 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:24.195449 29757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f252a21f63b4c6680524bbfff117ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.196725 29680 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc8cab458b546498e660456894d1295 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:24.199590 29683 tablet_service.cc:1511] Processing CreateTablet for tablet e3ddd3202fef4a9ea16d74ad97f570c6 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:24.200572 29679 tablet_service.cc:1511] Processing CreateTablet for tablet b2358003b8ee4a9db783bf49bc3467fb (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:24.204773 29683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ddd3202fef4a9ea16d74ad97f570c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.204532 29678 tablet_service.cc:1511] Processing CreateTablet for tablet 2f252a21f63b4c6680524bbfff117ff6 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:24.205425 29811 tablet_bootstrap.cc:492] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.206028 29680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc8cab458b546498e660456894d1295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.211900 29678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f252a21f63b4c6680524bbfff117ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.218763 29679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2358003b8ee4a9db783bf49bc3467fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.224025 29677 tablet_service.cc:1511] Processing CreateTablet for tablet cb7cafab58d14929846a2649a9074ca4 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:24.225503 29677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7cafab58d14929846a2649a9074ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.225731 29760 tablet_service.cc:1511] Processing CreateTablet for tablet cb7cafab58d14929846a2649a9074ca4 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:24.227069 29760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7cafab58d14929846a2649a9074ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.231968 29810 tablet_bootstrap.cc:654] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.235525 29608 tablet_service.cc:1511] Processing CreateTablet for tablet cb7cafab58d14929846a2649a9074ca4 (DEFAULT_TABLE table=test-workload [id=d15f90bc51a74e21a7c8012d1cd49d5f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:24.236953 29608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7cafab58d14929846a2649a9074ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.244590 29811 tablet_bootstrap.cc:654] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.306875 29810 tablet_bootstrap.cc:492] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.307478 29810 ts_tablet_manager.cc:1403] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.130s	user 0.034s	sys 0.018s
I20260709 12:13:24.309885 29810 raft_consensus.cc:359] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:24.310674 29810 raft_consensus.cc:385] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.311017 29810 raft_consensus.cc:740] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.311699 29810 consensus_queue.cc:260] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:24.310292 29811 tablet_bootstrap.cc:492] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.313222 29811 ts_tablet_manager.cc:1403] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.017s
I20260709 12:13:24.316715 29810 ts_tablet_manager.cc:1434] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:24.317633 29795 heartbeater.cc:499] Master 127.20.56.126:41433 was elected leader, sending a full tablet report...
I20260709 12:13:24.317941 29810 tablet_bootstrap.cc:492] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
I20260709 12:13:24.319849 29811 raft_consensus.cc:359] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.320557 29811 raft_consensus.cc:385] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.320868 29811 raft_consensus.cc:740] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.321578 29811 consensus_queue.cc:260] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.325013 29810 tablet_bootstrap.cc:654] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.328958 29814 tablet_bootstrap.cc:492] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.343736 29814 tablet_bootstrap.cc:654] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.350354 29646 heartbeater.cc:499] Master 127.20.56.126:41433 was elected leader, sending a full tablet report...
I20260709 12:13:24.350723 29811 ts_tablet_manager.cc:1434] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.016s
I20260709 12:13:24.350817 29810 tablet_bootstrap.cc:492] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.351583 29810 ts_tablet_manager.cc:1403] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.019s
I20260709 12:13:24.352013 29811 tablet_bootstrap.cc:492] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.354544 29810 raft_consensus.cc:359] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.355306 29810 raft_consensus.cc:385] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.355631 29810 raft_consensus.cc:740] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.356515 29810 consensus_queue.cc:260] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.358639 29811 tablet_bootstrap.cc:654] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.358670 29810 ts_tablet_manager.cc:1434] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:13:24.359925 29810 tablet_bootstrap.cc:492] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
I20260709 12:13:24.368165 29810 tablet_bootstrap.cc:654] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.381108 29810 tablet_bootstrap.cc:492] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.381814 29810 ts_tablet_manager.cc:1403] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 12:13:24.385986 29810 raft_consensus.cc:359] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.387042 29810 raft_consensus.cc:385] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.387436 29810 raft_consensus.cc:740] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.388670 29810 consensus_queue.cc:260] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.391929 29810 ts_tablet_manager.cc:1434] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.009s
I20260709 12:13:24.393431 29810 tablet_bootstrap.cc:492] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
I20260709 12:13:24.399134 29814 tablet_bootstrap.cc:492] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
I20260709 12:13:24.399180 29811 tablet_bootstrap.cc:492] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.399940 29814 ts_tablet_manager.cc:1403] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.034s
I20260709 12:13:24.400010 29811 ts_tablet_manager.cc:1403] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.033s
I20260709 12:13:24.400979 29810 tablet_bootstrap.cc:654] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.403364 29814 raft_consensus.cc:359] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.404222 29814 raft_consensus.cc:385] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.404577 29814 raft_consensus.cc:740] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.404640 29811 raft_consensus.cc:359] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.405871 29811 raft_consensus.cc:385] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.405627 29814 consensus_queue.cc:260] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.406376 29811 raft_consensus.cc:740] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.407603 29811 consensus_queue.cc:260] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.410995 29811 ts_tablet_manager.cc:1434] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:13:24.412286 29811 tablet_bootstrap.cc:492] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.421316 29811 tablet_bootstrap.cc:654] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.425347 29810 tablet_bootstrap.cc:492] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.425997 29810 ts_tablet_manager.cc:1403] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.011s
I20260709 12:13:24.427356 29721 heartbeater.cc:499] Master 127.20.56.126:41433 was elected leader, sending a full tablet report...
I20260709 12:13:24.428014 29814 ts_tablet_manager.cc:1434] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.028s	user 0.016s	sys 0.010s
I20260709 12:13:24.429122 29814 tablet_bootstrap.cc:492] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.430018 29810 raft_consensus.cc:359] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.431159 29810 raft_consensus.cc:385] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.431546 29810 raft_consensus.cc:740] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.432578 29810 consensus_queue.cc:260] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.434744 29811 tablet_bootstrap.cc:492] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.435297 29810 ts_tablet_manager.cc:1434] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:13:24.435338 29811 ts_tablet_manager.cc:1403] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.002s
I20260709 12:13:24.436471 29810 tablet_bootstrap.cc:492] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
I20260709 12:13:24.436491 29814 tablet_bootstrap.cc:654] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.438721 29811 raft_consensus.cc:359] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.439534 29811 raft_consensus.cc:385] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.439842 29811 raft_consensus.cc:740] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.440886 29811 consensus_queue.cc:260] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
W20260709 12:13:24.442309 29796 tablet.cc:2406] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:24.443908 29810 tablet_bootstrap.cc:654] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.448187 29811 ts_tablet_manager.cc:1434] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:13:24.449193 29814 tablet_bootstrap.cc:492] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
I20260709 12:13:24.449661 29811 tablet_bootstrap.cc:492] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.449820 29814 ts_tablet_manager.cc:1403] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:13:24.459878 29811 tablet_bootstrap.cc:654] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.456554 29814 raft_consensus.cc:359] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.462349 29814 raft_consensus.cc:385] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.462767 29814 raft_consensus.cc:740] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.463670 29814 consensus_queue.cc:260] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.473125 29814 ts_tablet_manager.cc:1434] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.001s
I20260709 12:13:24.473665 29811 tablet_bootstrap.cc:492] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.473688 29810 tablet_bootstrap.cc:492] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.474411 29814 tablet_bootstrap.cc:492] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.474481 29811 ts_tablet_manager.cc:1403] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 12:13:24.474493 29810 ts_tablet_manager.cc:1403] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.015s
I20260709 12:13:24.478099 29811 raft_consensus.cc:359] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.478376 29810 raft_consensus.cc:359] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.478881 29811 raft_consensus.cc:385] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.479108 29810 raft_consensus.cc:385] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.479300 29811 raft_consensus.cc:740] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.479471 29810 raft_consensus.cc:740] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.480149 29811 consensus_queue.cc:260] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.480486 29810 consensus_queue.cc:260] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.482705 29811 ts_tablet_manager.cc:1434] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:13:24.482848 29814 tablet_bootstrap.cc:654] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.483825 29811 tablet_bootstrap.cc:492] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.486276 29817 raft_consensus.cc:493] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.486804 29817 raft_consensus.cc:515] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.487948 29815 raft_consensus.cc:493] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.488443 29815 raft_consensus.cc:515] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.494554 29817 leader_election.cc:290] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:24.495572 29810 ts_tablet_manager.cc:1434] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:13:24.496455 29814 tablet_bootstrap.cc:492] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
I20260709 12:13:24.497059 29814 ts_tablet_manager.cc:1403] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 12:13:24.498550 29810 tablet_bootstrap.cc:492] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
I20260709 12:13:24.501073 29814 raft_consensus.cc:359] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.501937 29814 raft_consensus.cc:385] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.502329 29814 raft_consensus.cc:740] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.503341 29814 consensus_queue.cc:260] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.503360 29815 leader_election.cc:290] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:24.505702 29810 tablet_bootstrap.cc:654] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.505826 29814 ts_tablet_manager.cc:1434] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:24.507090 29814 tablet_bootstrap.cc:492] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.512785 29815 raft_consensus.cc:493] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.513362 29815 raft_consensus.cc:515] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:24.515475 29815 leader_election.cc:290] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705), 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063)
I20260709 12:13:24.515913 29814 tablet_bootstrap.cc:654] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.539702 29811 tablet_bootstrap.cc:654] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.553851 29621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ddd3202fef4a9ea16d74ad97f570c6" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:24.555038 29621 raft_consensus.cc:2468] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 0.
I20260709 12:13:24.556813 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:24.559726 29735 leader_election.cc:304] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:24.561004 29815 raft_consensus.cc:2804] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:24.561494 29815 raft_consensus.cc:493] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.561934 29815 raft_consensus.cc:3060] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.568902 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ddd3202fef4a9ea16d74ad97f570c6" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
I20260709 12:13:24.569315 29695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
W20260709 12:13:24.569643 29735 leader_election.cc:343] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:24.570747 29734 leader_election.cc:343] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:24.571753 29734 leader_election.cc:343] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.572176 29734 leader_election.cc:304] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b085b580e39741da9402d86991cffcfd; no voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea
I20260709 12:13:24.573734 29695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
W20260709 12:13:24.575800 29585 leader_election.cc:343] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.575740 29815 raft_consensus.cc:515] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.579734 29814 tablet_bootstrap.cc:492] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
W20260709 12:13:24.580194 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:24.580372 29814 ts_tablet_manager.cc:1403] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.074s	user 0.028s	sys 0.017s
I20260709 12:13:24.581001 29810 tablet_bootstrap.cc:492] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.581552 29810 ts_tablet_manager.cc:1403] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.083s	user 0.027s	sys 0.054s
I20260709 12:13:24.582659 29770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd" is_pre_election: true
W20260709 12:13:24.585067 29584 leader_election.cc:343] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b085b580e39741da9402d86991cffcfd (127.20.56.67:38781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.585085 29810 raft_consensus.cc:359] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.585807 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ddd3202fef4a9ea16d74ad97f570c6" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:24.586086 29810 raft_consensus.cc:385] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.586431 29620 raft_consensus.cc:3060] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.586393 29810 raft_consensus.cc:740] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.587417 29810 consensus_queue.cc:260] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.590082 29811 tablet_bootstrap.cc:492] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.590859 29811 ts_tablet_manager.cc:1403] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.003s
I20260709 12:13:24.585839 29584 leader_election.cc:304] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285; no voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd
I20260709 12:13:24.591796 29817 raft_consensus.cc:2749] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.594985 29811 raft_consensus.cc:359] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.596004 29811 raft_consensus.cc:385] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.596208 29838 raft_consensus.cc:2749] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.596426 29811 raft_consensus.cc:740] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.597661 29814 raft_consensus.cc:359] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.598613 29810 ts_tablet_manager.cc:1434] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 12:13:24.601508 29814 raft_consensus.cc:385] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.600157 29620 raft_consensus.cc:2468] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 1.
I20260709 12:13:24.601924 29814 raft_consensus.cc:740] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.599189 29811 consensus_queue.cc:260] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.601009 29815 leader_election.cc:290] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:24.602321 29810 tablet_bootstrap.cc:492] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
I20260709 12:13:24.602880 29735 leader_election.cc:304] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:24.602790 29695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ddd3202fef4a9ea16d74ad97f570c6" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:24.604044 29814 consensus_queue.cc:260] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.604502 29815 raft_consensus.cc:2804] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:24.605206 29695 raft_consensus.cc:3060] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.605247 29815 raft_consensus.cc:697] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 1 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:24.606312 29815 consensus_queue.cc:237] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.610566 29811 ts_tablet_manager.cc:1434] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:13:24.612108 29811 tablet_bootstrap.cc:492] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.613090 29827 raft_consensus.cc:493] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.613624 29827 raft_consensus.cc:515] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.618520 29827 leader_election.cc:290] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:24.618657 29811 tablet_bootstrap.cc:654] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.638834 29810 tablet_bootstrap.cc:654] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.643193 29695 raft_consensus.cc:2468] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 1.
I20260709 12:13:24.648253 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc8cab458b546498e660456894d1295" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:24.649163 29620 raft_consensus.cc:2468] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 0.
I20260709 12:13:24.649959 29814 ts_tablet_manager.cc:1434] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.001s
I20260709 12:13:24.651141 29661 leader_election.cc:304] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:24.652381 29827 raft_consensus.cc:2804] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:24.651180 29814 tablet_bootstrap.cc:492] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.652791 29827 raft_consensus.cc:493] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.653151 29827 raft_consensus.cc:3060] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.661367 29770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc8cab458b546498e660456894d1295" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd" is_pre_election: true
I20260709 12:13:24.662147 29770 raft_consensus.cc:2468] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 0.
I20260709 12:13:24.664804 29814 tablet_bootstrap.cc:654] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.669284 29827 raft_consensus.cc:515] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.671526 29810 tablet_bootstrap.cc:492] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.672098 29810 ts_tablet_manager.cc:1403] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.070s	user 0.005s	sys 0.029s
I20260709 12:13:24.672308 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc8cab458b546498e660456894d1295" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:24.673107 29620 raft_consensus.cc:3060] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.672040 29519 catalog_manager.cc:5697] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 0 to 1, leader changed from <none> to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 1 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.675307 29815 raft_consensus.cc:493] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.675675 29810 raft_consensus.cc:359] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.675838 29815 raft_consensus.cc:515] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.676498 29810 raft_consensus.cc:385] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.676839 29810 raft_consensus.cc:740] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.677618 29810 consensus_queue.cc:260] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.678571 29815 leader_election.cc:290] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:24.679839 29695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb24a436d0b64405b521ed6763a1c52a" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
I20260709 12:13:24.680159 29621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb24a436d0b64405b521ed6763a1c52a" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:24.680349 29810 ts_tablet_manager.cc:1434] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:13:24.681569 29810 tablet_bootstrap.cc:492] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
W20260709 12:13:24.681686 29735 leader_election.cc:343] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:24.682221 29734 leader_election.cc:343] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.682873 29734 leader_election.cc:304] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b085b580e39741da9402d86991cffcfd; no voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea
I20260709 12:13:24.684382 29815 raft_consensus.cc:2749] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.684389 29620 raft_consensus.cc:2468] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
I20260709 12:13:24.686381 29661 leader_election.cc:304] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:24.687830 29822 raft_consensus.cc:2804] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:24.688320 29811 tablet_bootstrap.cc:492] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.688875 29811 ts_tablet_manager.cc:1403] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.007s
I20260709 12:13:24.689103 29810 tablet_bootstrap.cc:654] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.692168 29811 raft_consensus.cc:359] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.694733 29811 raft_consensus.cc:385] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.696412 29811 raft_consensus.cc:740] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.698464 29814 tablet_bootstrap.cc:492] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
I20260709 12:13:24.699877 29815 raft_consensus.cc:493] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.700178 29814 ts_tablet_manager.cc:1403] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.019s
I20260709 12:13:24.700341 29810 tablet_bootstrap.cc:492] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.700801 29810 ts_tablet_manager.cc:1403] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 12:13:24.700552 29815 raft_consensus.cc:515] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.703545 29822 raft_consensus.cc:697] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:24.699044 29811 consensus_queue.cc:260] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.703593 29810 raft_consensus.cc:359] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.704133 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:24.704528 29810 raft_consensus.cc:385] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.698905 29770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc8cab458b546498e660456894d1295" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:24.704861 29810 raft_consensus.cc:740] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.705204 29770 raft_consensus.cc:3060] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.704725 29822 consensus_queue.cc:237] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.705865 29810 consensus_queue.cc:260] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.707762 29810 ts_tablet_manager.cc:1434] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:24.708736 29810 tablet_bootstrap.cc:492] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
I20260709 12:13:24.709358 29811 ts_tablet_manager.cc:1434] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 12:13:24.710474 29811 tablet_bootstrap.cc:492] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.711055 29815 leader_election.cc:290] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:24.704825 29620 raft_consensus.cc:2468] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 0.
I20260709 12:13:24.712810 29695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
I20260709 12:13:24.714296 29735 leader_election.cc:304] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:24.714531 29810 tablet_bootstrap.cc:654] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.715411 29817 raft_consensus.cc:493] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.715906 29817 raft_consensus.cc:515] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.716746 29811 tablet_bootstrap.cc:654] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.718024 29817 leader_election.cc:290] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:24.719789 29769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd" is_pre_election: true
I20260709 12:13:24.703393 29814 raft_consensus.cc:359] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.720482 29769 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2514b4a6525c4689a6d4263de3575285 in term 0.
I20260709 12:13:24.720554 29814 raft_consensus.cc:385] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.721169 29814 raft_consensus.cc:740] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.721835 29584 leader_election.cc:304] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:24.722436 29846 raft_consensus.cc:493] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.722591 29814 consensus_queue.cc:260] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.722978 29846 raft_consensus.cc:515] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
W20260709 12:13:24.724212 29734 leader_election.cc:343] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.724457 29695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
I20260709 12:13:24.725152 29695 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2514b4a6525c4689a6d4263de3575285 in term 0.
I20260709 12:13:24.725965 29810 tablet_bootstrap.cc:492] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.726493 29810 ts_tablet_manager.cc:1403] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:13:24.727702 29846 leader_election.cc:290] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:24.728839 29769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd" is_pre_election: true
I20260709 12:13:24.729621 29810 raft_consensus.cc:359] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.730495 29810 raft_consensus.cc:385] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:24.730836 29659 leader_election.cc:343] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b085b580e39741da9402d86991cffcfd (127.20.56.67:38781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.731112 29814 ts_tablet_manager.cc:1434] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 12:13:24.729635 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:24.730835 29810 raft_consensus.cc:740] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.731119 29815 raft_consensus.cc:2804] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:24.731909 29620 raft_consensus.cc:2468] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 0.
I20260709 12:13:24.732260 29815 raft_consensus.cc:493] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.732326 29814 tablet_bootstrap.cc:492] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.732331 29810 consensus_queue.cc:260] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.733160 29661 leader_election.cc:304] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: b085b580e39741da9402d86991cffcfd
I20260709 12:13:24.730929 29851 raft_consensus.cc:2804] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:24.734561 29846 raft_consensus.cc:2804] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:24.734802 29851 raft_consensus.cc:493] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.735038 29810 ts_tablet_manager.cc:1434] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:24.735196 29846 raft_consensus.cc:493] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.735807 29846 raft_consensus.cc:3060] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.737000 29827 leader_election.cc:290] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:24.736188 29770 raft_consensus.cc:2468] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
I20260709 12:13:24.734524 29815 raft_consensus.cc:3060] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.739931 29811 tablet_bootstrap.cc:492] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.736117 29810 tablet_bootstrap.cc:492] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd: Bootstrap starting.
I20260709 12:13:24.742039 29838 raft_consensus.cc:493] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.746932 29811 ts_tablet_manager.cc:1403] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 12:13:24.747268 29838 raft_consensus.cc:515] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.749567 29838 leader_election.cc:290] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:24.750031 29811 raft_consensus.cc:359] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.750834 29811 raft_consensus.cc:385] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.751122 29811 raft_consensus.cc:740] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.751273 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2358003b8ee4a9db783bf49bc3467fb" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:24.751986 29620 raft_consensus.cc:2468] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 0.
I20260709 12:13:24.751869 29811 consensus_queue.cc:260] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.752091 29846 raft_consensus.cc:515] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.735262 29851 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.753587 29735 leader_election.cc:304] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:24.744134 29518 catalog_manager.cc:5697] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 1 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.745239 29815 raft_consensus.cc:515] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.755088 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:24.755723 29620 raft_consensus.cc:3060] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.756614 29815 leader_election.cc:290] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:24.757232 29815 raft_consensus.cc:2804] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:24.757589 29815 raft_consensus.cc:493] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.757768 29621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:24.758404 29621 raft_consensus.cc:3060] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.759352 29810 tablet_bootstrap.cc:654] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.763854 29814 tablet_bootstrap.cc:654] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.763720 29851 raft_consensus.cc:515] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.772854 29621 raft_consensus.cc:2468] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 1.
I20260709 12:13:24.776616 29810 tablet_bootstrap.cc:492] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd: No bootstrap required, opened a new log
I20260709 12:13:24.776717 29735 leader_election.cc:304] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:24.777628 29810 ts_tablet_manager.cc:1403] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.002s
I20260709 12:13:24.777860 29838 raft_consensus.cc:2804] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:24.778388 29620 raft_consensus.cc:2468] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
I20260709 12:13:24.778533 29838 raft_consensus.cc:697] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 1 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:24.757936 29815 raft_consensus.cc:3060] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.779225 29851 leader_election.cc:290] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 election: Requested vote from peers 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:24.753614 29811 ts_tablet_manager.cc:1434] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:24.780153 29770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:24.779922 29838 consensus_queue.cc:237] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.780766 29770 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.780947 29811 tablet_bootstrap.cc:492] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.783449 29695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2358003b8ee4a9db783bf49bc3467fb" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
I20260709 12:13:24.783766 29769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:24.784168 29695 raft_consensus.cc:2468] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 0.
I20260709 12:13:24.785071 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:24.785447 29694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:24.786108 29694 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:24.786559 29659 leader_election.cc:343] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b085b580e39741da9402d86991cffcfd (127.20.56.67:38781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.788234 29811 tablet_bootstrap.cc:654] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.775452 29846 leader_election.cc:290] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:24.792174 29661 leader_election.cc:304] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: b085b580e39741da9402d86991cffcfd
I20260709 12:13:24.792747 29770 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2514b4a6525c4689a6d4263de3575285 in term 1.
I20260709 12:13:24.793936 29584 leader_election.cc:304] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:24.794194 29846 raft_consensus.cc:2804] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:13:24.793998 29734 leader_election.cc:343] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.795019 29851 raft_consensus.cc:2804] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:24.795483 29851 raft_consensus.cc:697] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 1 LEADER]: Becoming Leader. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Running, Role: LEADER
I20260709 12:13:24.796294 29851 consensus_queue.cc:237] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.796528 29810 raft_consensus.cc:359] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.797179 29810 raft_consensus.cc:385] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.797474 29810 raft_consensus.cc:740] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.798542 29810 consensus_queue.cc:260] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.801733 29810 ts_tablet_manager.cc:1434] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:13:24.800534 29846 raft_consensus.cc:697] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:24.806206 29846 consensus_queue.cc:237] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.813700 29815 raft_consensus.cc:515] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.818223 29815 leader_election.cc:290] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:24.818821 29814 tablet_bootstrap.cc:492] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
I20260709 12:13:24.819382 29814 ts_tablet_manager.cc:1403] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.009s
I20260709 12:13:24.819829 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2358003b8ee4a9db783bf49bc3467fb" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:24.820677 29696 raft_consensus.cc:3060] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.822340 29814 raft_consensus.cc:359] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.827241 29814 raft_consensus.cc:385] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.824544 29694 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2514b4a6525c4689a6d4263de3575285 in term 1.
I20260709 12:13:24.823607 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2358003b8ee4a9db783bf49bc3467fb" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:24.827795 29814 raft_consensus.cc:740] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.828159 29620 raft_consensus.cc:3060] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.828963 29814 consensus_queue.cc:260] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.828711 29516 catalog_manager.cc:5697] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 0 to 1, leader changed from <none> to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 1 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.831802 29814 ts_tablet_manager.cc:1434] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:13:24.833874 29814 tablet_bootstrap.cc:492] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.836486 29518 catalog_manager.cc:5697] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2514b4a6525c4689a6d4263de3575285 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "2514b4a6525c4689a6d4263de3575285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.840155 29815 raft_consensus.cc:493] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.840906 29814 tablet_bootstrap.cc:654] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.840754 29815 raft_consensus.cc:515] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.843933 29621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
W20260709 12:13:24.845992 29735 leader_election.cc:343] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.852197 29696 raft_consensus.cc:2468] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 1.
I20260709 12:13:24.853981 29734 leader_election.cc:304] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:24.855013 29838 raft_consensus.cc:2804] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:24.855480 29838 raft_consensus.cc:697] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 1 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:24.856303 29838 consensus_queue.cc:237] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.862291 29620 raft_consensus.cc:2468] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 1.
I20260709 12:13:24.863221 29815 leader_election.cc:290] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:24.863804 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
W20260709 12:13:24.865178 29734 leader_election.cc:343] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:24.865665 29734 leader_election.cc:304] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b085b580e39741da9402d86991cffcfd; no voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea
I20260709 12:13:24.870682 29815 raft_consensus.cc:2749] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.881388 29811 tablet_bootstrap.cc:492] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.882156 29811 ts_tablet_manager.cc:1403] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.101s	user 0.029s	sys 0.042s
I20260709 12:13:24.881441 29516 catalog_manager.cc:5697] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 1 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.883373 29814 tablet_bootstrap.cc:492] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
I20260709 12:13:24.883874 29814 ts_tablet_manager.cc:1403] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.019s
I20260709 12:13:24.885124 29811 raft_consensus.cc:359] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:24.885767 29811 raft_consensus.cc:385] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.885995 29811 raft_consensus.cc:740] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.886638 29811 consensus_queue.cc:260] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:24.886811 29814 raft_consensus.cc:359] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.888258 29811 ts_tablet_manager.cc:1434] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:24.889525 29814 raft_consensus.cc:385] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.889890 29814 raft_consensus.cc:740] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.890451 29811 tablet_bootstrap.cc:492] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.890676 29814 consensus_queue.cc:260] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.892237 29518 catalog_manager.cc:5697] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 0 to 1, leader changed from <none> to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 1 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.893420 29814 ts_tablet_manager.cc:1434] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:24.894529 29814 tablet_bootstrap.cc:492] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.897038 29811 tablet_bootstrap.cc:654] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.901113 29814 tablet_bootstrap.cc:654] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.915182 29814 tablet_bootstrap.cc:492] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
I20260709 12:13:24.915184 29811 tablet_bootstrap.cc:492] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.915838 29814 ts_tablet_manager.cc:1403] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 12:13:24.915865 29811 ts_tablet_manager.cc:1403] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 12:13:24.918723 29811 raft_consensus.cc:359] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.918917 29814 raft_consensus.cc:359] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.919404 29811 raft_consensus.cc:385] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.919560 29814 raft_consensus.cc:385] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.919734 29811 raft_consensus.cc:740] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.919878 29814 raft_consensus.cc:740] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.920485 29811 consensus_queue.cc:260] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.920504 29814 consensus_queue.cc:260] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.922640 29814 ts_tablet_manager.cc:1434] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:24.922640 29811 ts_tablet_manager.cc:1434] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:24.923713 29811 tablet_bootstrap.cc:492] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:24.923713 29814 tablet_bootstrap.cc:492] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.929318 29811 tablet_bootstrap.cc:654] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.930807 29814 tablet_bootstrap.cc:654] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.937381 29811 tablet_bootstrap.cc:492] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: No bootstrap required, opened a new log
I20260709 12:13:24.937902 29811 ts_tablet_manager.cc:1403] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:13:24.940502 29814 tablet_bootstrap.cc:492] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
I20260709 12:13:24.940315 29811 raft_consensus.cc:359] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.940887 29811 raft_consensus.cc:385] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.940989 29814 ts_tablet_manager.cc:1403] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 12:13:24.941186 29811 raft_consensus.cc:740] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.941864 29811 consensus_queue.cc:260] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.943370 29811 ts_tablet_manager.cc:1434] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:13:24.943651 29814 raft_consensus.cc:359] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:24.944347 29814 raft_consensus.cc:385] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.944610 29814 raft_consensus.cc:740] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.945219 29814 consensus_queue.cc:260] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:24.946226 29838 raft_consensus.cc:493] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.947091 29814 ts_tablet_manager.cc:1434] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:24.946790 29838 raft_consensus.cc:515] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.948031 29814 tablet_bootstrap.cc:492] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea: Bootstrap starting.
I20260709 12:13:24.949015 29838 leader_election.cc:290] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:24.949656 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:24.950484 29620 raft_consensus.cc:2393] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b085b580e39741da9402d86991cffcfd in current term 1: Already voted for candidate 89d6e213407d46c39f5ae74948d8abea in this term.
I20260709 12:13:24.950584 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
I20260709 12:13:24.952200 29734 leader_election.cc:304] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b085b580e39741da9402d86991cffcfd; no voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea
I20260709 12:13:24.952994 29838 raft_consensus.cc:3060] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:24.957408 29814 tablet_bootstrap.cc:654] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:24.960471 29838 raft_consensus.cc:2749] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:24.962368 29814 tablet_bootstrap.cc:492] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea: No bootstrap required, opened a new log
I20260709 12:13:24.962870 29814 ts_tablet_manager.cc:1403] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.004s
I20260709 12:13:24.964709 29814 raft_consensus.cc:359] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.965210 29814 raft_consensus.cc:385] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:24.965427 29814 raft_consensus.cc:740] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.966007 29814 consensus_queue.cc:260] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:24.967594 29814 ts_tablet_manager.cc:1434] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:25.031755 29838 consensus_queue.cc:1048] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.043778 29837 consensus_queue.cc:1048] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:25.105679 29846 raft_consensus.cc:493] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.106174 29846 raft_consensus.cc:515] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:25.108108 29846 leader_election.cc:290] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:25.108917 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:25.109138 29770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd" is_pre_election: true
I20260709 12:13:25.109565 29620 raft_consensus.cc:2468] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 0.
I20260709 12:13:25.109784 29770 raft_consensus.cc:2468] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 0.
I20260709 12:13:25.110699 29661 leader_election.cc:304] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:25.111428 29846 raft_consensus.cc:2804] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.111795 29846 raft_consensus.cc:493] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.112071 29846 raft_consensus.cc:3060] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.115684 29822 consensus_queue.cc:1048] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.119031 29846 raft_consensus.cc:515] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:25.122092 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:25.122399 29769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:25.122741 29620 raft_consensus.cc:3060] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.123100 29769 raft_consensus.cc:3060] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.126888 29846 leader_election.cc:290] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:25.130164 29827 raft_consensus.cc:493] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.130389 29620 raft_consensus.cc:2468] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
I20260709 12:13:25.130805 29827 raft_consensus.cc:515] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:25.131896 29661 leader_election.cc:304] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:25.133445 29827 leader_election.cc:290] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:25.134068 29827 raft_consensus.cc:2804] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.134586 29621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb24a436d0b64405b521ed6763a1c52a" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:25.135318 29621 raft_consensus.cc:2468] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 0.
I20260709 12:13:25.134625 29827 raft_consensus.cc:697] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:25.136554 29661 leader_election.cc:304] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:25.134666 29770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb24a436d0b64405b521ed6763a1c52a" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd" is_pre_election: true
I20260709 12:13:25.137812 29770 raft_consensus.cc:2468] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 0.
I20260709 12:13:25.138087 29852 raft_consensus.cc:2804] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.139878 29852 raft_consensus.cc:493] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.140239 29852 raft_consensus.cc:3060] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.138348 29827 consensus_queue.cc:237] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:25.137048 29769 raft_consensus.cc:2468] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
I20260709 12:13:25.144618 29851 raft_consensus.cc:493] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.145179 29851 raft_consensus.cc:515] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:25.139307 29875 consensus_queue.cc:1048] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:13:25.147486 29851 leader_election.cc:290] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:25.149058 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f252a21f63b4c6680524bbfff117ff6" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
I20260709 12:13:25.149835 29696 raft_consensus.cc:2468] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2514b4a6525c4689a6d4263de3575285 in term 0.
I20260709 12:13:25.152135 29585 leader_election.cc:304] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:25.153127 29817 raft_consensus.cc:2804] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.153574 29817 raft_consensus.cc:493] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.154439 29817 raft_consensus.cc:3060] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.149127 29768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f252a21f63b4c6680524bbfff117ff6" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd" is_pre_election: true
I20260709 12:13:25.159801 29768 raft_consensus.cc:2468] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2514b4a6525c4689a6d4263de3575285 in term 0.
I20260709 12:13:25.159490 29852 raft_consensus.cc:515] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:25.166754 29852 leader_election.cc:290] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:25.167680 29621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb24a436d0b64405b521ed6763a1c52a" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:25.168488 29621 raft_consensus.cc:3060] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.167761 29515 catalog_manager.cc:5697] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 1 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.170320 29817 raft_consensus.cc:515] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:25.173451 29768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb24a436d0b64405b521ed6763a1c52a" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:25.174124 29768 raft_consensus.cc:3060] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.175424 29769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f252a21f63b4c6680524bbfff117ff6" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:25.176093 29769 raft_consensus.cc:3060] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.178566 29817 leader_election.cc:290] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 election: Requested vote from peers 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:25.181630 29768 raft_consensus.cc:2468] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
I20260709 12:13:25.182742 29659 leader_election.cc:304] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:25.182761 29621 raft_consensus.cc:2468] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
I20260709 12:13:25.183913 29852 raft_consensus.cc:2804] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.184549 29852 raft_consensus.cc:697] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:25.185009 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f252a21f63b4c6680524bbfff117ff6" candidate_uuid: "2514b4a6525c4689a6d4263de3575285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:25.185681 29696 raft_consensus.cc:3060] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.186012 29852 consensus_queue.cc:237] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:25.188388 29769 raft_consensus.cc:2468] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2514b4a6525c4689a6d4263de3575285 in term 1.
I20260709 12:13:25.189692 29584 leader_election.cc:304] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:25.190629 29817 raft_consensus.cc:2804] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.191119 29817 raft_consensus.cc:697] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 1 LEADER]: Becoming Leader. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Running, Role: LEADER
I20260709 12:13:25.191942 29817 consensus_queue.cc:237] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:25.195111 29696 raft_consensus.cc:2468] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2514b4a6525c4689a6d4263de3575285 in term 1.
I20260709 12:13:25.206955 29827 consensus_queue.cc:1048] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.209338 29827 consensus_queue.cc:1048] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.209179 29516 catalog_manager.cc:5697] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2514b4a6525c4689a6d4263de3575285 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "2514b4a6525c4689a6d4263de3575285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.209893 29515 catalog_manager.cc:5697] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 1 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.253970 29817 consensus_queue.cc:1048] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.257064 29815 consensus_queue.cc:1048] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.265753 29851 consensus_queue.cc:1048] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:25.275734 29696 raft_consensus.cc:3060] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.285013 29838 consensus_queue.cc:1048] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.302593 29852 raft_consensus.cc:493] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.303169 29852 raft_consensus.cc:515] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:25.304752 29852 leader_election.cc:290] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b085b580e39741da9402d86991cffcfd (127.20.56.67:38781), 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063)
I20260709 12:13:25.305608 29769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd" is_pre_election: true
I20260709 12:13:25.305814 29621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285" is_pre_election: true
I20260709 12:13:25.306232 29769 raft_consensus.cc:2468] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 0.
I20260709 12:13:25.306528 29621 raft_consensus.cc:2468] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 0.
I20260709 12:13:25.307307 29659 leader_election.cc:304] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:25.308075 29852 raft_consensus.cc:2804] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:25.308389 29852 raft_consensus.cc:493] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.308662 29852 raft_consensus.cc:3060] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.313707 29852 raft_consensus.cc:515] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:25.315346 29852 leader_election.cc:290] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Requested vote from peers b085b580e39741da9402d86991cffcfd (127.20.56.67:38781), 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063)
I20260709 12:13:25.316254 29769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:25.316408 29621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:25.316888 29769 raft_consensus.cc:3060] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.316994 29621 raft_consensus.cc:3060] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:25.322077 29769 raft_consensus.cc:2468] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
I20260709 12:13:25.322077 29621 raft_consensus.cc:2468] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
I20260709 12:13:25.323339 29659 leader_election.cc:304] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:25.324080 29852 raft_consensus.cc:2804] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:25.324612 29852 raft_consensus.cc:697] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:25.325356 29852 consensus_queue.cc:237] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:25.332285 29516 catalog_manager.cc:5697] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 1 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.351029 29838 consensus_queue.cc:1048] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.361439 29837 consensus_queue.cc:1048] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.501274 20705 ts_manager.cc:295] Set tserver state for 2514b4a6525c4689a6d4263de3575285 to MAINTENANCE_MODE
I20260709 12:13:25.502027 20705 tablet_server.cc:179] TabletServer@127.20.56.65:0 shutting down...
W20260709 12:13:25.515751 29735 consensus_peers.cc:597] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.527590 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:25.528288 20705 tablet_replica.cc:333] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.528858 20705 raft_consensus.cc:2243] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.529449 20705 pending_rounds.cc:70] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Trying to abort 1 pending ops.
I20260709 12:13:25.529631 20705 pending_rounds.cc:77] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622344477433856 op_type: NO_OP noop_request { }
I20260709 12:13:25.529881 20705 raft_consensus.cc:2889] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:25.530133 20705 raft_consensus.cc:2272] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.532335 20705 tablet_replica.cc:333] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.532886 20705 raft_consensus.cc:2243] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.533254 20705 raft_consensus.cc:2272] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.535461 20705 tablet_replica.cc:333] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.536089 20705 raft_consensus.cc:2243] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.536458 20705 raft_consensus.cc:2272] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.538906 20705 tablet_replica.cc:333] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.539418 20705 raft_consensus.cc:2243] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.539793 20705 raft_consensus.cc:2272] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.542063 20705 tablet_replica.cc:333] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.542655 20705 raft_consensus.cc:2243] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.543011 20705 raft_consensus.cc:2272] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.545092 20705 tablet_replica.cc:333] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.545605 20705 raft_consensus.cc:2243] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.545920 20705 raft_consensus.cc:2272] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.547818 20705 tablet_replica.cc:333] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.548513 20705 raft_consensus.cc:2243] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.548893 20705 raft_consensus.cc:2272] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.550634 20705 tablet_replica.cc:333] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.551288 20705 raft_consensus.cc:2243] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.551759 20705 raft_consensus.cc:2272] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:25.551777 29661 consensus_peers.cc:597] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.553437 20705 tablet_replica.cc:333] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.553982 20705 raft_consensus.cc:2243] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:25.554381 20705 raft_consensus.cc:2272] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:25.556486 20705 tablet_replica.cc:333] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: stopping tablet replica
I20260709 12:13:25.556979 20705 raft_consensus.cc:2243] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:25.557811 20705 raft_consensus.cc:2272] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:25.581212 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:25.587119 29852 consensus_queue.cc:1048] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:25.587716 20705 tablet_server.cc:196] TabletServer@127.20.56.65:0 shutdown complete.
W20260709 12:13:25.668466 29661 consensus_peers.cc:597] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.670379 29876 consensus_queue.cc:1048] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:25.707544 29661 consensus_peers.cc:597] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:25.709276 29661 consensus_peers.cc:597] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:25.722069 29661 consensus_peers.cc:597] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:25.760581 29735 consensus_peers.cc:597] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.775323 29876 consensus_queue.cc:1048] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:25.809089 29735 consensus_peers.cc:597] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:26.582517 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:26.766135 29852 raft_consensus.cc:493] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2514b4a6525c4689a6d4263de3575285)
I20260709 12:13:26.767053 29852 raft_consensus.cc:515] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:26.769280 29852 leader_election.cc:290] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:26.770587 29815 raft_consensus.cc:493] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2514b4a6525c4689a6d4263de3575285)
I20260709 12:13:26.770871 29768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd" is_pre_election: true
I20260709 12:13:26.771588 29815 raft_consensus.cc:515] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:26.772500 29768 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 1.
W20260709 12:13:26.773290 29661 leader_election.cc:336] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111)
I20260709 12:13:26.774088 29659 leader_election.cc:304] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd; no voters: 2514b4a6525c4689a6d4263de3575285
I20260709 12:13:26.774712 29815 leader_election.cc:290] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:26.775954 29852 raft_consensus.cc:2804] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:26.776394 29852 raft_consensus.cc:493] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2514b4a6525c4689a6d4263de3575285)
I20260709 12:13:26.776893 29852 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:26.777853 29735 leader_election.cc:336] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111)
I20260709 12:13:26.778137 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
I20260709 12:13:26.787638 29852 raft_consensus.cc:515] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:26.788765 29696 raft_consensus.cc:2393] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b085b580e39741da9402d86991cffcfd in current term 2: Already voted for candidate 89d6e213407d46c39f5ae74948d8abea in this term.
I20260709 12:13:26.789988 29852 leader_election.cc:290] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 2 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:26.791360 29768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:26.792045 29768 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.794307 29734 leader_election.cc:304] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b085b580e39741da9402d86991cffcfd; no voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea
W20260709 12:13:26.795822 29661 leader_election.cc:336] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111)
I20260709 12:13:26.800843 29768 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 2.
I20260709 12:13:26.801476 29815 raft_consensus.cc:2749] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:26.802345 29659 leader_election.cc:304] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd; no voters: 2514b4a6525c4689a6d4263de3575285
I20260709 12:13:26.803223 29852 raft_consensus.cc:2804] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.803747 29852 raft_consensus.cc:697] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 2 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:26.804991 29852 consensus_queue.cc:237] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:26.813264 29516 catalog_manager.cc:5697] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 1 to 2, leader changed from 2514b4a6525c4689a6d4263de3575285 (127.20.56.65) to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 2 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.939877 29815 raft_consensus.cc:493] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.940472 29815 raft_consensus.cc:515] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:26.942600 29815 leader_election.cc:290] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
W20260709 12:13:26.943820 29735 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111) [suppressed 125 similar messages]
I20260709 12:13:26.943785 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f252a21f63b4c6680524bbfff117ff6" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea" is_pre_election: true
I20260709 12:13:26.944919 29696 raft_consensus.cc:2468] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 1.
I20260709 12:13:26.946203 29734 leader_election.cc:304] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd; no voters: 
W20260709 12:13:26.946904 29735 leader_election.cc:336] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111)
I20260709 12:13:26.946940 29815 raft_consensus.cc:2804] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:26.947407 29815 raft_consensus.cc:493] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.947682 29815 raft_consensus.cc:3060] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.954725 29815 raft_consensus.cc:515] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:26.956382 29815 leader_election.cc:290] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:26.957476 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f252a21f63b4c6680524bbfff117ff6" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:26.958110 29696 raft_consensus.cc:3060] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:26.960078 29735 leader_election.cc:336] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111)
I20260709 12:13:26.964505 29696 raft_consensus.cc:2468] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 2.
I20260709 12:13:26.965636 29734 leader_election.cc:304] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd; no voters: 2514b4a6525c4689a6d4263de3575285
I20260709 12:13:26.966321 29815 raft_consensus.cc:2804] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.966799 29815 raft_consensus.cc:697] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:26.967808 29815 consensus_queue.cc:237] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:26.974807 29516 catalog_manager.cc:5697] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 1 to 2, leader changed from 2514b4a6525c4689a6d4263de3575285 (127.20.56.65) to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 2 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:27.298215 29661 consensus_peers.cc:597] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:27.375696 29696 raft_consensus.cc:1275] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:27.377017 29815 consensus_queue.cc:1048] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:27.395802 29735 consensus_peers.cc:597] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:27.430564 29768 raft_consensus.cc:1275] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Refusing update from remote peer 89d6e213407d46c39f5ae74948d8abea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.432054 29901 consensus_queue.cc:1048] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:27.583422 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:27.911466 29661 consensus_peers.cc:597] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:27.960843 29735 consensus_peers.cc:597] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:27.979533 29661 consensus_peers.cc:597] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:27.981424 29661 consensus_peers.cc:597] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.072775 29661 consensus_peers.cc:597] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.215940 29661 consensus_peers.cc:597] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.241791 29735 consensus_peers.cc:597] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.472250 29735 consensus_peers.cc:597] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.584549 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:29.585635 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:29.815759 29661 consensus_peers.cc:597] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:29.961333 29735 consensus_peers.cc:597] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:30.215826 29661 consensus_peers.cc:597] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.234017 29661 consensus_peers.cc:597] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.425698 29661 consensus_peers.cc:597] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.558108 29735 consensus_peers.cc:597] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.586628 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:30.612134 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:30.620021 29913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:30.620414 29914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:30.621399 29916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:30.622875 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:30.624997 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:30.625205 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:30.625453 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599210625434 us; error 0 us; skew 500 ppm
I20260709 12:13:30.626078 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:30.628965 20705 webserver.cc:533] Webserver started at http://127.20.56.65:42565/ using document root <none> and password file <none>
I20260709 12:13:30.629673 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:30.629870 20705 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:13:30.634038 20705 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:13:30.638895 29921 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:30.639674 20705 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:13:30.640005 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "2514b4a6525c4689a6d4263de3575285"
format_stamp: "Formatted at 2026-07-09 12:13:23 on dist-test-slave-2dwh"
I20260709 12:13:30.640374 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:30.651842 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:30.653499 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:30.655185 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:30.658726 29928 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:13:30.711163 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:13:30.711531 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.000s	sys 0.002s
I20260709 12:13:30.711899 20705 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:13:30.717952 29928 tablet_bootstrap.cc:492] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.732187 29928 tablet_bootstrap.cc:492] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:30.733222 29928 tablet_bootstrap.cc:492] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.733971 29928 ts_tablet_manager.cc:1403] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.008s
W20260709 12:13:30.735066 29661 consensus_peers.cc:597] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:30.736584 29928 raft_consensus.cc:359] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.737360 29928 raft_consensus.cc:740] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.738035 29928 consensus_queue.cc:260] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.740713 29928 ts_tablet_manager.cc:1434] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:30.741477 29928 tablet_bootstrap.cc:492] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.755894 29928 tablet_bootstrap.cc:492] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.756181 20705 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:13:30.756523 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.045s	user 0.039s	sys 0.001s
I20260709 12:13:30.756898 29928 tablet_bootstrap.cc:492] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.757809 29928 ts_tablet_manager.cc:1403] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:13:30.760252 29928 raft_consensus.cc:359] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.760861 29928 raft_consensus.cc:740] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.761566 29928 consensus_queue.cc:260] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.763422 29928 ts_tablet_manager.cc:1434] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:13:30.764523 29928 tablet_bootstrap.cc:492] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.782356 29928 tablet_bootstrap.cc:492] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.783324 29928 tablet_bootstrap.cc:492] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.784085 29928 ts_tablet_manager.cc:1403] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.001s
I20260709 12:13:30.786908 29928 raft_consensus.cc:359] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.787679 29928 raft_consensus.cc:740] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.788597 29928 consensus_queue.cc:260] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.790616 29928 ts_tablet_manager.cc:1434] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:30.791385 29928 tablet_bootstrap.cc:492] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.806116 29928 tablet_bootstrap.cc:492] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.807385 29928 tablet_bootstrap.cc:492] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.808139 29928 ts_tablet_manager.cc:1403] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:13:30.811096 29928 raft_consensus.cc:359] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.811873 29928 raft_consensus.cc:740] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.812625 29928 consensus_queue.cc:260] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.814800 29928 ts_tablet_manager.cc:1434] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:30.815516 29928 tablet_bootstrap.cc:492] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.829564 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:42063
I20260709 12:13:30.829676 29991 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:42063 every 8 connection(s)
I20260709 12:13:30.830578 29928 tablet_bootstrap.cc:492] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.831399 29928 tablet_bootstrap.cc:492] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.832099 29928 ts_tablet_manager.cc:1403] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:13:30.834625 29928 raft_consensus.cc:359] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.835160 29928 raft_consensus.cc:740] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.836023 29928 consensus_queue.cc:260] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.837680 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.837955 29928 ts_tablet_manager.cc:1434] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:30.839116 29928 tablet_bootstrap.cc:492] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.856928 29928 tablet_bootstrap.cc:492] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.857793 29928 tablet_bootstrap.cc:492] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.858471 29928 ts_tablet_manager.cc:1403] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:13:30.861040 29928 raft_consensus.cc:359] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:30.861627 29928 raft_consensus.cc:740] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.861744 29992 heartbeater.cc:344] Connected to a master server at 127.20.56.126:41433
I20260709 12:13:30.862335 29992 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:30.862506 29928 consensus_queue.cc:260] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:30.863376 29992 heartbeater.cc:507] Master 127.20.56.126:41433 requested a full tablet report, sending...
I20260709 12:13:30.864665 29928 ts_tablet_manager.cc:1434] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:30.865598 29928 tablet_bootstrap.cc:492] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.870401 29696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
mode: GRACEFUL
new_leader_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:55998
I20260709 12:13:30.871305 29696 raft_consensus.cc:606] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 2 LEADER]: Received request to transfer leadership to TS b085b580e39741da9402d86991cffcfd
I20260709 12:13:30.874126 29515 ts_manager.cc:194] Re-registered known tserver with Master: 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063)
I20260709 12:13:30.874905 29696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bc8cab458b546498e660456894d1295"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
mode: GRACEFUL
new_leader_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:55998
I20260709 12:13:30.875573 29696 raft_consensus.cc:606] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Received request to transfer leadership to TS b085b580e39741da9402d86991cffcfd
I20260709 12:13:30.877154 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:30.878080 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:30.879369 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.892077 29515 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51464
I20260709 12:13:30.896727 29992 heartbeater.cc:499] Master 127.20.56.126:41433 was elected leader, sending a full tablet report...
I20260709 12:13:30.908828 29928 tablet_bootstrap.cc:492] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.909884 29928 tablet_bootstrap.cc:492] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.910625 29928 ts_tablet_manager.cc:1403] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.020s
I20260709 12:13:30.913120 29928 raft_consensus.cc:359] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.913632 29928 raft_consensus.cc:740] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.914331 29928 consensus_queue.cc:260] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.916014 29928 ts_tablet_manager.cc:1434] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:30.916738 29928 tablet_bootstrap.cc:492] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.931272 29928 tablet_bootstrap.cc:492] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.931311 29964 raft_consensus.cc:3060] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.932279 29928 tablet_bootstrap.cc:492] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.932963 29928 ts_tablet_manager.cc:1403] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.002s
I20260709 12:13:30.935585 29928 raft_consensus.cc:359] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.936254 29928 raft_consensus.cc:740] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.936964 29928 consensus_queue.cc:260] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.938891 29964 pending_rounds.cc:85] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Aborting all ops after (but not including) 0
I20260709 12:13:30.938933 29928 ts_tablet_manager.cc:1434] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:13:30.939395 29964 pending_rounds.cc:107] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:13:30.939815 29964 raft_consensus.cc:2889] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:30.940248 29928 tablet_bootstrap.cc:492] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.952567 29928 tablet_bootstrap.cc:492] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.953274 29928 tablet_bootstrap.cc:492] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.953855 29928 ts_tablet_manager.cc:1403] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 12:13:30.955760 29928 raft_consensus.cc:359] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.956260 29928 raft_consensus.cc:740] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.956815 29928 consensus_queue.cc:260] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.958644 29928 ts_tablet_manager.cc:1434] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:13:30.959544 29928 tablet_bootstrap.cc:492] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: Bootstrap starting.
I20260709 12:13:30.972712 29928 tablet_bootstrap.cc:492] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.973405 29928 tablet_bootstrap.cc:492] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: Bootstrap complete.
I20260709 12:13:30.973933 29928 ts_tablet_manager.cc:1403] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:13:30.975760 29928 raft_consensus.cc:359] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.976213 29928 raft_consensus.cc:740] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2514b4a6525c4689a6d4263de3575285, State: Initialized, Role: FOLLOWER
I20260709 12:13:30.976779 29928 consensus_queue.cc:260] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:30.978519 29928 ts_tablet_manager.cc:1434] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 12:13:31.040825 29852 raft_consensus.cc:993] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea: : Instructing follower b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:31.041652 29970 raft_consensus.cc:1081] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Signalling peer b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:31.043593 29768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bc8cab458b546498e660456894d1295"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:13:31.044111 29768 raft_consensus.cc:493] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.044415 29768 raft_consensus.cc:3060] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.050062 29768 raft_consensus.cc:515] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:31.051877 29768 leader_election.cc:290] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:31.052850 29964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc8cab458b546498e660456894d1295" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:31.052942 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc8cab458b546498e660456894d1295" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:31.053727 29964 raft_consensus.cc:3060] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.053828 29696 raft_consensus.cc:3055] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.054304 29696 raft_consensus.cc:740] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:31.055279 29696 consensus_queue.cc:260] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:31.056411 29696 raft_consensus.cc:3060] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.060894 29964 raft_consensus.cc:2468] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 2.
I20260709 12:13:31.062325 29735 leader_election.cc:304] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:31.062914 29696 raft_consensus.cc:2468] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 2.
I20260709 12:13:31.063454 30004 raft_consensus.cc:2804] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.063958 30004 raft_consensus.cc:697] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:31.064975 30004 consensus_queue.cc:237] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:31.072299 29515 catalog_manager.cc:5697] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 1 to 2, leader changed from 89d6e213407d46c39f5ae74948d8abea (127.20.56.66) to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 2 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.244340 29852 raft_consensus.cc:993] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea: : Instructing follower b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:31.244874 29970 raft_consensus.cc:1081] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 2 LEADER]: Signalling peer b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:31.246590 29768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:13:31.247167 29768 raft_consensus.cc:493] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.247476 29768 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.252843 29768 raft_consensus.cc:515] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:31.254731 29768 leader_election.cc:290] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 3 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:31.255584 29964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:31.255805 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:31.256316 29964 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.256352 29696 raft_consensus.cc:3055] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.256906 29696 raft_consensus.cc:740] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:31.257787 29696 consensus_queue.cc:260] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:31.259150 29696 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.264295 29964 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 3.
I20260709 12:13:31.265722 29735 leader_election.cc:304] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:31.266517 30004 raft_consensus.cc:2804] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.266587 29696 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 3.
I20260709 12:13:31.267064 30004 raft_consensus.cc:697] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 3 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:31.268131 30004 consensus_queue.cc:237] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:31.275664 29515 catalog_manager.cc:5697] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 2 to 3, leader changed from 89d6e213407d46c39f5ae74948d8abea (127.20.56.66) to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 3 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.515182 29964 raft_consensus.cc:1275] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:31.516525 29815 consensus_queue.cc:1048] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:31.527026 29696 raft_consensus.cc:1275] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:31.528678 29815 consensus_queue.cc:1048] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:31.587731 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:31.835513 29696 raft_consensus.cc:1275] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.836930 29815 consensus_queue.cc:1048] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.846231 29964 raft_consensus.cc:1275] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.847668 30017 consensus_queue.cc:1048] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:31.900965 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.920289 29768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
mode: GRACEFUL
new_leader_uuid: "89d6e213407d46c39f5ae74948d8abea"
 from {username='slave'} at 127.0.0.1:40778
I20260709 12:13:31.920848 29768 raft_consensus.cc:606] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 1 LEADER]: Received request to transfer leadership to TS 89d6e213407d46c39f5ae74948d8abea
I20260709 12:13:31.923475 29768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bc8cab458b546498e660456894d1295"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
mode: GRACEFUL
new_leader_uuid: "89d6e213407d46c39f5ae74948d8abea"
 from {username='slave'} at 127.0.0.1:40778
I20260709 12:13:31.923985 29768 raft_consensus.cc:606] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Received request to transfer leadership to TS 89d6e213407d46c39f5ae74948d8abea
I20260709 12:13:31.925004 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:31.925495 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:31.926306 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.153038 30024 raft_consensus.cc:993] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd: : Instructing follower 89d6e213407d46c39f5ae74948d8abea to start an election
I20260709 12:13:32.153682 30017 raft_consensus.cc:1081] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Signalling peer 89d6e213407d46c39f5ae74948d8abea to start an election
I20260709 12:13:32.155258 29696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bc8cab458b546498e660456894d1295"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:13:32.155884 29696 raft_consensus.cc:493] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.156246 29696 raft_consensus.cc:3060] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.162580 29696 raft_consensus.cc:515] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:32.164547 29696 leader_election.cc:290] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 3 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:32.165412 29964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc8cab458b546498e660456894d1295" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:32.166106 29964 raft_consensus.cc:3060] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.166007 29768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc8cab458b546498e660456894d1295" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:32.166798 29768 raft_consensus.cc:3055] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.167194 29768 raft_consensus.cc:740] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:32.168005 29768 consensus_queue.cc:260] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:32.169303 29768 raft_consensus.cc:3060] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.174026 29964 raft_consensus.cc:2468] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 3.
I20260709 12:13:32.175392 29661 leader_election.cc:304] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:32.176209 30018 raft_consensus.cc:2804] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:32.176648 29768 raft_consensus.cc:2468] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 3.
I20260709 12:13:32.176666 30018 raft_consensus.cc:697] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 3 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:32.177834 30018 consensus_queue.cc:237] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:32.184640 29515 catalog_manager.cc:5697] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 2 to 3, leader changed from b085b580e39741da9402d86991cffcfd (127.20.56.67) to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 3 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.364099 30024 raft_consensus.cc:993] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd: : Instructing follower 89d6e213407d46c39f5ae74948d8abea to start an election
I20260709 12:13:32.364631 30017 raft_consensus.cc:1081] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 1 LEADER]: Signalling peer 89d6e213407d46c39f5ae74948d8abea to start an election
I20260709 12:13:32.366153 29696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:13:32.366659 29696 raft_consensus.cc:493] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.366915 29696 raft_consensus.cc:3060] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.371743 29696 raft_consensus.cc:515] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:32.373188 29696 leader_election.cc:290] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 2 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:32.374145 29964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:32.374249 29768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f2167548d8a47d2bf1635fb6a674f34" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:32.375010 29964 raft_consensus.cc:3060] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.375159 29768 raft_consensus.cc:3055] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.375602 29768 raft_consensus.cc:740] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:32.376471 29768 consensus_queue.cc:260] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:32.377772 29768 raft_consensus.cc:3060] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.382925 29964 raft_consensus.cc:2468] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 2.
I20260709 12:13:32.384358 29661 leader_election.cc:304] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:32.385093 29768 raft_consensus.cc:2468] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 2.
I20260709 12:13:32.385120 30018 raft_consensus.cc:2804] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.385847 30018 raft_consensus.cc:697] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 2 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:32.386835 30018 consensus_queue.cc:237] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:32.394105 29515 catalog_manager.cc:5697] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 1 to 2, leader changed from b085b580e39741da9402d86991cffcfd (127.20.56.67) to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 2 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.576953 29768 raft_consensus.cc:1275] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Refusing update from remote peer 89d6e213407d46c39f5ae74948d8abea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.578456 30018 consensus_queue.cc:1048] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.588091 29964 raft_consensus.cc:1275] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Refusing update from remote peer 89d6e213407d46c39f5ae74948d8abea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:32.588949 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:32.590091 29970 consensus_queue.cc:1048] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:32.767815 29964 raft_consensus.cc:1275] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Refusing update from remote peer 89d6e213407d46c39f5ae74948d8abea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.769186 30035 consensus_queue.cc:1048] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.778366 29768 raft_consensus.cc:1275] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Refusing update from remote peer 89d6e213407d46c39f5ae74948d8abea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.779851 30035 consensus_queue.cc:1048] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.934610 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.942651 29696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
mode: GRACEFUL
new_leader_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:55998
I20260709 12:13:32.943202 29696 raft_consensus.cc:606] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Received request to transfer leadership to TS b085b580e39741da9402d86991cffcfd
I20260709 12:13:32.945966 29696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
mode: GRACEFUL
new_leader_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:55998
I20260709 12:13:32.946516 29696 raft_consensus.cc:606] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Received request to transfer leadership to TS b085b580e39741da9402d86991cffcfd
I20260709 12:13:32.947700 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:32.948216 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:32.948805 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.299171 29970 raft_consensus.cc:993] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea: : Instructing follower b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:33.299657 30042 raft_consensus.cc:1081] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Signalling peer b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:33.301232 29768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:13:33.301777 29768 raft_consensus.cc:493] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.302078 29768 raft_consensus.cc:3060] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.304313 29970 raft_consensus.cc:993] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea: : Instructing follower b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:33.304840 30042 raft_consensus.cc:1081] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Signalling peer b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:33.306385 29769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:13:33.306900 29769 raft_consensus.cc:493] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.307199 29769 raft_consensus.cc:3060] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.307983 29768 raft_consensus.cc:515] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:33.310528 29768 leader_election.cc:290] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Requested vote from peers 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705), 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063)
I20260709 12:13:33.310868 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:33.311058 29964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:33.311467 29696 raft_consensus.cc:3055] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.311703 29964 raft_consensus.cc:3060] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.311836 29696 raft_consensus.cc:740] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:33.312769 29696 consensus_queue.cc:260] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:33.313704 29696 raft_consensus.cc:3060] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.316495 29769 raft_consensus.cc:515] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:33.318356 29696 raft_consensus.cc:2468] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 2.
I20260709 12:13:33.318867 29769 leader_election.cc:290] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:33.320149 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:33.320710 29961 raft_consensus.cc:3060] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.320746 29964 raft_consensus.cc:2468] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 2.
I20260709 12:13:33.321998 29734 leader_election.cc:304] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89d6e213407d46c39f5ae74948d8abea, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:33.322856 30017 raft_consensus.cc:2804] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.323932 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7cafab58d14929846a2649a9074ca4" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:33.324541 29696 raft_consensus.cc:3055] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.324792 30017 raft_consensus.cc:697] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:33.324828 29696 raft_consensus.cc:740] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:33.325911 30017 consensus_queue.cc:237] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:33.325937 29696 consensus_queue.cc:260] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:33.327639 29696 raft_consensus.cc:3060] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.328248 29961 raft_consensus.cc:2468] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 2.
I20260709 12:13:33.329699 29735 leader_election.cc:304] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:33.335533 30043 raft_consensus.cc:2804] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.336226 30043 raft_consensus.cc:697] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:33.336300 29696 raft_consensus.cc:2468] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 2.
I20260709 12:13:33.337584 30043 consensus_queue.cc:237] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:33.344090 29515 catalog_manager.cc:5697] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 1 to 2, leader changed from 89d6e213407d46c39f5ae74948d8abea (127.20.56.66) to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 2 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.358835 29515 catalog_manager.cc:5697] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 1 to 2, leader changed from 89d6e213407d46c39f5ae74948d8abea (127.20.56.66) to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 2 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:33.589987 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:33.757922 29961 raft_consensus.cc:1275] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.759370 30043 consensus_queue.cc:1048] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.772274 29696 raft_consensus.cc:1275] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.774191 30045 consensus_queue.cc:1048] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.876499 29961 raft_consensus.cc:1275] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.877811 30043 consensus_queue.cc:1048] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.889230 29696 raft_consensus.cc:1275] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.893241 30043 consensus_queue.cc:1048] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.955009 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.962519 29769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
mode: GRACEFUL
new_leader_uuid: "89d6e213407d46c39f5ae74948d8abea"
 from {username='slave'} at 127.0.0.1:40778
I20260709 12:13:33.963042 29769 raft_consensus.cc:606] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Received request to transfer leadership to TS 89d6e213407d46c39f5ae74948d8abea
I20260709 12:13:33.965699 29769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
mode: GRACEFUL
new_leader_uuid: "89d6e213407d46c39f5ae74948d8abea"
 from {username='slave'} at 127.0.0.1:40778
I20260709 12:13:33.966204 29769 raft_consensus.cc:606] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 3 LEADER]: Received request to transfer leadership to TS 89d6e213407d46c39f5ae74948d8abea
I20260709 12:13:33.967437 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:33.967921 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:33.968549 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:34.167119 30058 raft_consensus.cc:993] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd: : Instructing follower 89d6e213407d46c39f5ae74948d8abea to start an election
I20260709 12:13:34.167768 30017 raft_consensus.cc:1081] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Signalling peer 89d6e213407d46c39f5ae74948d8abea to start an election
I20260709 12:13:34.169414 29696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:13:34.169950 29696 raft_consensus.cc:493] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.170354 29696 raft_consensus.cc:3060] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.175064 29696 raft_consensus.cc:515] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:34.176556 29696 leader_election.cc:290] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 3 election: Requested vote from peers b085b580e39741da9402d86991cffcfd (127.20.56.67:38781), 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063)
I20260709 12:13:34.177486 29769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:34.177646 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "124fa3187e384bb1aa743eb25c7ef353" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:34.178086 29769 raft_consensus.cc:3055] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:34.178264 29961 raft_consensus.cc:3060] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.178520 29769 raft_consensus.cc:740] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:34.179391 29769 consensus_queue.cc:260] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:34.180517 29769 raft_consensus.cc:3060] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:34.184459 29961 raft_consensus.cc:2468] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 3.
I20260709 12:13:34.185629 29661 leader_election.cc:304] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:34.186187 29769 raft_consensus.cc:2468] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 3.
I20260709 12:13:34.186429 29970 raft_consensus.cc:2804] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:34.187187 29970 raft_consensus.cc:697] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 3 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:34.188091 29970 consensus_queue.cc:237] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } }
I20260709 12:13:34.195549 29515 catalog_manager.cc:5697] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 2 to 3, leader changed from b085b580e39741da9402d86991cffcfd (127.20.56.67) to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 3 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.576869 30058 raft_consensus.cc:993] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd: : Instructing follower 89d6e213407d46c39f5ae74948d8abea to start an election
I20260709 12:13:34.577358 30017 raft_consensus.cc:1081] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 3 LEADER]: Signalling peer 89d6e213407d46c39f5ae74948d8abea to start an election
I20260709 12:13:34.578917 29696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:13:34.579365 29696 raft_consensus.cc:493] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.579679 29696 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:34.585752 29696 raft_consensus.cc:515] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:34.587977 29696 leader_election.cc:290] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 4 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), b085b580e39741da9402d86991cffcfd (127.20.56.67:38781)
I20260709 12:13:34.588373 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:34.588653 29769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "89d6e213407d46c39f5ae74948d8abea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b085b580e39741da9402d86991cffcfd"
I20260709 12:13:34.589071 29961 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:34.589246 29769 raft_consensus.cc:3055] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:34.589635 29769 raft_consensus.cc:740] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
W20260709 12:13:34.590912 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:34.590523 29769 consensus_queue.cc:260] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:34.591801 29769 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:34.595108 29961 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 4.
I20260709 12:13:34.596560 29661 leader_election.cc:304] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, 89d6e213407d46c39f5ae74948d8abea; no voters: 
I20260709 12:13:34.597324 29970 raft_consensus.cc:2804] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:34.597774 29769 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89d6e213407d46c39f5ae74948d8abea in term 4.
I20260709 12:13:34.598901 29970 raft_consensus.cc:697] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 4 LEADER]: Becoming Leader. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:34.600122 29970 consensus_queue.cc:237] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:34.608584 29515 catalog_manager.cc:5697] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea reported cstate change: term changed from 3 to 4, leader changed from b085b580e39741da9402d86991cffcfd (127.20.56.67) to 89d6e213407d46c39f5ae74948d8abea (127.20.56.66). New cstate: current_term: 4 leader_uuid: "89d6e213407d46c39f5ae74948d8abea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.716604 29961 raft_consensus.cc:1275] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Refusing update from remote peer 89d6e213407d46c39f5ae74948d8abea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.717860 29970 consensus_queue.cc:1048] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.726820 29769 raft_consensus.cc:1275] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Refusing update from remote peer 89d6e213407d46c39f5ae74948d8abea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.728322 30067 consensus_queue.cc:1048] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.975428 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:34.983075 29696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
mode: GRACEFUL
new_leader_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:55998
I20260709 12:13:34.983552 29696 raft_consensus.cc:606] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 4 LEADER]: Received request to transfer leadership to TS b085b580e39741da9402d86991cffcfd
I20260709 12:13:34.986049 29696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186"
dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
mode: GRACEFUL
new_leader_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:55998
I20260709 12:13:34.986531 29696 raft_consensus.cc:606] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Received request to transfer leadership to TS b085b580e39741da9402d86991cffcfd
I20260709 12:13:34.987457 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:34.987919 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:34.988415 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:35.048419 29769 raft_consensus.cc:1275] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 4 FOLLOWER]: Refusing update from remote peer 89d6e213407d46c39f5ae74948d8abea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:35.049809 30067 consensus_queue.cc:1048] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:35.056373 29970 raft_consensus.cc:993] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea: : Instructing follower b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:35.056905 30063 raft_consensus.cc:1081] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 4 LEADER]: Signalling peer b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:35.060189 29961 raft_consensus.cc:1275] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 4 FOLLOWER]: Refusing update from remote peer 89d6e213407d46c39f5ae74948d8abea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:35.061847 29768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:13:35.061895 30063 consensus_queue.cc:1048] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:35.063097 29768 raft_consensus.cc:493] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.063498 29768 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:35.070981 29768 raft_consensus.cc:515] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:35.073947 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:35.074576 29696 raft_consensus.cc:3055] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:35.074967 29696 raft_consensus.cc:740] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:35.075042 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cfc0db03fe544c59677c3bd19b1d476" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:35.075860 29696 consensus_queue.cc:260] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:35.076866 29961 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:35.077099 29696 raft_consensus.cc:3060] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:35.079748 29768 leader_election.cc:290] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 5 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:35.084619 29961 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 5.
I20260709 12:13:35.085991 29696 raft_consensus.cc:2468] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 5.
I20260709 12:13:35.085965 29735 leader_election.cc:304] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:35.087004 30017 raft_consensus.cc:2804] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:35.087941 30017 raft_consensus.cc:697] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 5 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:35.088766 30017 consensus_queue.cc:237] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:35.095808 29516 catalog_manager.cc:5697] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 4 to 5, leader changed from 89d6e213407d46c39f5ae74948d8abea (127.20.56.66) to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 5 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:35.351501 30063 raft_consensus.cc:993] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea: : Instructing follower b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:35.351982 30042 raft_consensus.cc:1081] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Signalling peer b085b580e39741da9402d86991cffcfd to start an election
I20260709 12:13:35.353389 29768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186"
dest_uuid: "b085b580e39741da9402d86991cffcfd"
 from {username='slave'} at 127.0.0.1:41440
I20260709 12:13:35.353799 29768 raft_consensus.cc:493] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.354018 29768 raft_consensus.cc:3060] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.358351 29768 raft_consensus.cc:515] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:35.359845 29768 leader_election.cc:290] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Requested vote from peers 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063), 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705)
I20260709 12:13:35.360697 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2514b4a6525c4689a6d4263de3575285"
I20260709 12:13:35.360889 29696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "863ad85c3ff64fb38d4a221c10ee6186" candidate_uuid: "b085b580e39741da9402d86991cffcfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89d6e213407d46c39f5ae74948d8abea"
I20260709 12:13:35.361415 29696 raft_consensus.cc:3055] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:35.361415 29961 raft_consensus.cc:3060] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.361862 29696 raft_consensus.cc:740] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89d6e213407d46c39f5ae74948d8abea, State: Running, Role: LEADER
I20260709 12:13:35.362681 29696 consensus_queue.cc:260] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:35.363915 29696 raft_consensus.cc:3060] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.368975 29961 raft_consensus.cc:2468] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 2.
I20260709 12:13:35.370225 29735 leader_election.cc:304] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2514b4a6525c4689a6d4263de3575285, b085b580e39741da9402d86991cffcfd; no voters: 
I20260709 12:13:35.370631 29696 raft_consensus.cc:2468] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b085b580e39741da9402d86991cffcfd in term 2.
I20260709 12:13:35.371037 30017 raft_consensus.cc:2804] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:35.371641 30017 raft_consensus.cc:697] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Becoming Leader. State: Replica: b085b580e39741da9402d86991cffcfd, State: Running, Role: LEADER
I20260709 12:13:35.372489 30017 consensus_queue.cc:237] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } }
I20260709 12:13:35.379382 29516 catalog_manager.cc:5697] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd reported cstate change: term changed from 1 to 2, leader changed from 89d6e213407d46c39f5ae74948d8abea (127.20.56.66) to b085b580e39741da9402d86991cffcfd (127.20.56.67). New cstate: current_term: 2 leader_uuid: "b085b580e39741da9402d86991cffcfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b085b580e39741da9402d86991cffcfd" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 38781 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:35.545099 29961 raft_consensus.cc:1275] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 5 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:35.546401 30017 consensus_queue.cc:1048] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:35.555027 29696 raft_consensus.cc:1275] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 5 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:35.556811 30074 consensus_queue.cc:1048] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:13:35.591919 29567 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:35.909462 29964 raft_consensus.cc:1275] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.911862 30074 consensus_queue.cc:1048] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2514b4a6525c4689a6d4263de3575285" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 42063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:35.925622 29696 raft_consensus.cc:1275] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Refusing update from remote peer b085b580e39741da9402d86991cffcfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.928331 30072 consensus_queue.cc:1048] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "89d6e213407d46c39f5ae74948d8abea" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:35.994675 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:36.032828 20705 tablet_server.cc:179] TabletServer@127.20.56.65:42063 shutting down...
I20260709 12:13:36.065320 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:36.066184 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.067034 20705 raft_consensus.cc:2243] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.067727 20705 raft_consensus.cc:2272] T 5cfc0db03fe544c59677c3bd19b1d476 P 2514b4a6525c4689a6d4263de3575285 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.071193 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.071839 20705 raft_consensus.cc:2243] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.072297 20705 raft_consensus.cc:2272] T 863ad85c3ff64fb38d4a221c10ee6186 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.075408 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.076125 20705 raft_consensus.cc:2243] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.076584 20705 raft_consensus.cc:2272] T e3ddd3202fef4a9ea16d74ad97f570c6 P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.079200 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.080009 20705 raft_consensus.cc:2243] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.080657 20705 raft_consensus.cc:2272] T 1f2167548d8a47d2bf1635fb6a674f34 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:36.081971 29735 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 78 similar messages]
I20260709 12:13:36.084295 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.085254 20705 raft_consensus.cc:2243] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:36.085772 29735 consensus_peers.cc:597] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.085971 20705 raft_consensus.cc:2272] T bb24a436d0b64405b521ed6763a1c52a P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.088557 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.089146 20705 raft_consensus.cc:2243] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.089732 20705 raft_consensus.cc:2272] T cb7cafab58d14929846a2649a9074ca4 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.093196 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.093878 20705 raft_consensus.cc:2243] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:36.094623 29735 consensus_peers.cc:597] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.094632 20705 raft_consensus.cc:2272] T 124fa3187e384bb1aa743eb25c7ef353 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.097380 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.098016 20705 raft_consensus.cc:2243] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.098536 20705 raft_consensus.cc:2272] T b2358003b8ee4a9db783bf49bc3467fb P 2514b4a6525c4689a6d4263de3575285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.100996 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.101552 20705 raft_consensus.cc:2243] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.102057 20705 raft_consensus.cc:2272] T 8bc8cab458b546498e660456894d1295 P 2514b4a6525c4689a6d4263de3575285 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.104494 20705 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:36.105046 20705 raft_consensus.cc:2243] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.105587 20705 raft_consensus.cc:2272] T 2f252a21f63b4c6680524bbfff117ff6 P 2514b4a6525c4689a6d4263de3575285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.141541 20705 tablet_server.cc:196] TabletServer@127.20.56.65:42063 shutdown complete.
I20260709 12:13:36.174086 20705 tablet_server.cc:179] TabletServer@127.20.56.66:0 shutting down...
W20260709 12:13:36.190500 29734 consensus_peers.cc:597] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd -> Peer 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705): Couldn't send request to peer 89d6e213407d46c39f5ae74948d8abea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.201745 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:36.202782 20705 tablet_replica.cc:333] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.203573 20705 raft_consensus.cc:2243] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.204133 20705 raft_consensus.cc:2272] T 2f252a21f63b4c6680524bbfff117ff6 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.206818 20705 tablet_replica.cc:333] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.207605 20705 raft_consensus.cc:2243] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.209029 20705 raft_consensus.cc:2272] T 1f2167548d8a47d2bf1635fb6a674f34 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.214247 20705 tablet_replica.cc:333] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.215682 20705 raft_consensus.cc:2243] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.216627 20705 raft_consensus.cc:2272] T 863ad85c3ff64fb38d4a221c10ee6186 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:36.219049 29735 consensus_peers.cc:597] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.221596 20705 tablet_replica.cc:333] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.222733 20705 raft_consensus.cc:2243] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.223377 20705 raft_consensus.cc:2272] T e3ddd3202fef4a9ea16d74ad97f570c6 P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.226960 20705 tablet_replica.cc:333] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.227910 20705 raft_consensus.cc:2243] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.228523 20705 raft_consensus.cc:2272] T cb7cafab58d14929846a2649a9074ca4 P 89d6e213407d46c39f5ae74948d8abea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.232616 20705 tablet_replica.cc:333] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.233357 20705 raft_consensus.cc:2243] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:13:36.233430 29735 consensus_peers.cc:597] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd -> Peer 2514b4a6525c4689a6d4263de3575285 (127.20.56.65:42063): Couldn't send request to peer 2514b4a6525c4689a6d4263de3575285. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:42063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.234773 20705 raft_consensus.cc:2272] T 124fa3187e384bb1aa743eb25c7ef353 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.237962 20705 tablet_replica.cc:333] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.238862 20705 raft_consensus.cc:2243] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.240140 20705 raft_consensus.cc:2272] T bb24a436d0b64405b521ed6763a1c52a P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.243294 20705 tablet_replica.cc:333] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.243996 20705 raft_consensus.cc:2243] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.244652 20705 raft_consensus.cc:2272] T b2358003b8ee4a9db783bf49bc3467fb P 89d6e213407d46c39f5ae74948d8abea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.247618 20705 tablet_replica.cc:333] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.248306 20705 raft_consensus.cc:2243] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.248939 20705 raft_consensus.cc:2272] T 5cfc0db03fe544c59677c3bd19b1d476 P 89d6e213407d46c39f5ae74948d8abea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.252908 20705 tablet_replica.cc:333] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea: stopping tablet replica
I20260709 12:13:36.253569 20705 raft_consensus.cc:2243] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.254639 20705 raft_consensus.cc:2272] T 8bc8cab458b546498e660456894d1295 P 89d6e213407d46c39f5ae74948d8abea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.289301 20705 tablet_server.cc:196] TabletServer@127.20.56.66:0 shutdown complete.
I20260709 12:13:36.318104 20705 tablet_server.cc:179] TabletServer@127.20.56.67:0 shutting down...
I20260709 12:13:36.343556 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:36.344293 20705 tablet_replica.cc:333] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.345106 20705 raft_consensus.cc:2243] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.346362 20705 raft_consensus.cc:2272] T 2f252a21f63b4c6680524bbfff117ff6 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.349630 20705 tablet_replica.cc:333] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.350378 20705 raft_consensus.cc:2243] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:36.350384 29734 consensus_peers.cc:597] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd -> Peer 89d6e213407d46c39f5ae74948d8abea (127.20.56.66:34705): Couldn't send request to peer 89d6e213407d46c39f5ae74948d8abea. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:34705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.351157 20705 raft_consensus.cc:2272] T 1f2167548d8a47d2bf1635fb6a674f34 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.353488 20705 tablet_replica.cc:333] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.354065 20705 raft_consensus.cc:2243] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.354586 20705 raft_consensus.cc:2272] T 8bc8cab458b546498e660456894d1295 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.356925 20705 tablet_replica.cc:333] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.357479 20705 raft_consensus.cc:2243] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.358398 20705 raft_consensus.cc:2272] T cb7cafab58d14929846a2649a9074ca4 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.360502 20705 tablet_replica.cc:333] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.361006 20705 raft_consensus.cc:2243] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.361542 20705 raft_consensus.cc:2272] T 124fa3187e384bb1aa743eb25c7ef353 P b085b580e39741da9402d86991cffcfd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.363880 20705 tablet_replica.cc:333] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.364387 20705 raft_consensus.cc:2243] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.365371 20705 raft_consensus.cc:2272] T b2358003b8ee4a9db783bf49bc3467fb P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.368187 20705 tablet_replica.cc:333] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.368944 20705 raft_consensus.cc:2243] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:36.369447 20705 raft_consensus.cc:2272] T bb24a436d0b64405b521ed6763a1c52a P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.371865 20705 tablet_replica.cc:333] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.372432 20705 raft_consensus.cc:2243] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.373314 20705 raft_consensus.cc:2272] T 863ad85c3ff64fb38d4a221c10ee6186 P b085b580e39741da9402d86991cffcfd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.375857 20705 tablet_replica.cc:333] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.376372 20705 raft_consensus.cc:2243] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.377238 20705 raft_consensus.cc:2272] T e3ddd3202fef4a9ea16d74ad97f570c6 P b085b580e39741da9402d86991cffcfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.380112 20705 tablet_replica.cc:333] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd: stopping tablet replica
I20260709 12:13:36.380713 20705 raft_consensus.cc:2243] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.381668 20705 raft_consensus.cc:2272] T 5cfc0db03fe544c59677c3bd19b1d476 P b085b580e39741da9402d86991cffcfd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.416460 20705 tablet_server.cc:196] TabletServer@127.20.56.67:0 shutdown complete.
I20260709 12:13:36.443724 20705 master.cc:562] Master@127.20.56.126:41433 shutting down...
I20260709 12:13:36.467958 20705 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.468693 20705 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.469099 20705 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3e763c8d1951424d8ce73abf805ea859: stopping tablet replica
I20260709 12:13:36.489666 20705 master.cc:584] Master@127.20.56.126:41433 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13094 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:13:36.537061 20705 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.56.126:39227
I20260709 12:13:36.538256 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:36.544134 30087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.544191 30086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.544843 30089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.546196 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:36.547088 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:36.547268 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:36.547384 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599216547373 us; error 0 us; skew 500 ppm
I20260709 12:13:36.547866 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:36.550184 20705 webserver.cc:533] Webserver started at http://127.20.56.126:35371/ using document root <none> and password file <none>
I20260709 12:13:36.550755 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:36.550925 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:36.551137 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:36.552254 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/master-0-root/instance:
uuid: "218449f602274b5d9b3363128c8d5154"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-2dwh"
I20260709 12:13:36.557020 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:13:36.561125 30094 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.561961 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:36.562286 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/master-0-root
uuid: "218449f602274b5d9b3363128c8d5154"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-2dwh"
I20260709 12:13:36.562695 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:36.589430 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:36.590732 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:36.629257 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.126:39227
I20260709 12:13:36.629346 30145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.126:39227 every 8 connection(s)
I20260709 12:13:36.633605 30146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.645925 30146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154: Bootstrap starting.
I20260709 12:13:36.650863 30146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:36.655076 30146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154: No bootstrap required, opened a new log
I20260709 12:13:36.657266 30146 raft_consensus.cc:359] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218449f602274b5d9b3363128c8d5154" member_type: VOTER }
I20260709 12:13:36.657655 30146 raft_consensus.cc:385] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.657858 30146 raft_consensus.cc:740] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218449f602274b5d9b3363128c8d5154, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.658489 30146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218449f602274b5d9b3363128c8d5154" member_type: VOTER }
I20260709 12:13:36.658910 30146 raft_consensus.cc:399] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:36.659096 30146 raft_consensus.cc:493] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:36.659307 30146 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.664213 30146 raft_consensus.cc:515] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218449f602274b5d9b3363128c8d5154" member_type: VOTER }
I20260709 12:13:36.664880 30146 leader_election.cc:304] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 218449f602274b5d9b3363128c8d5154; no voters: 
I20260709 12:13:36.665980 30146 leader_election.cc:290] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:36.666404 30149 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:36.667853 30149 raft_consensus.cc:697] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 1 LEADER]: Becoming Leader. State: Replica: 218449f602274b5d9b3363128c8d5154, State: Running, Role: LEADER
I20260709 12:13:36.668588 30149 consensus_queue.cc:237] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218449f602274b5d9b3363128c8d5154" member_type: VOTER }
I20260709 12:13:36.669102 30146 sys_catalog.cc:565] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:36.673662 30150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "218449f602274b5d9b3363128c8d5154" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218449f602274b5d9b3363128c8d5154" member_type: VOTER } }
I20260709 12:13:36.673873 30151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 218449f602274b5d9b3363128c8d5154. Latest consensus state: current_term: 1 leader_uuid: "218449f602274b5d9b3363128c8d5154" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218449f602274b5d9b3363128c8d5154" member_type: VOTER } }
I20260709 12:13:36.674793 30150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:36.674783 30151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:36.680069 30156 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:36.685773 30156 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:36.686892 20705 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:36.694875 30156 catalog_manager.cc:1383] Generated new cluster ID: 871ddbe308154a3f82183a62d855e820
I20260709 12:13:36.695142 30156 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:36.712214 30156 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:36.713574 30156 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:36.730819 30156 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154: Generated new TSK 0
I20260709 12:13:36.731501 30156 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:36.754050 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:36.760569 30167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.761689 30168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.763154 20705 server_base.cc:1061] running on GCE node
W20260709 12:13:36.764215 30170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.765362 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:36.765570 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:36.765792 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599216765751 us; error 0 us; skew 500 ppm
I20260709 12:13:36.766389 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:36.768842 20705 webserver.cc:533] Webserver started at http://127.20.56.65:35163/ using document root <none> and password file <none>
I20260709 12:13:36.769333 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:36.769493 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:36.769816 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:36.771049 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-0-root/instance:
uuid: "d976a75af48045bfb6d7f7b5de53c7c9"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-2dwh"
I20260709 12:13:36.775504 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:36.778997 30175 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.779793 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:13:36.780112 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "d976a75af48045bfb6d7f7b5de53c7c9"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-2dwh"
I20260709 12:13:36.780366 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:36.797664 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:36.799005 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:36.800487 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:36.802850 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:36.803076 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.803344 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:36.803539 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.846536 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:40097
I20260709 12:13:36.846596 30237 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:40097 every 8 connection(s)
I20260709 12:13:36.851971 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:36.860605 30243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.860841 30242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.864391 30245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.864416 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:36.865458 30238 heartbeater.cc:344] Connected to a master server at 127.20.56.126:39227
I20260709 12:13:36.865935 30238 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:36.865948 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:36.866369 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:36.866621 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599216866603 us; error 0 us; skew 500 ppm
I20260709 12:13:36.867043 30238 heartbeater.cc:507] Master 127.20.56.126:39227 requested a full tablet report, sending...
I20260709 12:13:36.867254 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:36.869524 30111 ts_manager.cc:194] Registered new tserver with Master: d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65:40097)
I20260709 12:13:36.870136 20705 webserver.cc:533] Webserver started at http://127.20.56.66:34335/ using document root <none> and password file <none>
I20260709 12:13:36.870834 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:36.871074 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:36.871351 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:36.871929 30111 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40856
I20260709 12:13:36.872670 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-1-root/instance:
uuid: "dd2a1eff397c41d98a45167bfa78380f"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-2dwh"
I20260709 12:13:36.877365 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:13:36.880893 30250 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.881841 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:36.882180 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-1-root
uuid: "dd2a1eff397c41d98a45167bfa78380f"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-2dwh"
I20260709 12:13:36.882573 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:36.904047 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:36.905270 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:36.906903 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:36.909178 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:36.909389 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.909672 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:36.909840 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.950814 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.66:33955
I20260709 12:13:36.950908 30312 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.66:33955 every 8 connection(s)
I20260709 12:13:36.955830 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:36.964036 30316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.964515 30317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.967900 20705 server_base.cc:1061] running on GCE node
W20260709 12:13:36.968245 30320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.968721 30313 heartbeater.cc:344] Connected to a master server at 127.20.56.126:39227
I20260709 12:13:36.969245 30313 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:36.969498 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:36.969810 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:36.970000 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599216969983 us; error 0 us; skew 500 ppm
I20260709 12:13:36.970070 30313 heartbeater.cc:507] Master 127.20.56.126:39227 requested a full tablet report, sending...
I20260709 12:13:36.970757 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:36.972545 30111 ts_manager.cc:194] Registered new tserver with Master: dd2a1eff397c41d98a45167bfa78380f (127.20.56.66:33955)
I20260709 12:13:36.973773 20705 webserver.cc:533] Webserver started at http://127.20.56.67:43527/ using document root <none> and password file <none>
I20260709 12:13:36.974227 30111 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40868
I20260709 12:13:36.974359 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:36.974818 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:36.975099 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:36.976701 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-2-root/instance:
uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-2dwh"
I20260709 12:13:36.981772 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:13:36.985386 30324 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.986204 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:36.986569 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-2-root
uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-2dwh"
I20260709 12:13:36.986862 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895630772-20705-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:37.003424 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:37.004707 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:37.006299 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:37.008705 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:37.008888 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:37.009169 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:37.009393 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:37.049607 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.67:44183
I20260709 12:13:37.049710 30386 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.67:44183 every 8 connection(s)
I20260709 12:13:37.064363 30387 heartbeater.cc:344] Connected to a master server at 127.20.56.126:39227
I20260709 12:13:37.064838 30387 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:37.065568 30387 heartbeater.cc:507] Master 127.20.56.126:39227 requested a full tablet report, sending...
I20260709 12:13:37.067641 30111 ts_manager.cc:194] Registered new tserver with Master: 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183)
I20260709 12:13:37.068629 20705 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01583163s
I20260709 12:13:37.069021 30111 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40880
I20260709 12:13:37.094489 30111 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40882:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:37.096824 30111 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:37.172937 30203 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1f1e0fad054e4da676e09db8895db3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=88993055b0e347fa81c581399d803da1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:37.173202 30202 tablet_service.cc:1511] Processing CreateTablet for tablet 7e738e735d164ba1b2a86978d41f989a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=88993055b0e347fa81c581399d803da1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:37.174527 30203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1f1e0fad054e4da676e09db8895db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.174352 30352 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1f1e0fad054e4da676e09db8895db3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=88993055b0e347fa81c581399d803da1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:37.175829 30352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1f1e0fad054e4da676e09db8895db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.175652 30351 tablet_service.cc:1511] Processing CreateTablet for tablet 7e738e735d164ba1b2a86978d41f989a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=88993055b0e347fa81c581399d803da1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:37.177039 30351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e738e735d164ba1b2a86978d41f989a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.178567 30278 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1f1e0fad054e4da676e09db8895db3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=88993055b0e347fa81c581399d803da1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:37.179009 30202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e738e735d164ba1b2a86978d41f989a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.180073 30278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1f1e0fad054e4da676e09db8895db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.178608 30277 tablet_service.cc:1511] Processing CreateTablet for tablet 7e738e735d164ba1b2a86978d41f989a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=88993055b0e347fa81c581399d803da1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:37.188024 30277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e738e735d164ba1b2a86978d41f989a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.200891 30402 tablet_bootstrap.cc:492] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9: Bootstrap starting.
I20260709 12:13:37.213173 30403 tablet_bootstrap.cc:492] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae: Bootstrap starting.
I20260709 12:13:37.213886 30402 tablet_bootstrap.cc:654] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.221725 30403 tablet_bootstrap.cc:654] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.224277 30405 tablet_bootstrap.cc:492] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f: Bootstrap starting.
I20260709 12:13:37.225136 30402 tablet_bootstrap.cc:492] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9: No bootstrap required, opened a new log
I20260709 12:13:37.225900 30402 ts_tablet_manager.cc:1403] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 12:13:37.229143 30402 raft_consensus.cc:359] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } }
I20260709 12:13:37.229898 30402 raft_consensus.cc:385] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.230213 30402 raft_consensus.cc:740] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d976a75af48045bfb6d7f7b5de53c7c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.231072 30402 consensus_queue.cc:260] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } }
I20260709 12:13:37.231995 30405 tablet_bootstrap.cc:654] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.233582 30238 heartbeater.cc:499] Master 127.20.56.126:39227 was elected leader, sending a full tablet report...
I20260709 12:13:37.234179 30402 ts_tablet_manager.cc:1434] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:13:37.235272 30402 tablet_bootstrap.cc:492] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9: Bootstrap starting.
I20260709 12:13:37.236748 30403 tablet_bootstrap.cc:492] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae: No bootstrap required, opened a new log
I20260709 12:13:37.237329 30403 ts_tablet_manager.cc:1403] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 12:13:37.240440 30403 raft_consensus.cc:359] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.241219 30403 raft_consensus.cc:385] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.241568 30403 raft_consensus.cc:740] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28dd2e277d5c40c6a00fb28d6a3405ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.242355 30403 consensus_queue.cc:260] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.244418 30402 tablet_bootstrap.cc:654] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.251341 30405 tablet_bootstrap.cc:492] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f: No bootstrap required, opened a new log
I20260709 12:13:37.251864 30405 ts_tablet_manager.cc:1403] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.008s
I20260709 12:13:37.252326 30402 tablet_bootstrap.cc:492] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9: No bootstrap required, opened a new log
I20260709 12:13:37.252882 30402 ts_tablet_manager.cc:1403] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 12:13:37.254859 30405 raft_consensus.cc:359] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } }
I20260709 12:13:37.255621 30387 heartbeater.cc:499] Master 127.20.56.126:39227 was elected leader, sending a full tablet report...
I20260709 12:13:37.255676 30405 raft_consensus.cc:385] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.255812 30402 raft_consensus.cc:359] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.256373 30403 ts_tablet_manager.cc:1434] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:13:37.256392 30405 raft_consensus.cc:740] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2a1eff397c41d98a45167bfa78380f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.256771 30402 raft_consensus.cc:385] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.257239 30402 raft_consensus.cc:740] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d976a75af48045bfb6d7f7b5de53c7c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.257869 30403 tablet_bootstrap.cc:492] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae: Bootstrap starting.
I20260709 12:13:37.258155 30402 consensus_queue.cc:260] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.258244 30405 consensus_queue.cc:260] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } }
I20260709 12:13:37.264192 30402 ts_tablet_manager.cc:1434] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:37.265489 30403 tablet_bootstrap.cc:654] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.266387 30313 heartbeater.cc:499] Master 127.20.56.126:39227 was elected leader, sending a full tablet report...
I20260709 12:13:37.266973 30405 ts_tablet_manager.cc:1434] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.005s
I20260709 12:13:37.268831 30405 tablet_bootstrap.cc:492] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f: Bootstrap starting.
I20260709 12:13:37.275733 30405 tablet_bootstrap.cc:654] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.280460 30403 tablet_bootstrap.cc:492] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae: No bootstrap required, opened a new log
I20260709 12:13:37.281023 30403 ts_tablet_manager.cc:1403] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 12:13:37.281415 30405 tablet_bootstrap.cc:492] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f: No bootstrap required, opened a new log
I20260709 12:13:37.282001 30405 ts_tablet_manager.cc:1403] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 12:13:37.284088 30403 raft_consensus.cc:359] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } }
I20260709 12:13:37.284874 30403 raft_consensus.cc:385] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.285203 30403 raft_consensus.cc:740] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28dd2e277d5c40c6a00fb28d6a3405ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.285053 30405 raft_consensus.cc:359] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.285902 30405 raft_consensus.cc:385] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.286231 30405 raft_consensus.cc:740] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2a1eff397c41d98a45167bfa78380f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.286077 30403 consensus_queue.cc:260] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } }
I20260709 12:13:37.287292 30405 consensus_queue.cc:260] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.288596 30403 ts_tablet_manager.cc:1434] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:37.289845 30405 ts_tablet_manager.cc:1434] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:13:37.570927 30411 raft_consensus.cc:493] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.571400 30411 raft_consensus.cc:515] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.573486 30411 leader_election.cc:290] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65:40097), 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183)
I20260709 12:13:37.584352 30213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e738e735d164ba1b2a86978d41f989a" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" is_pre_election: true
I20260709 12:13:37.585104 30213 raft_consensus.cc:2468] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 0.
I20260709 12:13:37.585378 30362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e738e735d164ba1b2a86978d41f989a" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" is_pre_election: true
I20260709 12:13:37.586134 30362 raft_consensus.cc:2468] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 0.
I20260709 12:13:37.586597 30252 leader_election.cc:304] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d976a75af48045bfb6d7f7b5de53c7c9, dd2a1eff397c41d98a45167bfa78380f; no voters: 
I20260709 12:13:37.587535 30411 raft_consensus.cc:2804] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.587805 30411 raft_consensus.cc:493] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.588013 30411 raft_consensus.cc:3060] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.593595 30411 raft_consensus.cc:515] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.594823 30407 raft_consensus.cc:493] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.595391 30407 raft_consensus.cc:515] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } }
I20260709 12:13:37.595412 30411 leader_election.cc:290] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 1 election: Requested vote from peers d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65:40097), 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183)
I20260709 12:13:37.596194 30213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e738e735d164ba1b2a86978d41f989a" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d976a75af48045bfb6d7f7b5de53c7c9"
I20260709 12:13:37.596866 30213 raft_consensus.cc:3060] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.597074 30362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e738e735d164ba1b2a86978d41f989a" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
I20260709 12:13:37.597782 30362 raft_consensus.cc:3060] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.598778 30407 leader_election.cc:290] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183), dd2a1eff397c41d98a45167bfa78380f (127.20.56.66:33955)
I20260709 12:13:37.606863 30213 raft_consensus.cc:2468] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 1.
I20260709 12:13:37.608286 30252 leader_election.cc:304] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d976a75af48045bfb6d7f7b5de53c7c9, dd2a1eff397c41d98a45167bfa78380f; no voters: 
I20260709 12:13:37.609089 30411 raft_consensus.cc:2804] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.607167 30362 raft_consensus.cc:2468] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 1.
I20260709 12:13:37.611716 30411 raft_consensus.cc:697] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Becoming Leader. State: Replica: dd2a1eff397c41d98a45167bfa78380f, State: Running, Role: LEADER
I20260709 12:13:37.612753 30411 consensus_queue.cc:237] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.615245 30362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f1e0fad054e4da676e09db8895db3" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" is_pre_election: true
I20260709 12:13:37.616065 30362 raft_consensus.cc:2468] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d976a75af48045bfb6d7f7b5de53c7c9 in term 0.
I20260709 12:13:37.617820 30179 leader_election.cc:304] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28dd2e277d5c40c6a00fb28d6a3405ae, d976a75af48045bfb6d7f7b5de53c7c9; no voters: 
I20260709 12:13:37.618686 30407 raft_consensus.cc:2804] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.619151 30407 raft_consensus.cc:493] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.619583 30407 raft_consensus.cc:3060] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.621629 30288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f1e0fad054e4da676e09db8895db3" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2a1eff397c41d98a45167bfa78380f" is_pre_election: true
I20260709 12:13:37.622448 30288 raft_consensus.cc:2468] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d976a75af48045bfb6d7f7b5de53c7c9 in term 0.
I20260709 12:13:37.622123 30110 catalog_manager.cc:5697] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f reported cstate change: term changed from 0 to 1, leader changed from <none> to dd2a1eff397c41d98a45167bfa78380f (127.20.56.66). New cstate: current_term: 1 leader_uuid: "dd2a1eff397c41d98a45167bfa78380f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.626579 30407 raft_consensus.cc:515] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } }
I20260709 12:13:37.628631 30407 leader_election.cc:290] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 1 election: Requested vote from peers 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183), dd2a1eff397c41d98a45167bfa78380f (127.20.56.66:33955)
I20260709 12:13:37.629638 30362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f1e0fad054e4da676e09db8895db3" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
I20260709 12:13:37.629987 30288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f1e0fad054e4da676e09db8895db3" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2a1eff397c41d98a45167bfa78380f"
I20260709 12:13:37.630216 30362 raft_consensus.cc:3060] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.630786 30288 raft_consensus.cc:3060] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.636227 30362 raft_consensus.cc:2468] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d976a75af48045bfb6d7f7b5de53c7c9 in term 1.
I20260709 12:13:37.637641 30179 leader_election.cc:304] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28dd2e277d5c40c6a00fb28d6a3405ae, d976a75af48045bfb6d7f7b5de53c7c9; no voters: 
I20260709 12:13:37.638612 30407 raft_consensus.cc:2804] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.639998 30288 raft_consensus.cc:2468] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d976a75af48045bfb6d7f7b5de53c7c9 in term 1.
I20260709 12:13:37.639992 30407 raft_consensus.cc:697] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 LEADER]: Becoming Leader. State: Replica: d976a75af48045bfb6d7f7b5de53c7c9, State: Running, Role: LEADER
I20260709 12:13:37.641256 30407 consensus_queue.cc:237] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } }
I20260709 12:13:37.648434 30110 catalog_manager.cc:5697] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.682192 30110 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40890:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:37.684381 30110 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:37.709528 30202 tablet_service.cc:1511] Processing CreateTablet for tablet a68b77bb85ed47eb92544e56e391d194 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c4b9e84ecc5a496381bedf564851c5df]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:37.710903 30202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a68b77bb85ed47eb92544e56e391d194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.710985 30278 tablet_service.cc:1511] Processing CreateTablet for tablet a68b77bb85ed47eb92544e56e391d194 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c4b9e84ecc5a496381bedf564851c5df]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:37.712373 30278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a68b77bb85ed47eb92544e56e391d194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.712469 30352 tablet_service.cc:1511] Processing CreateTablet for tablet a68b77bb85ed47eb92544e56e391d194 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c4b9e84ecc5a496381bedf564851c5df]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:37.713773 30352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a68b77bb85ed47eb92544e56e391d194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.717641 30351 tablet_service.cc:1511] Processing CreateTablet for tablet a487d45b4f134d10b81d6d6755444e2e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c4b9e84ecc5a496381bedf564851c5df]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:37.717914 30203 tablet_service.cc:1511] Processing CreateTablet for tablet a487d45b4f134d10b81d6d6755444e2e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c4b9e84ecc5a496381bedf564851c5df]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:37.719267 30203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a487d45b4f134d10b81d6d6755444e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.720237 30277 tablet_service.cc:1511] Processing CreateTablet for tablet a487d45b4f134d10b81d6d6755444e2e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c4b9e84ecc5a496381bedf564851c5df]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:37.721467 30277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a487d45b4f134d10b81d6d6755444e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.722998 30351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a487d45b4f134d10b81d6d6755444e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.729048 30402 tablet_bootstrap.cc:492] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9: Bootstrap starting.
I20260709 12:13:37.731539 30405 tablet_bootstrap.cc:492] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f: Bootstrap starting.
I20260709 12:13:37.735436 30402 tablet_bootstrap.cc:654] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.739612 30405 tablet_bootstrap.cc:654] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.748601 30403 tablet_bootstrap.cc:492] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae: Bootstrap starting.
I20260709 12:13:37.749925 30405 tablet_bootstrap.cc:492] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f: No bootstrap required, opened a new log
I20260709 12:13:37.750501 30405 ts_tablet_manager.cc:1403] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.001s
I20260709 12:13:37.754439 30402 tablet_bootstrap.cc:492] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9: No bootstrap required, opened a new log
I20260709 12:13:37.755096 30402 ts_tablet_manager.cc:1403] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.005s
I20260709 12:13:37.754858 30405 raft_consensus.cc:359] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.755688 30405 raft_consensus.cc:385] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.755992 30405 raft_consensus.cc:740] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2a1eff397c41d98a45167bfa78380f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.756554 30403 tablet_bootstrap.cc:654] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.758347 30405 consensus_queue.cc:260] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.758430 30402 raft_consensus.cc:359] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.765856 30402 raft_consensus.cc:385] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.766222 30402 raft_consensus.cc:740] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d976a75af48045bfb6d7f7b5de53c7c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.767148 30405 ts_tablet_manager.cc:1434] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:13:37.768361 30405 tablet_bootstrap.cc:492] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f: Bootstrap starting.
I20260709 12:13:37.768155 30402 consensus_queue.cc:260] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.769642 30403 tablet_bootstrap.cc:492] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae: No bootstrap required, opened a new log
I20260709 12:13:37.770303 30403 ts_tablet_manager.cc:1403] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:13:37.770624 30402 ts_tablet_manager.cc:1434] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:13:37.771826 30402 tablet_bootstrap.cc:492] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9: Bootstrap starting.
I20260709 12:13:37.778337 30405 tablet_bootstrap.cc:654] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.780583 30403 raft_consensus.cc:359] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.781426 30403 raft_consensus.cc:385] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.778337 30402 tablet_bootstrap.cc:654] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.781934 30403 raft_consensus.cc:740] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28dd2e277d5c40c6a00fb28d6a3405ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.782951 30403 consensus_queue.cc:260] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.784847 30405 tablet_bootstrap.cc:492] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f: No bootstrap required, opened a new log
I20260709 12:13:37.785465 30405 ts_tablet_manager.cc:1403] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:13:37.787882 30403 ts_tablet_manager.cc:1434] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:13:37.789347 30403 tablet_bootstrap.cc:492] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae: Bootstrap starting.
I20260709 12:13:37.789080 30405 raft_consensus.cc:359] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.790076 30405 raft_consensus.cc:385] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.790467 30405 raft_consensus.cc:740] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2a1eff397c41d98a45167bfa78380f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.791342 30405 consensus_queue.cc:260] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.793793 30405 ts_tablet_manager.cc:1434] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:37.797254 30402 tablet_bootstrap.cc:492] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9: No bootstrap required, opened a new log
I20260709 12:13:37.797511 30403 tablet_bootstrap.cc:654] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.797816 30402 ts_tablet_manager.cc:1403] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:13:37.801213 30402 raft_consensus.cc:359] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.801975 30402 raft_consensus.cc:385] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.802264 30402 raft_consensus.cc:740] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d976a75af48045bfb6d7f7b5de53c7c9, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.803159 30403 tablet_bootstrap.cc:492] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae: No bootstrap required, opened a new log
I20260709 12:13:37.802995 30402 consensus_queue.cc:260] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.803702 30403 ts_tablet_manager.cc:1403] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:13:37.806793 30402 ts_tablet_manager.cc:1434] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:13:37.806900 30403 raft_consensus.cc:359] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.807709 30403 raft_consensus.cc:385] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.807991 30403 raft_consensus.cc:740] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28dd2e277d5c40c6a00fb28d6a3405ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.808769 30403 consensus_queue.cc:260] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.811115 30403 ts_tablet_manager.cc:1434] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:13:37.909250 30407 raft_consensus.cc:493] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.909845 30407 raft_consensus.cc:515] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.911747 30407 leader_election.cc:290] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd2a1eff397c41d98a45167bfa78380f (127.20.56.66:33955), 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183)
I20260709 12:13:37.912478 30288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a487d45b4f134d10b81d6d6755444e2e" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2a1eff397c41d98a45167bfa78380f" is_pre_election: true
I20260709 12:13:37.912750 30362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a487d45b4f134d10b81d6d6755444e2e" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" is_pre_election: true
I20260709 12:13:37.913110 30288 raft_consensus.cc:2468] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d976a75af48045bfb6d7f7b5de53c7c9 in term 0.
I20260709 12:13:37.913398 30362 raft_consensus.cc:2468] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d976a75af48045bfb6d7f7b5de53c7c9 in term 0.
I20260709 12:13:37.914346 30178 leader_election.cc:304] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d976a75af48045bfb6d7f7b5de53c7c9, dd2a1eff397c41d98a45167bfa78380f; no voters: 
I20260709 12:13:37.915109 30407 raft_consensus.cc:2804] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.915457 30407 raft_consensus.cc:493] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.915691 30407 raft_consensus.cc:3060] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.920732 30407 raft_consensus.cc:515] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.922492 30407 leader_election.cc:290] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 1 election: Requested vote from peers dd2a1eff397c41d98a45167bfa78380f (127.20.56.66:33955), 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183)
I20260709 12:13:37.923207 30288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a487d45b4f134d10b81d6d6755444e2e" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2a1eff397c41d98a45167bfa78380f"
I20260709 12:13:37.923520 30362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a487d45b4f134d10b81d6d6755444e2e" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
I20260709 12:13:37.923775 30288 raft_consensus.cc:3060] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.924146 30362 raft_consensus.cc:3060] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.929636 30288 raft_consensus.cc:2468] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d976a75af48045bfb6d7f7b5de53c7c9 in term 1.
I20260709 12:13:37.929869 30362 raft_consensus.cc:2468] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d976a75af48045bfb6d7f7b5de53c7c9 in term 1.
I20260709 12:13:37.930896 30178 leader_election.cc:304] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d976a75af48045bfb6d7f7b5de53c7c9, dd2a1eff397c41d98a45167bfa78380f; no voters: 
I20260709 12:13:37.931679 30407 raft_consensus.cc:2804] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.932161 30407 raft_consensus.cc:697] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 LEADER]: Becoming Leader. State: Replica: d976a75af48045bfb6d7f7b5de53c7c9, State: Running, Role: LEADER
I20260709 12:13:37.933007 30407 consensus_queue.cc:237] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.939580 30110 catalog_manager.cc:5697] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.987565 30411 raft_consensus.cc:493] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.988171 30411 raft_consensus.cc:515] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:37.990077 30411 leader_election.cc:290] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65:40097), 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183)
I20260709 12:13:37.990900 30213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" is_pre_election: true
I20260709 12:13:37.991124 30362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" is_pre_election: true
I20260709 12:13:37.991528 30213 raft_consensus.cc:2468] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 0.
I20260709 12:13:37.991801 30362 raft_consensus.cc:2468] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 0.
I20260709 12:13:37.992691 30252 leader_election.cc:304] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d976a75af48045bfb6d7f7b5de53c7c9, dd2a1eff397c41d98a45167bfa78380f; no voters: 
I20260709 12:13:37.993382 30411 raft_consensus.cc:2804] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.993757 30411 raft_consensus.cc:493] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.994046 30411 raft_consensus.cc:3060] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.999081 30411 raft_consensus.cc:515] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.000761 30411 leader_election.cc:290] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 1 election: Requested vote from peers d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65:40097), 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183)
I20260709 12:13:38.001622 30213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d976a75af48045bfb6d7f7b5de53c7c9"
I20260709 12:13:38.001802 30362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
I20260709 12:13:38.002326 30362 raft_consensus.cc:3060] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:38.002333 30213 raft_consensus.cc:3060] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:38.010046 30213 raft_consensus.cc:2468] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 1.
I20260709 12:13:38.010371 30362 raft_consensus.cc:2468] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 1.
I20260709 12:13:38.011415 30252 leader_election.cc:304] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d976a75af48045bfb6d7f7b5de53c7c9, dd2a1eff397c41d98a45167bfa78380f; no voters: 
I20260709 12:13:38.012202 30411 raft_consensus.cc:2804] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:38.012635 30411 raft_consensus.cc:697] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Becoming Leader. State: Replica: dd2a1eff397c41d98a45167bfa78380f, State: Running, Role: LEADER
I20260709 12:13:38.013440 30411 consensus_queue.cc:237] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.020375 30411 consensus_queue.cc:1048] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.020736 30110 catalog_manager.cc:5697] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f reported cstate change: term changed from 0 to 1, leader changed from <none> to dd2a1eff397c41d98a45167bfa78380f (127.20.56.66). New cstate: current_term: 1 leader_uuid: "dd2a1eff397c41d98a45167bfa78380f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.037669 30442 consensus_queue.cc:1048] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [LEADER]: Connected to new peer: Peer: permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:38.102679 30288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e738e735d164ba1b2a86978d41f989a"
dest_uuid: "dd2a1eff397c41d98a45167bfa78380f"
mode: GRACEFUL
new_leader_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
 from {username='slave'} at 127.0.0.1:41192
I20260709 12:13:38.103315 30288 raft_consensus.cc:606] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Received request to transfer leadership to TS 28dd2e277d5c40c6a00fb28d6a3405ae
I20260709 12:13:38.109222 30288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194"
dest_uuid: "dd2a1eff397c41d98a45167bfa78380f"
mode: GRACEFUL
new_leader_uuid: "d976a75af48045bfb6d7f7b5de53c7c9"
 from {username='slave'} at 127.0.0.1:41192
I20260709 12:13:38.109782 30288 raft_consensus.cc:606] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Received request to transfer leadership to TS d976a75af48045bfb6d7f7b5de53c7c9
I20260709 12:13:38.155920 30407 consensus_queue.cc:1048] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.167692 30423 consensus_queue.cc:1048] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:38.402926 30418 consensus_queue.cc:1048] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.410390 30444 raft_consensus.cc:993] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f: : Instructing follower d976a75af48045bfb6d7f7b5de53c7c9 to start an election
I20260709 12:13:38.410919 30444 raft_consensus.cc:1081] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Signalling peer d976a75af48045bfb6d7f7b5de53c7c9 to start an election
I20260709 12:13:38.415558 30444 consensus_queue.cc:1048] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [LEADER]: Connected to new peer: Peer: permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.415866 30212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194"
dest_uuid: "d976a75af48045bfb6d7f7b5de53c7c9"
 from {username='slave'} at 127.0.0.1:41030
I20260709 12:13:38.416716 30212 raft_consensus.cc:493] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.417093 30212 raft_consensus.cc:3060] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.424687 30212 raft_consensus.cc:515] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.428894 30288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2a1eff397c41d98a45167bfa78380f"
I20260709 12:13:38.429529 30288 raft_consensus.cc:3055] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.429628 30212 leader_election.cc:290] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 2 election: Requested vote from peers dd2a1eff397c41d98a45167bfa78380f (127.20.56.66:33955), 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183)
I20260709 12:13:38.429934 30288 raft_consensus.cc:740] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd2a1eff397c41d98a45167bfa78380f, State: Running, Role: LEADER
I20260709 12:13:38.430356 30361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194" candidate_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
I20260709 12:13:38.430929 30288 consensus_queue.cc:260] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.432168 30288 raft_consensus.cc:3060] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.438959 30288 raft_consensus.cc:2468] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d976a75af48045bfb6d7f7b5de53c7c9 in term 2.
I20260709 12:13:38.440074 30178 leader_election.cc:304] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d976a75af48045bfb6d7f7b5de53c7c9, dd2a1eff397c41d98a45167bfa78380f; no voters: 28dd2e277d5c40c6a00fb28d6a3405ae
I20260709 12:13:38.440876 30423 raft_consensus.cc:2804] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.441349 30423 raft_consensus.cc:697] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 LEADER]: Becoming Leader. State: Replica: d976a75af48045bfb6d7f7b5de53c7c9, State: Running, Role: LEADER
I20260709 12:13:38.442054 30423 consensus_queue.cc:237] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.448442 30108 catalog_manager.cc:5697] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 reported cstate change: term changed from 1 to 2, leader changed from dd2a1eff397c41d98a45167bfa78380f (127.20.56.66) to d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.459062 30444 raft_consensus.cc:993] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f: : Instructing follower 28dd2e277d5c40c6a00fb28d6a3405ae to start an election
I20260709 12:13:38.459553 30418 raft_consensus.cc:1081] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Signalling peer 28dd2e277d5c40c6a00fb28d6a3405ae to start an election
I20260709 12:13:38.461165 30362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e738e735d164ba1b2a86978d41f989a"
dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
 from {username='slave'} at 127.0.0.1:35726
I20260709 12:13:38.461685 30362 raft_consensus.cc:493] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.462041 30362 raft_consensus.cc:3060] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.467486 30362 raft_consensus.cc:515] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.469452 30362 leader_election.cc:290] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [CANDIDATE]: Term 2 election: Requested vote from peers d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65:40097), dd2a1eff397c41d98a45167bfa78380f (127.20.56.66:33955)
I20260709 12:13:38.482784 30212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e738e735d164ba1b2a86978d41f989a" candidate_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d976a75af48045bfb6d7f7b5de53c7c9"
I20260709 12:13:38.482767 30288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e738e735d164ba1b2a86978d41f989a" candidate_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2a1eff397c41d98a45167bfa78380f"
I20260709 12:13:38.483609 30212 raft_consensus.cc:3060] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.483629 30288 raft_consensus.cc:3055] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.484180 30288 raft_consensus.cc:740] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd2a1eff397c41d98a45167bfa78380f, State: Running, Role: LEADER
I20260709 12:13:38.485090 30288 consensus_queue.cc:260] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.486455 30288 raft_consensus.cc:3060] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.491524 30212 raft_consensus.cc:2468] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28dd2e277d5c40c6a00fb28d6a3405ae in term 2.
I20260709 12:13:38.492936 30326 leader_election.cc:304] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28dd2e277d5c40c6a00fb28d6a3405ae, d976a75af48045bfb6d7f7b5de53c7c9; no voters: 
I20260709 12:13:38.493517 30288 raft_consensus.cc:2468] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28dd2e277d5c40c6a00fb28d6a3405ae in term 2.
I20260709 12:13:38.493840 30409 raft_consensus.cc:2804] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.495167 30409 raft_consensus.cc:697] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 2 LEADER]: Becoming Leader. State: Replica: 28dd2e277d5c40c6a00fb28d6a3405ae, State: Running, Role: LEADER
I20260709 12:13:38.495862 30409 consensus_queue.cc:237] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.502591 30108 catalog_manager.cc:5697] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae reported cstate change: term changed from 1 to 2, leader changed from dd2a1eff397c41d98a45167bfa78380f (127.20.56.66) to 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67). New cstate: current_term: 2 leader_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.508266 30423 consensus_queue.cc:1048] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:38.515661 30407 consensus_queue.cc:1048] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.564043 20705 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:13:38.565611 20705 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:13:38.565937 20705 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:13:38.578672 30212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194"
dest_uuid: "d976a75af48045bfb6d7f7b5de53c7c9"
mode: GRACEFUL
new_leader_uuid: "dd2a1eff397c41d98a45167bfa78380f"
 from {username='slave'} at 127.0.0.1:41052
I20260709 12:13:38.579152 30212 raft_consensus.cc:606] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 LEADER]: Received request to transfer leadership to TS dd2a1eff397c41d98a45167bfa78380f
I20260709 12:13:38.580194 20705 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:13:38.862634 30362 raft_consensus.cc:3060] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.868376 30362 raft_consensus.cc:1275] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 2 FOLLOWER]: Refusing update from remote peer d976a75af48045bfb6d7f7b5de53c7c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:38.869730 30457 consensus_queue.cc:1048] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.878005 30288 raft_consensus.cc:1275] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 2 FOLLOWER]: Refusing update from remote peer d976a75af48045bfb6d7f7b5de53c7c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:38.879520 30457 consensus_queue.cc:1048] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.887349 30423 raft_consensus.cc:993] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9: : Instructing follower dd2a1eff397c41d98a45167bfa78380f to start an election
I20260709 12:13:38.887814 30457 raft_consensus.cc:1081] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 LEADER]: Signalling peer dd2a1eff397c41d98a45167bfa78380f to start an election
I20260709 12:13:38.889483 30288 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194"
dest_uuid: "dd2a1eff397c41d98a45167bfa78380f"
 from {username='slave'} at 127.0.0.1:41190
I20260709 12:13:38.890087 30288 raft_consensus.cc:493] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.890383 30288 raft_consensus.cc:3060] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.895331 30288 raft_consensus.cc:515] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.897460 30288 leader_election.cc:290] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 3 election: Requested vote from peers d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65:40097), 28dd2e277d5c40c6a00fb28d6a3405ae (127.20.56.67:44183)
I20260709 12:13:38.897866 30212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d976a75af48045bfb6d7f7b5de53c7c9"
I20260709 12:13:38.898074 30362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68b77bb85ed47eb92544e56e391d194" candidate_uuid: "dd2a1eff397c41d98a45167bfa78380f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae"
I20260709 12:13:38.898568 30212 raft_consensus.cc:3055] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.898751 30362 raft_consensus.cc:3060] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.898962 30212 raft_consensus.cc:740] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d976a75af48045bfb6d7f7b5de53c7c9, State: Running, Role: LEADER
I20260709 12:13:38.899873 30212 consensus_queue.cc:260] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.900880 30212 raft_consensus.cc:3060] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.904907 30362 raft_consensus.cc:2468] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 3.
I20260709 12:13:38.906183 30254 leader_election.cc:304] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28dd2e277d5c40c6a00fb28d6a3405ae, dd2a1eff397c41d98a45167bfa78380f; no voters: 
I20260709 12:13:38.906358 30212 raft_consensus.cc:2468] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2a1eff397c41d98a45167bfa78380f in term 3.
I20260709 12:13:38.906993 30418 raft_consensus.cc:2804] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:38.907466 30418 raft_consensus.cc:697] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 3 LEADER]: Becoming Leader. State: Replica: dd2a1eff397c41d98a45167bfa78380f, State: Running, Role: LEADER
I20260709 12:13:38.908257 30418 consensus_queue.cc:237] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } }
I20260709 12:13:38.914462 30110 catalog_manager.cc:5697] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f reported cstate change: term changed from 2 to 3, leader changed from d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65) to dd2a1eff397c41d98a45167bfa78380f (127.20.56.66). New cstate: current_term: 3 leader_uuid: "dd2a1eff397c41d98a45167bfa78380f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d976a75af48045bfb6d7f7b5de53c7c9" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 40097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2a1eff397c41d98a45167bfa78380f" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28dd2e277d5c40c6a00fb28d6a3405ae" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 44183 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.930130 20705 tablet_server.cc:179] TabletServer@127.20.56.65:0 shutting down...
I20260709 12:13:38.950560 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:38.951313 20705 tablet_replica.cc:333] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9: stopping tablet replica
W20260709 12:13:38.951396 30326 consensus_peers.cc:597] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae -> Peer d976a75af48045bfb6d7f7b5de53c7c9 (127.20.56.65:40097): Couldn't send request to peer d976a75af48045bfb6d7f7b5de53c7c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:38.952098 20705 raft_consensus.cc:2243] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:38.952869 20705 raft_consensus.cc:2272] T a487d45b4f134d10b81d6d6755444e2e P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.955348 20705 tablet_replica.cc:333] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9: stopping tablet replica
I20260709 12:13:38.955839 20705 raft_consensus.cc:2243] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.956207 20705 raft_consensus.cc:2272] T a68b77bb85ed47eb92544e56e391d194 P d976a75af48045bfb6d7f7b5de53c7c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.958705 20705 tablet_replica.cc:333] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9: stopping tablet replica
I20260709 12:13:38.959218 20705 raft_consensus.cc:2243] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.959635 20705 raft_consensus.cc:2272] T 7e738e735d164ba1b2a86978d41f989a P d976a75af48045bfb6d7f7b5de53c7c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.962013 20705 tablet_replica.cc:333] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9: stopping tablet replica
I20260709 12:13:38.962604 20705 raft_consensus.cc:2243] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:38.963436 20705 raft_consensus.cc:2272] T 0f1f1e0fad054e4da676e09db8895db3 P d976a75af48045bfb6d7f7b5de53c7c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.977248 20705 tablet_server.cc:196] TabletServer@127.20.56.65:0 shutdown complete.
I20260709 12:13:38.989892 20705 tablet_server.cc:179] TabletServer@127.20.56.66:0 shutting down...
I20260709 12:13:39.008605 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:39.009233 20705 tablet_replica.cc:333] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f: stopping tablet replica
I20260709 12:13:39.009799 20705 raft_consensus.cc:2243] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.010222 20705 raft_consensus.cc:2272] T a487d45b4f134d10b81d6d6755444e2e P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.012717 20705 tablet_replica.cc:333] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f: stopping tablet replica
I20260709 12:13:39.013266 20705 raft_consensus.cc:2243] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:39.013899 20705 pending_rounds.cc:70] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f: Trying to abort 1 pending ops.
I20260709 12:13:39.014122 20705 pending_rounds.cc:77] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305622400655843328 op_type: NO_OP noop_request { }
I20260709 12:13:39.014632 20705 raft_consensus.cc:2889] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:39.015055 20705 raft_consensus.cc:2272] T a68b77bb85ed47eb92544e56e391d194 P dd2a1eff397c41d98a45167bfa78380f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.017882 20705 tablet_replica.cc:333] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f: stopping tablet replica
I20260709 12:13:39.018599 20705 raft_consensus.cc:2243] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.019059 20705 raft_consensus.cc:2272] T 7e738e735d164ba1b2a86978d41f989a P dd2a1eff397c41d98a45167bfa78380f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.021431 20705 tablet_replica.cc:333] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f: stopping tablet replica
I20260709 12:13:39.021978 20705 raft_consensus.cc:2243] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.022504 20705 raft_consensus.cc:2272] T 0f1f1e0fad054e4da676e09db8895db3 P dd2a1eff397c41d98a45167bfa78380f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.036202 20705 tablet_server.cc:196] TabletServer@127.20.56.66:0 shutdown complete.
I20260709 12:13:39.048134 20705 tablet_server.cc:179] TabletServer@127.20.56.67:0 shutting down...
W20260709 12:13:39.061306 30327 consensus_peers.cc:597] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae -> Peer dd2a1eff397c41d98a45167bfa78380f (127.20.56.66:33955): Couldn't send request to peer dd2a1eff397c41d98a45167bfa78380f. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:33955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:39.069589 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:39.070384 20705 tablet_replica.cc:333] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae: stopping tablet replica
I20260709 12:13:39.071036 20705 raft_consensus.cc:2243] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.071506 20705 raft_consensus.cc:2272] T a487d45b4f134d10b81d6d6755444e2e P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.073699 20705 tablet_replica.cc:333] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae: stopping tablet replica
I20260709 12:13:39.074229 20705 raft_consensus.cc:2243] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.074695 20705 raft_consensus.cc:2272] T a68b77bb85ed47eb92544e56e391d194 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.077294 20705 tablet_replica.cc:333] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae: stopping tablet replica
I20260709 12:13:39.077819 20705 raft_consensus.cc:2243] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.078238 20705 raft_consensus.cc:2272] T 0f1f1e0fad054e4da676e09db8895db3 P 28dd2e277d5c40c6a00fb28d6a3405ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.080773 20705 tablet_replica.cc:333] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae: stopping tablet replica
I20260709 12:13:39.081254 20705 raft_consensus.cc:2243] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:39.081998 20705 pending_rounds.cc:70] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae: Trying to abort 1 pending ops.
I20260709 12:13:39.082213 20705 pending_rounds.cc:77] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622398967123968 op_type: NO_OP noop_request { }
I20260709 12:13:39.082520 20705 raft_consensus.cc:2889] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:39.082810 20705 raft_consensus.cc:2272] T 7e738e735d164ba1b2a86978d41f989a P 28dd2e277d5c40c6a00fb28d6a3405ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.105711 20705 tablet_server.cc:196] TabletServer@127.20.56.67:0 shutdown complete.
I20260709 12:13:39.117957 20705 master.cc:562] Master@127.20.56.126:39227 shutting down...
I20260709 12:13:39.136907 20705 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:39.137477 20705 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.137830 20705 tablet_replica.cc:333] T 00000000000000000000000000000000 P 218449f602274b5d9b3363128c8d5154: stopping tablet replica
I20260709 12:13:39.157685 20705 master.cc:584] Master@127.20.56.126:39227 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2650 ms)
[----------] 6 tests from LeaderRebalancerTest (323389 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:13:39.187410 20705 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.56.126:40845
I20260709 12:13:39.188548 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:39.193717 30463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:39.193756 30464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:39.195139 30466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:39.196277 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:39.197194 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:39.197403 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:39.197589 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599219197550 us; error 0 us; skew 500 ppm
I20260709 12:13:39.198163 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:39.200502 20705 webserver.cc:533] Webserver started at http://127.20.56.126:46685/ using document root <none> and password file <none>
I20260709 12:13:39.201123 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:39.201406 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:39.201776 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:39.203426 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/master-0-root/instance:
uuid: "231bf61d7df74645895805718ea7a52e"
format_stamp: "Formatted at 2026-07-09 12:13:39 on dist-test-slave-2dwh"
I20260709 12:13:39.210117 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:13:39.213671 30471 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.214385 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:39.214747 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/master-0-root
uuid: "231bf61d7df74645895805718ea7a52e"
format_stamp: "Formatted at 2026-07-09 12:13:39 on dist-test-slave-2dwh"
I20260709 12:13:39.215049 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:39.240841 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:39.241883 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:39.277535 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.126:40845
I20260709 12:13:39.277644 30522 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.126:40845 every 8 connection(s)
I20260709 12:13:39.281445 30523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.291805 30523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e: Bootstrap starting.
I20260709 12:13:39.296214 30523 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:39.300276 30523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e: No bootstrap required, opened a new log
I20260709 12:13:39.302336 30523 raft_consensus.cc:359] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231bf61d7df74645895805718ea7a52e" member_type: VOTER }
I20260709 12:13:39.302736 30523 raft_consensus.cc:385] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:39.302922 30523 raft_consensus.cc:740] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 231bf61d7df74645895805718ea7a52e, State: Initialized, Role: FOLLOWER
I20260709 12:13:39.303424 30523 consensus_queue.cc:260] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231bf61d7df74645895805718ea7a52e" member_type: VOTER }
I20260709 12:13:39.303819 30523 raft_consensus.cc:399] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:39.304001 30523 raft_consensus.cc:493] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:39.304215 30523 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:39.309372 30523 raft_consensus.cc:515] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231bf61d7df74645895805718ea7a52e" member_type: VOTER }
I20260709 12:13:39.309996 30523 leader_election.cc:304] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 231bf61d7df74645895805718ea7a52e; no voters: 
I20260709 12:13:39.311108 30523 leader_election.cc:290] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:39.311443 30526 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:39.313023 30526 raft_consensus.cc:697] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 1 LEADER]: Becoming Leader. State: Replica: 231bf61d7df74645895805718ea7a52e, State: Running, Role: LEADER
I20260709 12:13:39.313674 30526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231bf61d7df74645895805718ea7a52e" member_type: VOTER }
I20260709 12:13:39.314749 30523 sys_catalog.cc:565] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:39.317158 30528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 231bf61d7df74645895805718ea7a52e. Latest consensus state: current_term: 1 leader_uuid: "231bf61d7df74645895805718ea7a52e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231bf61d7df74645895805718ea7a52e" member_type: VOTER } }
I20260709 12:13:39.317173 30527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "231bf61d7df74645895805718ea7a52e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231bf61d7df74645895805718ea7a52e" member_type: VOTER } }
I20260709 12:13:39.317907 30528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:39.318400 30527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:39.327431 30532 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:39.332713 30532 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:39.333889 20705 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:39.341559 30532 catalog_manager.cc:1383] Generated new cluster ID: 45319ddfc9ba4949ab70defdc21038bc
I20260709 12:13:39.341871 30532 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:39.363466 30532 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:39.364830 30532 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:39.377017 30532 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e: Generated new TSK 0
I20260709 12:13:39.377657 30532 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:39.401198 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:39.407250 30544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:39.408499 30545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:39.409825 30547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:39.410122 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:39.411024 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:39.411211 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:39.411331 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599219411320 us; error 0 us; skew 500 ppm
I20260709 12:13:39.411795 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:39.414052 20705 webserver.cc:533] Webserver started at http://127.20.56.65:45193/ using document root <none> and password file <none>
I20260709 12:13:39.414587 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:39.414767 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:39.414985 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:39.416262 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-0-root/instance:
uuid: "1c7aa2de38104af2ad409269ad19f00e"
format_stamp: "Formatted at 2026-07-09 12:13:39 on dist-test-slave-2dwh"
I20260709 12:13:39.421000 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:13:39.424449 30552 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.425237 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:39.425561 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "1c7aa2de38104af2ad409269ad19f00e"
format_stamp: "Formatted at 2026-07-09 12:13:39 on dist-test-slave-2dwh"
I20260709 12:13:39.425879 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:39.455435 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:39.456880 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:39.458431 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:39.460755 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:39.460984 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.461234 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:39.461407 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.500626 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:46829
I20260709 12:13:39.500730 30614 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:46829 every 8 connection(s)
I20260709 12:13:39.505847 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:39.512782 30619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:39.514658 30620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:39.516539 30622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:39.518463 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:39.518848 30615 heartbeater.cc:344] Connected to a master server at 127.20.56.126:40845
I20260709 12:13:39.519304 30615 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:39.519536 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:39.519832 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:39.520002 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599219519987 us; error 0 us; skew 500 ppm
I20260709 12:13:39.520133 30615 heartbeater.cc:507] Master 127.20.56.126:40845 requested a full tablet report, sending...
I20260709 12:13:39.520618 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:39.522516 30488 ts_manager.cc:194] Registered new tserver with Master: 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829)
I20260709 12:13:39.523522 20705 webserver.cc:533] Webserver started at http://127.20.56.66:37293/ using document root <none> and password file <none>
I20260709 12:13:39.524250 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:39.524489 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:39.524778 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:39.525039 30488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41460
I20260709 12:13:39.526228 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-1-root/instance:
uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
format_stamp: "Formatted at 2026-07-09 12:13:39 on dist-test-slave-2dwh"
I20260709 12:13:39.531291 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:39.534698 30627 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.535470 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:39.535725 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-1-root
uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
format_stamp: "Formatted at 2026-07-09 12:13:39 on dist-test-slave-2dwh"
I20260709 12:13:39.535962 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:39.548110 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:39.549301 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:39.550770 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:39.553097 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:39.553311 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.553583 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:39.553746 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.592221 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.66:44833
I20260709 12:13:39.592324 30689 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.66:44833 every 8 connection(s)
I20260709 12:13:39.597086 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:39.603365 30693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:39.605248 30694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:39.606933 20705 server_base.cc:1061] running on GCE node
W20260709 12:13:39.607947 30696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:39.609184 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:39.609458 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:39.609680 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599219609659 us; error 0 us; skew 500 ppm
I20260709 12:13:39.610298 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:39.610306 30690 heartbeater.cc:344] Connected to a master server at 127.20.56.126:40845
I20260709 12:13:39.610857 30690 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:39.611819 30690 heartbeater.cc:507] Master 127.20.56.126:40845 requested a full tablet report, sending...
I20260709 12:13:39.613173 20705 webserver.cc:533] Webserver started at http://127.20.56.67:36685/ using document root <none> and password file <none>
I20260709 12:13:39.613971 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:39.613991 30488 ts_manager.cc:194] Registered new tserver with Master: 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:39.614240 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:39.614655 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:39.615605 30488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41474
I20260709 12:13:39.615774 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-2-root/instance:
uuid: "28e7b02b11384174a618730bc6a07d5e"
format_stamp: "Formatted at 2026-07-09 12:13:39 on dist-test-slave-2dwh"
I20260709 12:13:39.620568 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:13:39.623914 30701 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.624729 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:13:39.625041 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-2-root
uuid: "28e7b02b11384174a618730bc6a07d5e"
format_stamp: "Formatted at 2026-07-09 12:13:39 on dist-test-slave-2dwh"
I20260709 12:13:39.625344 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895630772-20705-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:39.654815 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:39.655905 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:39.657310 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:39.659562 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:39.659804 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.660058 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:39.660233 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:39.698791 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.67:35849
I20260709 12:13:39.698902 30763 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.67:35849 every 8 connection(s)
I20260709 12:13:39.712914 30764 heartbeater.cc:344] Connected to a master server at 127.20.56.126:40845
I20260709 12:13:39.713440 30764 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:39.714193 30764 heartbeater.cc:507] Master 127.20.56.126:40845 requested a full tablet report, sending...
I20260709 12:13:39.716182 30488 ts_manager.cc:194] Registered new tserver with Master: 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:39.716625 20705 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014712038s
I20260709 12:13:39.717653 30488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41488
I20260709 12:13:39.741526 30488 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41504:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:39.744164 30488 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:39.812013 30729 tablet_service.cc:1511] Processing CreateTablet for tablet 1b398442b4934b51bd0b32e3dc08bbfc (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:39.814531 30729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b398442b4934b51bd0b32e3dc08bbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.817718 30728 tablet_service.cc:1511] Processing CreateTablet for tablet 7026d97b6d9b4e30b780f9755e68e075 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:39.819751 30728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7026d97b6d9b4e30b780f9755e68e075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.825623 30655 tablet_service.cc:1511] Processing CreateTablet for tablet 1b398442b4934b51bd0b32e3dc08bbfc (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:39.827101 30655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b398442b4934b51bd0b32e3dc08bbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.836537 30727 tablet_service.cc:1511] Processing CreateTablet for tablet f49cd1c6fc4a443f9693d0399bbb3750 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:39.837994 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49cd1c6fc4a443f9693d0399bbb3750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.838101 30654 tablet_service.cc:1511] Processing CreateTablet for tablet 7026d97b6d9b4e30b780f9755e68e075 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:39.839507 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7026d97b6d9b4e30b780f9755e68e075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.842334 30577 tablet_service.cc:1511] Processing CreateTablet for tablet 70b71b015e47483a9cda60722b2dcba2 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:39.843791 30577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b71b015e47483a9cda60722b2dcba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.847977 30653 tablet_service.cc:1511] Processing CreateTablet for tablet f49cd1c6fc4a443f9693d0399bbb3750 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:39.849340 30653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49cd1c6fc4a443f9693d0399bbb3750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.851466 30579 tablet_service.cc:1511] Processing CreateTablet for tablet 7026d97b6d9b4e30b780f9755e68e075 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:39.852878 30579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7026d97b6d9b4e30b780f9755e68e075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.855499 30580 tablet_service.cc:1511] Processing CreateTablet for tablet 1b398442b4934b51bd0b32e3dc08bbfc (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:39.856904 30580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b398442b4934b51bd0b32e3dc08bbfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.859548 30652 tablet_service.cc:1511] Processing CreateTablet for tablet 70b71b015e47483a9cda60722b2dcba2 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:39.861116 30652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b71b015e47483a9cda60722b2dcba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.863634 30726 tablet_service.cc:1511] Processing CreateTablet for tablet 70b71b015e47483a9cda60722b2dcba2 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:39.865468 30726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b71b015e47483a9cda60722b2dcba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.867448 30578 tablet_service.cc:1511] Processing CreateTablet for tablet f49cd1c6fc4a443f9693d0399bbb3750 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:39.869262 30578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49cd1c6fc4a443f9693d0399bbb3750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.871841 30779 tablet_bootstrap.cc:492] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:39.879451 30779 tablet_bootstrap.cc:654] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:39.883631 30729 tablet_service.cc:1511] Processing CreateTablet for tablet 775d5a7c35364a83bbc17334b67a51b1 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:39.885528 30729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775d5a7c35364a83bbc17334b67a51b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.886904 30655 tablet_service.cc:1511] Processing CreateTablet for tablet e52d6afc2c11471a8041ddf87f0777c0 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:39.888278 30655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52d6afc2c11471a8041ddf87f0777c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.887773 30654 tablet_service.cc:1511] Processing CreateTablet for tablet 775d5a7c35364a83bbc17334b67a51b1 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:39.891767 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775d5a7c35364a83bbc17334b67a51b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.907959 30576 tablet_service.cc:1511] Processing CreateTablet for tablet 775d5a7c35364a83bbc17334b67a51b1 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:39.909485 30576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775d5a7c35364a83bbc17334b67a51b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.916097 30575 tablet_service.cc:1511] Processing CreateTablet for tablet e52d6afc2c11471a8041ddf87f0777c0 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:39.917589 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52d6afc2c11471a8041ddf87f0777c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.919927 30728 tablet_service.cc:1511] Processing CreateTablet for tablet e52d6afc2c11471a8041ddf87f0777c0 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:39.921449 30728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52d6afc2c11471a8041ddf87f0777c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.946713 30574 tablet_service.cc:1511] Processing CreateTablet for tablet fc4da8ffaf9e440ea40ad7bd54994be9 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:39.948463 30574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4da8ffaf9e440ea40ad7bd54994be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.951995 30780 tablet_bootstrap.cc:492] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:39.956120 30654 tablet_service.cc:1511] Processing CreateTablet for tablet fc4da8ffaf9e440ea40ad7bd54994be9 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:39.957475 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4da8ffaf9e440ea40ad7bd54994be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.960258 30727 tablet_service.cc:1511] Processing CreateTablet for tablet fc4da8ffaf9e440ea40ad7bd54994be9 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:39.961730 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4da8ffaf9e440ea40ad7bd54994be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.969889 30780 tablet_bootstrap.cc:654] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:39.972551 30779 tablet_bootstrap.cc:492] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:39.973130 30779 ts_tablet_manager.cc:1403] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.102s	user 0.019s	sys 0.022s
I20260709 12:13:39.974378 30729 tablet_service.cc:1511] Processing CreateTablet for tablet 03907c95f073409399d08fff594fad21 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:39.975946 30729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03907c95f073409399d08fff594fad21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.976120 30779 raft_consensus.cc:359] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:39.976887 30779 raft_consensus.cc:385] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:39.977162 30779 raft_consensus.cc:740] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:39.978888 30575 tablet_service.cc:1511] Processing CreateTablet for tablet 03907c95f073409399d08fff594fad21 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:39.980242 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03907c95f073409399d08fff594fad21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.983500 30574 tablet_service.cc:1511] Processing CreateTablet for tablet f2ecf66b1bc048938456e496c030a992 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:39.983500 30652 tablet_service.cc:1511] Processing CreateTablet for tablet 03907c95f073409399d08fff594fad21 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:39.985001 30574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ecf66b1bc048938456e496c030a992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.985874 30652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03907c95f073409399d08fff594fad21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:39.986819 30779 consensus_queue.cc:260] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:39.994874 30780 tablet_bootstrap.cc:492] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:39.995442 30780 ts_tablet_manager.cc:1403] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.000s
I20260709 12:13:40.000406 30725 tablet_service.cc:1511] Processing CreateTablet for tablet f2ecf66b1bc048938456e496c030a992 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:40.001894 30725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ecf66b1bc048938456e496c030a992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:40.000406 30654 tablet_service.cc:1511] Processing CreateTablet for tablet f2ecf66b1bc048938456e496c030a992 (DEFAULT_TABLE table=test-workload [id=b7a2f57d9bd14a25ac71166206c310de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:40.005191 30780 raft_consensus.cc:359] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.006158 30780 raft_consensus.cc:385] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.006599 30780 raft_consensus.cc:740] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.006248 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ecf66b1bc048938456e496c030a992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:40.010336 30780 consensus_queue.cc:260] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.016512 30782 tablet_bootstrap.cc:492] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:40.034961 30764 heartbeater.cc:499] Master 127.20.56.126:40845 was elected leader, sending a full tablet report...
I20260709 12:13:40.035619 30780 ts_tablet_manager.cc:1434] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 12:13:40.036744 30780 tablet_bootstrap.cc:492] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:40.026178 30782 tablet_bootstrap.cc:654] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.041689 30780 tablet_bootstrap.cc:654] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.043771 30779 ts_tablet_manager.cc:1434] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.070s	user 0.018s	sys 0.009s
I20260709 12:13:40.044571 30690 heartbeater.cc:499] Master 127.20.56.126:40845 was elected leader, sending a full tablet report...
I20260709 12:13:40.048810 30782 tablet_bootstrap.cc:492] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:40.052181 30779 tablet_bootstrap.cc:492] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:40.053851 30782 ts_tablet_manager.cc:1403] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.006s
I20260709 12:13:40.057075 30782 raft_consensus.cc:359] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.057871 30782 raft_consensus.cc:385] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.058219 30782 raft_consensus.cc:740] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.058523 30779 tablet_bootstrap.cc:654] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.059442 30782 consensus_queue.cc:260] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.093400 30615 heartbeater.cc:499] Master 127.20.56.126:40845 was elected leader, sending a full tablet report...
I20260709 12:13:40.093658 30780 tablet_bootstrap.cc:492] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:40.093938 30779 tablet_bootstrap.cc:492] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:40.094226 30780 ts_tablet_manager.cc:1403] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.022s
I20260709 12:13:40.094497 30779 ts_tablet_manager.cc:1403] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.024s
I20260709 12:13:40.095355 30782 ts_tablet_manager.cc:1434] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.041s	user 0.016s	sys 0.016s
I20260709 12:13:40.096614 30782 tablet_bootstrap.cc:492] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:40.097689 30779 raft_consensus.cc:359] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.098057 30780 raft_consensus.cc:359] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:40.098546 30779 raft_consensus.cc:385] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.098893 30780 raft_consensus.cc:385] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.099011 30779 raft_consensus.cc:740] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.099366 30780 raft_consensus.cc:740] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.100178 30779 consensus_queue.cc:260] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.100241 30780 consensus_queue.cc:260] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:40.103098 30782 tablet_bootstrap.cc:654] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.106186 30780 ts_tablet_manager.cc:1434] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:40.107371 30780 tablet_bootstrap.cc:492] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:40.107393 30779 ts_tablet_manager.cc:1434] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:13:40.109671 30779 tablet_bootstrap.cc:492] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:40.117947 30779 tablet_bootstrap.cc:654] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.123800 30782 tablet_bootstrap.cc:492] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:40.126565 30780 tablet_bootstrap.cc:654] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.126610 30782 ts_tablet_manager.cc:1403] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.008s
I20260709 12:13:40.130818 30782 raft_consensus.cc:359] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:40.131656 30782 raft_consensus.cc:385] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.131978 30782 raft_consensus.cc:740] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.132740 30782 consensus_queue.cc:260] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:40.133338 30779 tablet_bootstrap.cc:492] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:40.133916 30779 ts_tablet_manager.cc:1403] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.009s
I20260709 12:13:40.135013 30782 ts_tablet_manager.cc:1434] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:40.136049 30782 tablet_bootstrap.cc:492] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:40.136911 30780 tablet_bootstrap.cc:492] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:40.136830 30779 raft_consensus.cc:359] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.137872 30779 raft_consensus.cc:385] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.137878 30780 ts_tablet_manager.cc:1403] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.002s
I20260709 12:13:40.138285 30779 raft_consensus.cc:740] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.139295 30779 consensus_queue.cc:260] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.140393 30788 raft_consensus.cc:493] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.140938 30788 raft_consensus.cc:515] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.142943 30782 tablet_bootstrap.cc:654] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.145068 30788 leader_election.cc:290] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.146950 30780 raft_consensus.cc:359] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.148622 30780 raft_consensus.cc:385] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.149099 30780 raft_consensus.cc:740] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.150187 30779 ts_tablet_manager.cc:1434] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:40.150348 30780 consensus_queue.cc:260] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.151788 30779 tablet_bootstrap.cc:492] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:40.161715 30780 ts_tablet_manager.cc:1434] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:13:40.168484 30782 tablet_bootstrap.cc:492] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:40.169016 30779 tablet_bootstrap.cc:654] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.169100 30782 ts_tablet_manager.cc:1403] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.015s
I20260709 12:13:40.172667 30782 raft_consensus.cc:359] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.173707 30782 raft_consensus.cc:385] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.174101 30782 raft_consensus.cc:740] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.175046 30782 consensus_queue.cc:260] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.177631 30780 tablet_bootstrap.cc:492] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:40.178328 30782 ts_tablet_manager.cc:1434] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:40.181129 30782 tablet_bootstrap.cc:492] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:40.187799 30780 tablet_bootstrap.cc:654] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.189668 30782 tablet_bootstrap.cc:654] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.192948 30780 tablet_bootstrap.cc:492] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:40.193087 30779 tablet_bootstrap.cc:492] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:40.193706 30780 ts_tablet_manager.cc:1403] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 12:13:40.193774 30779 ts_tablet_manager.cc:1403] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.011s
I20260709 12:13:40.196465 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.197088 30780 raft_consensus.cc:359] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.197950 30780 raft_consensus.cc:385] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.198338 30780 raft_consensus.cc:740] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.198767 30779 raft_consensus.cc:359] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.199576 30779 raft_consensus.cc:385] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.199169 30780 consensus_queue.cc:260] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.199929 30779 raft_consensus.cc:740] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.200500 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.201130 30779 consensus_queue.cc:260] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.201934 30780 ts_tablet_manager.cc:1434] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:40.203125 30780 tablet_bootstrap.cc:492] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:40.207557 30779 ts_tablet_manager.cc:1434] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:13:40.209087 30779 tablet_bootstrap.cc:492] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:40.210088 30780 tablet_bootstrap.cc:654] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:40.210273 30555 leader_election.cc:343] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:40.212989 30555 leader_election.cc:343] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.213696 30555 leader_election.cc:304] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e; no voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:40.214532 30788 raft_consensus.cc:2749] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:40.216445 30785 raft_consensus.cc:493] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.216977 30785 raft_consensus.cc:515] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.224606 30785 leader_election.cc:290] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.224783 30782 tablet_bootstrap.cc:492] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:40.225781 30782 ts_tablet_manager.cc:1403] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.009s
I20260709 12:13:40.230484 30782 raft_consensus.cc:359] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.232321 30779 tablet_bootstrap.cc:654] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.237074 30782 raft_consensus.cc:385] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.237746 30782 raft_consensus.cc:740] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.238933 30782 consensus_queue.cc:260] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.240731 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.241768 30739 raft_consensus.cc:2468] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:40.243322 30784 raft_consensus.cc:493] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.243952 30784 raft_consensus.cc:515] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.244583 30782 ts_tablet_manager.cc:1434] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:13:40.245916 30782 tablet_bootstrap.cc:492] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:40.248713 30630 leader_election.cc:304] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.250221 30785 raft_consensus.cc:493] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.250885 30785 raft_consensus.cc:515] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.252909 30782 tablet_bootstrap.cc:654] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.257537 30785 leader_election.cc:290] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.276427 30784 leader_election.cc:290] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:40.277415 30785 raft_consensus.cc:2804] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.278087 30785 raft_consensus.cc:493] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.281862 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.279557 30803 raft_consensus.cc:493] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.282940 30803 raft_consensus.cc:515] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.285909 30803 leader_election.cc:290] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.290704 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
W20260709 12:13:40.292466 30631 leader_election.cc:343] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:40.283564 30630 leader_election.cc:343] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.294256 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
W20260709 12:13:40.295778 30630 leader_election.cc:343] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.282040 30785 raft_consensus.cc:3060] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.288751 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:40.289532 30780 tablet_bootstrap.cc:492] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:40.296221 30782 tablet_bootstrap.cc:492] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:40.296761 30780 ts_tablet_manager.cc:1403] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.040s
W20260709 12:13:40.297389 30631 leader_election.cc:343] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.297477 30788 raft_consensus.cc:493] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.298213 30788 raft_consensus.cc:515] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.300385 30788 leader_election.cc:290] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.300786 30780 raft_consensus.cc:359] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.289686 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:40.301654 30780 raft_consensus.cc:385] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.302150 30589 raft_consensus.cc:2468] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:40.302556 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.302682 30780 raft_consensus.cc:740] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.296766 30782 ts_tablet_manager.cc:1403] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.001s
I20260709 12:13:40.303318 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.304060 30739 raft_consensus.cc:2468] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:40.304136 30780 consensus_queue.cc:260] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.305437 30555 leader_election.cc:304] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:40.305673 30631 leader_election.cc:304] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:40.306504 30788 raft_consensus.cc:2804] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.306885 30788 raft_consensus.cc:493] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.307107 30780 ts_tablet_manager.cc:1434] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 12:13:40.307256 30788 raft_consensus.cc:3060] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.307760 30782 raft_consensus.cc:359] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.308521 30782 raft_consensus.cc:385] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.308686 30780 tablet_bootstrap.cc:492] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:40.308856 30782 raft_consensus.cc:740] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.309890 30782 consensus_queue.cc:260] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.311645 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
W20260709 12:13:40.313367 30705 leader_election.cc:343] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.296227 30630 leader_election.cc:304] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:40.315891 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.289762 30779 tablet_bootstrap.cc:492] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:40.317155 30779 ts_tablet_manager.cc:1403] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.108s	user 0.033s	sys 0.019s
I20260709 12:13:40.319319 30780 tablet_bootstrap.cc:654] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.321544 30803 raft_consensus.cc:2804] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.321943 30803 raft_consensus.cc:493] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.322302 30803 raft_consensus.cc:3060] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.324055 30782 ts_tablet_manager.cc:1434] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 12:13:40.320344 30779 raft_consensus.cc:359] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.325953 30779 raft_consensus.cc:385] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:40.326000 30536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:40.326380 30779 raft_consensus.cc:740] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
W20260709 12:13:40.327965 30555 leader_election.cc:343] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.339507 30785 raft_consensus.cc:515] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.340931 30665 raft_consensus.cc:2393] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28e7b02b11384174a618730bc6a07d5e in current term 1: Already voted for candidate 7080d73d0ad44ecea8b5c9b7914913ae in this term.
I20260709 12:13:40.340818 30788 raft_consensus.cc:515] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.342294 30785 leader_election.cc:290] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.342962 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:40.333374 30804 raft_consensus.cc:2749] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:40.343647 30739 raft_consensus.cc:3060] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.344071 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:40.346055 30780 tablet_bootstrap.cc:492] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:40.345758 30779 consensus_queue.cc:260] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.346624 30780 ts_tablet_manager.cc:1403] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.011s
I20260709 12:13:40.348786 30785 raft_consensus.cc:493] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.349368 30784 raft_consensus.cc:493] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.349285 30785 raft_consensus.cc:515] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.349726 30780 raft_consensus.cc:359] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.350684 30780 raft_consensus.cc:385] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.351004 30780 raft_consensus.cc:740] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
W20260709 12:13:40.351106 30631 leader_election.cc:343] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.352191 30782 tablet_bootstrap.cc:492] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:40.351794 30780 consensus_queue.cc:260] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.352202 30704 leader_election.cc:304] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e; no voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:40.349850 30784 raft_consensus.cc:515] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.354811 30803 raft_consensus.cc:515] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.356403 30784 leader_election.cc:290] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:40.356913 30784 raft_consensus.cc:493] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.357237 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:40.357342 30784 raft_consensus.cc:515] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.357858 30788 leader_election.cc:290] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.357947 30665 raft_consensus.cc:3060] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.358615 30788 raft_consensus.cc:493] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.359067 30788 raft_consensus.cc:515] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.360673 30784 leader_election.cc:290] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:40.361948 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.365391 30803 leader_election.cc:290] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.366781 30665 raft_consensus.cc:2468] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:40.365985 30664 raft_consensus.cc:2468] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:40.364503 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:40.368010 30555 leader_election.cc:304] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.368475 30589 raft_consensus.cc:3060] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.369077 30555 leader_election.cc:304] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.370822 30785 leader_election.cc:290] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.371465 30782 tablet_bootstrap.cc:654] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.371856 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:40.367905 30779 ts_tablet_manager.cc:1434] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.050s	user 0.012s	sys 0.003s
I20260709 12:13:40.372915 30590 raft_consensus.cc:2393] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7080d73d0ad44ecea8b5c9b7914913ae in current term 1: Already voted for candidate 1c7aa2de38104af2ad409269ad19f00e in this term.
I20260709 12:13:40.375649 30779 tablet_bootstrap.cc:492] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:40.379791 30785 raft_consensus.cc:493] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.379958 30788 leader_election.cc:290] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.380218 30815 raft_consensus.cc:2804] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:40.380658 30788 raft_consensus.cc:2804] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.380757 30815 raft_consensus.cc:697] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:40.381048 30788 raft_consensus.cc:493] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.381436 30788 raft_consensus.cc:3060] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.380354 30785 raft_consensus.cc:515] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:40.381711 30815 consensus_queue.cc:237] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.388041 30589 raft_consensus.cc:2468] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:40.398386 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.389890 30739 raft_consensus.cc:2468] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:40.399680 30784 raft_consensus.cc:2749] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:40.400390 30631 leader_election.cc:304] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.401278 30803 raft_consensus.cc:2804] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:40.401780 30779 tablet_bootstrap.cc:654] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.401782 30803 raft_consensus.cc:697] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
W20260709 12:13:40.403621 30704 leader_election.cc:343] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.389567 30788 raft_consensus.cc:515] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.392738 30782 tablet_bootstrap.cc:492] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:40.404613 30782 ts_tablet_manager.cc:1403] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.005s
I20260709 12:13:40.395076 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.405295 30665 raft_consensus.cc:2468] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 0.
I20260709 12:13:40.405784 30630 leader_election.cc:304] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 1c7aa2de38104af2ad409269ad19f00e
I20260709 12:13:40.405318 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:40.407049 30811 raft_consensus.cc:2804] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:40.397432 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:40.404141 30803 consensus_queue.cc:237] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.394727 30785 leader_election.cc:290] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849), 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829)
I20260709 12:13:40.407634 30811 raft_consensus.cc:697] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:40.426067 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:40.407547 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:40.409833 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.409369 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:40.407780 30590 raft_consensus.cc:2468] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:40.415465 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:40.451638 30815 raft_consensus.cc:493] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.452044 30665 raft_consensus.cc:3060] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.452402 30631 leader_election.cc:304] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.452260 30815 raft_consensus.cc:515] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:40.447171 30782 raft_consensus.cc:359] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.454047 30782 raft_consensus.cc:385] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.454355 30782 raft_consensus.cc:740] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.455300 30815 leader_election.cc:290] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:40.455107 30782 consensus_queue.cc:260] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.425143 30788 leader_election.cc:290] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.416188 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.447692 30780 ts_tablet_manager.cc:1434] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.101s	user 0.014s	sys 0.010s
I20260709 12:13:40.458870 30735 raft_consensus.cc:2468] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:40.456283 30803 raft_consensus.cc:2804] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.456395 30589 raft_consensus.cc:2393] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28e7b02b11384174a618730bc6a07d5e in current term 1: Already voted for candidate 1c7aa2de38104af2ad409269ad19f00e in this term.
I20260709 12:13:40.459674 30803 raft_consensus.cc:493] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.460193 30803 raft_consensus.cc:3060] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.418061 30704 leader_election.cc:304] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.461398 30813 raft_consensus.cc:2804] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.461778 30813 raft_consensus.cc:493] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.407047 30488 catalog_manager.cc:5697] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 1 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.458004 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.454826 30486 catalog_manager.cc:5697] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 1 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.414633 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.464829 30737 raft_consensus.cc:2468] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:40.442891 30811 consensus_queue.cc:237] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.435837 30812 raft_consensus.cc:493] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.459815 30780 tablet_bootstrap.cc:492] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
W20260709 12:13:40.415632 30705 leader_election.cc:343] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.462076 30813 raft_consensus.cc:3060] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.468495 30705 leader_election.cc:304] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e; no voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:40.469550 30784 raft_consensus.cc:2749] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:40.469777 30665 raft_consensus.cc:2468] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:40.470827 30782 ts_tablet_manager.cc:1434] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 12:13:40.471149 30555 leader_election.cc:304] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.472005 30782 tablet_bootstrap.cc:492] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:40.472044 30788 raft_consensus.cc:2804] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:40.472759 30788 raft_consensus.cc:697] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
W20260709 12:13:40.470727 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.65:46829, user_credentials={real_user=slave}} blocked reactor thread for 55156.2us
W20260709 12:13:40.473778 30630 leader_election.cc:343] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.473658 30788 consensus_queue.cc:237] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.474797 30738 raft_consensus.cc:2468] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:40.467674 30812 raft_consensus.cc:515] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.477149 30812 leader_election.cc:290] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:40.480824 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.481241 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:40.481963 30782 tablet_bootstrap.cc:654] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.482578 30630 leader_election.cc:304] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 1c7aa2de38104af2ad409269ad19f00e
I20260709 12:13:40.469740 30803 raft_consensus.cc:515] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:40.483799 30785 raft_consensus.cc:2764] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:13:40.484489 30664 raft_consensus.cc:2393] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c7aa2de38104af2ad409269ad19f00e in current term 1: Already voted for candidate 7080d73d0ad44ecea8b5c9b7914913ae in this term.
I20260709 12:13:40.482191 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.488188 30737 raft_consensus.cc:2468] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:40.489655 30779 tablet_bootstrap.cc:492] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:40.490371 30779 ts_tablet_manager.cc:1403] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.007s
I20260709 12:13:40.492537 30813 raft_consensus.cc:515] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.493021 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:40.494060 30590 raft_consensus.cc:3060] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.492884 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:40.494210 30738 raft_consensus.cc:2393] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c7aa2de38104af2ad409269ad19f00e in current term 1: Already voted for candidate 28e7b02b11384174a618730bc6a07d5e in this term.
I20260709 12:13:40.497262 30555 leader_election.cc:304] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:40.497720 30779 raft_consensus.cc:359] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.498500 30779 raft_consensus.cc:385] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.493680 30803 leader_election.cc:290] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Requested vote from peers 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849), 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829)
I20260709 12:13:40.484515 30736 raft_consensus.cc:3060] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.499747 30779 raft_consensus.cc:740] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.502265 30779 consensus_queue.cc:260] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.504565 30779 ts_tablet_manager.cc:1434] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:13:40.505564 30779 tablet_bootstrap.cc:492] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:40.508193 30736 raft_consensus.cc:2468] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:40.515926 30782 tablet_bootstrap.cc:492] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:40.516530 30782 ts_tablet_manager.cc:1403] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.017s
W20260709 12:13:40.511303 30704 leader_election.cc:343] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:40.516402 30590 raft_consensus.cc:2468] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:40.518749 30788 raft_consensus.cc:2764] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:13:40.519574 30782 raft_consensus.cc:359] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.520428 30782 raft_consensus.cc:385] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.520722 30782 raft_consensus.cc:740] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.520790 30813 leader_election.cc:290] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:40.498849 30589 raft_consensus.cc:2468] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 0.
I20260709 12:13:40.521569 30779 tablet_bootstrap.cc:654] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.521359 30631 leader_election.cc:304] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.521503 30782 consensus_queue.cc:260] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.523170 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:40.523362 30811 raft_consensus.cc:2804] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:40.523934 30811 raft_consensus.cc:697] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:40.524148 30782 ts_tablet_manager.cc:1434] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:40.523972 30665 raft_consensus.cc:2393] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 28e7b02b11384174a618730bc6a07d5e in current term 1: Already voted for candidate 1c7aa2de38104af2ad409269ad19f00e in this term.
I20260709 12:13:40.524772 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:40.525233 30782 tablet_bootstrap.cc:492] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:40.524914 30811 consensus_queue.cc:237] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:40.525427 30738 raft_consensus.cc:3060] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.532648 30779 tablet_bootstrap.cc:492] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:40.533229 30779 ts_tablet_manager.cc:1403] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.000s
I20260709 12:13:40.534376 30738 raft_consensus.cc:2468] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:40.535197 30782 tablet_bootstrap.cc:654] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.519569 30780 tablet_bootstrap.cc:654] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.536670 30779 raft_consensus.cc:359] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.539778 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:40.540249 30779 raft_consensus.cc:385] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.540606 30779 raft_consensus.cc:740] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.541528 30779 consensus_queue.cc:260] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.544008 30705 leader_election.cc:304] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:40.544956 30813 raft_consensus.cc:2804] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.545357 30813 raft_consensus.cc:493] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.545424 30705 leader_election.cc:304] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e; no voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:40.545874 30813 raft_consensus.cc:3060] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.546365 30812 raft_consensus.cc:2749] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:40.544273 30779 ts_tablet_manager.cc:1434] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:13:40.547823 30782 tablet_bootstrap.cc:492] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:40.548503 30782 ts_tablet_manager.cc:1403] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.005s
I20260709 12:13:40.552217 30782 raft_consensus.cc:359] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.553122 30782 raft_consensus.cc:385] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.553450 30782 raft_consensus.cc:740] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.548570 30779 tablet_bootstrap.cc:492] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:40.556195 30813 raft_consensus.cc:515] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.559419 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:40.559787 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:40.560063 30590 raft_consensus.cc:3060] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.560474 30665 raft_consensus.cc:3060] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.554265 30782 consensus_queue.cc:260] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.565153 30782 ts_tablet_manager.cc:1434] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:13:40.566464 30782 tablet_bootstrap.cc:492] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:40.567911 30665 raft_consensus.cc:2468] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 1.
I20260709 12:13:40.569108 30780 tablet_bootstrap.cc:492] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:40.569370 30704 leader_election.cc:304] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.569762 30780 ts_tablet_manager.cc:1403] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.010s
I20260709 12:13:40.570385 30812 raft_consensus.cc:2804] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:40.570955 30812 raft_consensus.cc:697] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Becoming Leader. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:40.567911 30590 raft_consensus.cc:2468] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 1.
I20260709 12:13:40.571828 30812 consensus_queue.cc:237] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.574976 30780 raft_consensus.cc:359] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.575858 30780 raft_consensus.cc:385] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.576234 30780 raft_consensus.cc:740] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.576529 30779 tablet_bootstrap.cc:654] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.568017 30813 leader_election.cc:290] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:40.577488 30780 consensus_queue.cc:260] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.580545 30780 ts_tablet_manager.cc:1434] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:13:40.581992 30780 tablet_bootstrap.cc:492] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:40.582978 30782 tablet_bootstrap.cc:654] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.590054 30780 tablet_bootstrap.cc:654] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.594730 30782 tablet_bootstrap.cc:492] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:40.595325 30782 ts_tablet_manager.cc:1403] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.011s
I20260709 12:13:40.596485 30780 tablet_bootstrap.cc:492] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:40.596939 30780 ts_tablet_manager.cc:1403] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 12:13:40.598871 30780 raft_consensus.cc:359] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.602167 30780 raft_consensus.cc:385] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.602507 30780 raft_consensus.cc:740] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.598660 30782 raft_consensus.cc:359] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.603319 30782 raft_consensus.cc:385] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.603653 30782 raft_consensus.cc:740] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.603655 30779 tablet_bootstrap.cc:492] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:40.604460 30779 ts_tablet_manager.cc:1403] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.007s
I20260709 12:13:40.604338 30780 consensus_queue.cc:260] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.604342 30782 consensus_queue.cc:260] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.606720 30782 ts_tablet_manager.cc:1434] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:40.606921 30780 ts_tablet_manager.cc:1434] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:13:40.606303 30485 catalog_manager.cc:5697] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 28e7b02b11384174a618730bc6a07d5e (127.20.56.67). New cstate: current_term: 1 leader_uuid: "28e7b02b11384174a618730bc6a07d5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.607731 30780 tablet_bootstrap.cc:492] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:40.607976 30779 raft_consensus.cc:359] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.608664 30779 raft_consensus.cc:385] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.608922 30779 raft_consensus.cc:740] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.609743 30779 consensus_queue.cc:260] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.612130 30779 ts_tablet_manager.cc:1434] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:40.613061 30779 tablet_bootstrap.cc:492] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:40.613212 30780 tablet_bootstrap.cc:654] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.615597 30812 raft_consensus.cc:493] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.616281 30812 raft_consensus.cc:515] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.619068 30779 tablet_bootstrap.cc:654] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:40.619474 30812 leader_election.cc:290] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:40.620714 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:40.621161 30780 tablet_bootstrap.cc:492] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:40.621737 30590 raft_consensus.cc:2393] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28e7b02b11384174a618730bc6a07d5e in current term 1: Already voted for candidate 7080d73d0ad44ecea8b5c9b7914913ae in this term.
I20260709 12:13:40.621778 30780 ts_tablet_manager.cc:1403] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:13:40.620714 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.624090 30704 leader_election.cc:304] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e; no voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:40.624553 30779 tablet_bootstrap.cc:492] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:40.625073 30779 ts_tablet_manager.cc:1403] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 12:13:40.624979 30780 raft_consensus.cc:359] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.625368 30812 raft_consensus.cc:3060] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.625787 30780 raft_consensus.cc:385] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.626103 30780 raft_consensus.cc:740] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.626803 30780 consensus_queue.cc:260] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.627053 30486 catalog_manager.cc:5697] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 1 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.628338 30779 raft_consensus.cc:359] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.628813 30780 ts_tablet_manager.cc:1434] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:40.629012 30779 raft_consensus.cc:385] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:40.629297 30779 raft_consensus.cc:740] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:40.629635 30788 raft_consensus.cc:493] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.629204 30486 catalog_manager.cc:5697] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 1 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.630156 30788 raft_consensus.cc:515] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.630497 30779 consensus_queue.cc:260] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.632403 30788 leader_election.cc:290] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.633119 30779 ts_tablet_manager.cc:1434] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:40.634279 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecf66b1bc048938456e496c030a992" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.634295 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecf66b1bc048938456e496c030a992" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.635169 30738 raft_consensus.cc:2468] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:40.635195 30665 raft_consensus.cc:2468] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:40.635264 30812 raft_consensus.cc:2749] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:40.636627 30555 leader_election.cc:304] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.637822 30788 raft_consensus.cc:2804] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.638175 30788 raft_consensus.cc:493] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.638540 30788 raft_consensus.cc:3060] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.644438 30788 raft_consensus.cc:515] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.647922 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecf66b1bc048938456e496c030a992" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:40.648538 30738 raft_consensus.cc:3060] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.648816 30488 catalog_manager.cc:5697] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 1 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.652315 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecf66b1bc048938456e496c030a992" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:40.652982 30665 raft_consensus.cc:3060] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.655877 30738 raft_consensus.cc:2468] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:40.656780 30788 leader_election.cc:290] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.657298 30555 leader_election.cc:304] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:40.658165 30788 raft_consensus.cc:2804] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:40.658661 30788 raft_consensus.cc:697] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:40.659453 30788 consensus_queue.cc:237] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.659888 30665 raft_consensus.cc:2468] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:40.668119 30486 catalog_manager.cc:5697] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 1 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.715976 30811 raft_consensus.cc:493] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.716619 30811 raft_consensus.cc:515] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.718528 30811 leader_election.cc:290] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.719278 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03907c95f073409399d08fff594fad21" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:40.719923 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03907c95f073409399d08fff594fad21" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.719954 30590 raft_consensus.cc:2468] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:40.720836 30738 raft_consensus.cc:2468] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:40.721400 30631 leader_election.cc:304] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.722186 30811 raft_consensus.cc:2804] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.722553 30811 raft_consensus.cc:493] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.722838 30811 raft_consensus.cc:3060] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.728639 30811 raft_consensus.cc:515] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.730466 30811 leader_election.cc:290] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.731148 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03907c95f073409399d08fff594fad21" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:40.731460 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03907c95f073409399d08fff594fad21" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:40.731834 30590 raft_consensus.cc:3060] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.732071 30738 raft_consensus.cc:3060] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.737603 30590 raft_consensus.cc:2468] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:40.738266 30738 raft_consensus.cc:2468] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:40.739034 30631 leader_election.cc:304] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.739974 30811 raft_consensus.cc:2804] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:40.740473 30811 raft_consensus.cc:697] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:40.741201 30811 consensus_queue.cc:237] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.748739 30486 catalog_manager.cc:5697] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 1 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.773412 30788 raft_consensus.cc:493] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.773988 30788 raft_consensus.cc:515] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.775660 30788 leader_election.cc:290] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.776683 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.776939 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.777329 30665 raft_consensus.cc:2468] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:40.777705 30738 raft_consensus.cc:2468] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:40.778445 30555 leader_election.cc:304] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.779268 30788 raft_consensus.cc:2804] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:40.779626 30788 raft_consensus.cc:493] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.779961 30788 raft_consensus.cc:3060] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.784987 30788 raft_consensus.cc:515] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.786775 30788 leader_election.cc:290] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.787753 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:40.788471 30665 raft_consensus.cc:3060] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.788555 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:40.789258 30738 raft_consensus.cc:3060] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.794029 30665 raft_consensus.cc:2468] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:40.794516 30738 raft_consensus.cc:2468] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:40.795430 30555 leader_election.cc:304] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:40.796219 30788 raft_consensus.cc:2804] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:40.796613 30788 raft_consensus.cc:697] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:40.797391 30788 consensus_queue.cc:237] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.804536 30486 catalog_manager.cc:5697] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 1 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.835116 30788 consensus_queue.cc:1048] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:40.837283 30811 consensus_queue.cc:1048] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:40.856462 30785 consensus_queue.cc:1048] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:40.858016 30815 consensus_queue.cc:1048] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:40.867818 30809 consensus_queue.cc:1048] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:40.881958 30788 consensus_queue.cc:1048] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:40.895931 30788 raft_consensus.cc:493] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.896401 30788 raft_consensus.cc:515] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:40.898463 30788 leader_election.cc:290] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:40.899338 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:40.899443 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:40.900246 30738 raft_consensus.cc:2393] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c7aa2de38104af2ad409269ad19f00e in current term 1: Already voted for candidate 7080d73d0ad44ecea8b5c9b7914913ae in this term.
I20260709 12:13:40.901131 30555 leader_election.cc:304] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e; no voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:40.901860 30788 raft_consensus.cc:3060] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:40.906921 30788 raft_consensus.cc:2749] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:41.014345 30812 consensus_queue.cc:1048] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:41.022454 30785 consensus_queue.cc:1048] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.029263 30812 consensus_queue.cc:1048] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.040302 30665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
mode: GRACEFUL
new_leader_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:42192
I20260709 12:13:41.040987 30665 raft_consensus.cc:606] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Received request to transfer leadership to TS 1c7aa2de38104af2ad409269ad19f00e
I20260709 12:13:41.041666 30785 consensus_queue.cc:1048] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.041779 30811 consensus_queue.cc:1048] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.050254 30665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
mode: GRACEFUL
new_leader_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:42192
I20260709 12:13:41.051121 30665 raft_consensus.cc:606] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Received request to transfer leadership to TS 1c7aa2de38104af2ad409269ad19f00e
I20260709 12:13:41.063988 30665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
mode: GRACEFUL
new_leader_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:42192
I20260709 12:13:41.064697 30665 raft_consensus.cc:606] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Received request to transfer leadership to TS 1c7aa2de38104af2ad409269ad19f00e
I20260709 12:13:41.065729 30811 consensus_queue.cc:1048] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.093910 30590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
mode: GRACEFUL
new_leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:34450
I20260709 12:13:41.094595 30590 raft_consensus.cc:606] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Received request to transfer leadership to TS 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:41.097368 30788 consensus_queue.cc:1048] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.101715 30590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
mode: GRACEFUL
new_leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:34450
I20260709 12:13:41.102372 30590 raft_consensus.cc:606] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Received request to transfer leadership to TS 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:41.103368 30858 raft_consensus.cc:993] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae: : Instructing follower 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:41.103899 30803 raft_consensus.cc:1081] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Signalling peer 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:41.105846 30590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:33042
I20260709 12:13:41.106441 30590 raft_consensus.cc:493] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:41.111146 30590 raft_consensus.cc:3060] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.113396 30788 consensus_queue.cc:1048] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.124359 30736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9"
dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
mode: GRACEFUL
new_leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:37144
I20260709 12:13:41.125150 30736 raft_consensus.cc:606] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Received request to transfer leadership to TS 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:41.129788 30590 raft_consensus.cc:515] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:41.135449 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:41.136090 30736 raft_consensus.cc:3060] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.139308 30589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2ecf66b1bc048938456e496c030a992"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
mode: GRACEFUL
new_leader_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:34450
I20260709 12:13:41.139959 30590 leader_election.cc:290] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Requested vote from peers 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:41.140067 30589 raft_consensus.cc:606] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Received request to transfer leadership to TS 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:41.140550 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b398442b4934b51bd0b32e3dc08bbfc" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:41.141152 30665 raft_consensus.cc:3055] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.141547 30665 raft_consensus.cc:740] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:41.142401 30665 consensus_queue.cc:260] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:41.143532 30665 raft_consensus.cc:3060] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.144795 30736 raft_consensus.cc:2468] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:41.145825 30555 leader_election.cc:304] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:41.146565 30788 raft_consensus.cc:2804] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.146994 30788 raft_consensus.cc:697] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:41.147718 30788 consensus_queue.cc:237] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } }
I20260709 12:13:41.149369 30665 raft_consensus.cc:2468] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:41.154173 30485 catalog_manager.cc:5697] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 1 to 2, leader changed from 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66) to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 2 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.240461 30788 consensus_queue.cc:1048] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.249260 30858 consensus_queue.cc:1048] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.254218 30809 consensus_queue.cc:1048] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.264568 30858 consensus_queue.cc:1048] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:41.286752 30815 raft_consensus.cc:993] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e: : Instructing follower 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:41.287278 30809 raft_consensus.cc:1081] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Signalling peer 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:41.289134 30665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:50812
I20260709 12:13:41.289662 30665 raft_consensus.cc:493] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:41.289963 30665 raft_consensus.cc:3060] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.295100 30665 raft_consensus.cc:515] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.296749 30665 leader_election.cc:290] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:41.297673 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:41.297832 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775d5a7c35364a83bbc17334b67a51b1" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:41.298382 30590 raft_consensus.cc:3055] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.298455 30736 raft_consensus.cc:3060] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.298902 30590 raft_consensus.cc:740] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:41.299728 30590 consensus_queue.cc:260] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.300722 30590 raft_consensus.cc:3060] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.304275 30736 raft_consensus.cc:2468] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 2.
I20260709 12:13:41.305599 30630 leader_election.cc:304] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:41.305862 30590 raft_consensus.cc:2468] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 2.
I20260709 12:13:41.306349 30858 raft_consensus.cc:2804] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.306874 30858 raft_consensus.cc:697] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:41.307713 30858 consensus_queue.cc:237] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.313926 30485 catalog_manager.cc:5697] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 1 to 2, leader changed from 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65) to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 2 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:41.401816 30803 raft_consensus.cc:993] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae: : Instructing follower 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:41.402307 30858 raft_consensus.cc:1081] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Signalling peer 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:41.404006 30590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:33042
I20260709 12:13:41.404582 30590 raft_consensus.cc:493] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:41.404955 30590 raft_consensus.cc:3060] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.408643 30815 raft_consensus.cc:993] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e: : Instructing follower 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:41.409209 30809 raft_consensus.cc:1081] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Signalling peer 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:41.410969 30665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:50812
I20260709 12:13:41.411623 30665 raft_consensus.cc:493] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:41.412029 30665 raft_consensus.cc:3060] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.412822 30590 raft_consensus.cc:515] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.415344 30590 leader_election.cc:290] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:41.416119 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:41.416880 30664 raft_consensus.cc:3055] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.416908 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b71b015e47483a9cda60722b2dcba2" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:41.417320 30664 raft_consensus.cc:740] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:41.417618 30736 raft_consensus.cc:3060] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.418229 30664 consensus_queue.cc:260] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.419680 30664 raft_consensus.cc:3060] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.420409 30665 raft_consensus.cc:515] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.423012 30665 leader_election.cc:290] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:41.423589 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:41.423646 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d6afc2c11471a8041ddf87f0777c0" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:41.424569 30590 raft_consensus.cc:3055] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.424602 30738 raft_consensus.cc:3060] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.425175 30590 raft_consensus.cc:740] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:41.426587 30736 raft_consensus.cc:2468] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:41.426263 30590 consensus_queue.cc:260] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.428002 30590 raft_consensus.cc:3060] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.428303 30555 leader_election.cc:304] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:41.429240 30809 raft_consensus.cc:2804] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.429343 30664 raft_consensus.cc:2468] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:41.429785 30809 raft_consensus.cc:697] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:41.430676 30809 consensus_queue.cc:237] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.433104 30738 raft_consensus.cc:2468] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 2.
I20260709 12:13:41.434507 30630 leader_election.cc:304] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:41.435372 30858 raft_consensus.cc:2804] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.435882 30858 raft_consensus.cc:697] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:41.435921 30590 raft_consensus.cc:2468] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 2.
I20260709 12:13:41.436828 30858 consensus_queue.cc:237] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.439903 30485 catalog_manager.cc:5697] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 1 to 2, leader changed from 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66) to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 2 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:41.444451 30488 catalog_manager.cc:5697] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 1 to 2, leader changed from 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65) to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 2 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:41.487337 30803 raft_consensus.cc:993] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae: : Instructing follower 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:41.487852 30811 raft_consensus.cc:1081] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Signalling peer 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:41.489373 30590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:33042
I20260709 12:13:41.489949 30590 raft_consensus.cc:493] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:41.490269 30590 raft_consensus.cc:3060] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.495194 30590 raft_consensus.cc:515] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.496932 30590 leader_election.cc:290] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:41.497767 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:41.498047 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7026d97b6d9b4e30b780f9755e68e075" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:41.498488 30664 raft_consensus.cc:3055] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.498799 30738 raft_consensus.cc:3060] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.498908 30664 raft_consensus.cc:740] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:41.500070 30664 consensus_queue.cc:260] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.501359 30664 raft_consensus.cc:3060] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.504398 30738 raft_consensus.cc:2468] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:41.505563 30555 leader_election.cc:304] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:41.506268 30809 raft_consensus.cc:2804] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.506762 30809 raft_consensus.cc:697] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:41.507618 30664 raft_consensus.cc:2468] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:41.507618 30809 consensus_queue.cc:237] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.514092 30488 catalog_manager.cc:5697] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 1 to 2, leader changed from 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66) to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 2 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:41.593640 30738 raft_consensus.cc:1275] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.595031 30809 consensus_queue.cc:1048] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.600524 30812 raft_consensus.cc:993] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e: : Instructing follower 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:41.602499 30812 raft_consensus.cc:1081] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Signalling peer 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:41.604564 30664 raft_consensus.cc:1275] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.606895 30788 consensus_queue.cc:1048] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.607425 30664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:50816
I20260709 12:13:41.608059 30664 raft_consensus.cc:493] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:41.608426 30664 raft_consensus.cc:3060] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.616580 30664 raft_consensus.cc:515] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.618942 30664 leader_election.cc:290] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:41.619637 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:41.620301 30590 raft_consensus.cc:3060] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.621091 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:41.621747 30736 raft_consensus.cc:3055] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.622123 30736 raft_consensus.cc:740] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:41.622989 30736 consensus_queue.cc:260] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.624904 30736 raft_consensus.cc:3060] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.628719 30590 raft_consensus.cc:2468] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 2.
I20260709 12:13:41.629745 30631 leader_election.cc:304] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:41.630508 30811 raft_consensus.cc:2804] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.630967 30811 raft_consensus.cc:697] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:41.631809 30811 consensus_queue.cc:237] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.632503 30736 raft_consensus.cc:2468] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 2.
I20260709 12:13:41.638758 30485 catalog_manager.cc:5697] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 1 to 2, leader changed from 28e7b02b11384174a618730bc6a07d5e (127.20.56.67) to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 2 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:41.697234 30815 raft_consensus.cc:993] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e: : Instructing follower 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:41.697750 30788 raft_consensus.cc:1081] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Signalling peer 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:41.699211 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2ecf66b1bc048938456e496c030a992"
dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:41.699784 30736 raft_consensus.cc:493] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:41.700156 30736 raft_consensus.cc:3060] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.705309 30736 raft_consensus.cc:515] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.706779 30736 leader_election.cc:290] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 2 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:41.707595 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecf66b1bc048938456e496c030a992" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:41.707819 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecf66b1bc048938456e496c030a992" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:41.708244 30590 raft_consensus.cc:3055] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.708420 30664 raft_consensus.cc:3060] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.708563 30590 raft_consensus.cc:740] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:41.709362 30590 consensus_queue.cc:260] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.710289 30590 raft_consensus.cc:3060] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.713434 30664 raft_consensus.cc:2468] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 2.
I20260709 12:13:41.714562 30704 leader_election.cc:304] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:41.715406 30868 raft_consensus.cc:2804] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.715471 30590 raft_consensus.cc:2468] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 2.
I20260709 12:13:41.716038 30868 raft_consensus.cc:697] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 2 LEADER]: Becoming Leader. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:41.716985 30868 consensus_queue.cc:237] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:41.723800 30485 catalog_manager.cc:5697] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e reported cstate change: term changed from 1 to 2, leader changed from 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65) to 28e7b02b11384174a618730bc6a07d5e (127.20.56.67). New cstate: current_term: 2 leader_uuid: "28e7b02b11384174a618730bc6a07d5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.841760 30736 raft_consensus.cc:1275] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.843070 30788 consensus_queue.cc:1048] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.850926 30664 raft_consensus.cc:1275] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.853176 30815 consensus_queue.cc:1048] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.859684 30590 raft_consensus.cc:1275] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.861351 30803 consensus_queue.cc:1048] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.872361 30736 raft_consensus.cc:1275] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.874552 30811 consensus_queue.cc:1048] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.903259 30590 raft_consensus.cc:1275] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.904858 30811 consensus_queue.cc:1048] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.914785 30736 raft_consensus.cc:1275] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.916970 30876 consensus_queue.cc:1048] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.960389 30664 raft_consensus.cc:1275] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.961673 30815 consensus_queue.cc:1048] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.969417 30736 raft_consensus.cc:1275] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:41.971341 30809 consensus_queue.cc:1048] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:42.074141 30590 raft_consensus.cc:1275] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:42.075595 30876 consensus_queue.cc:1048] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:42.084537 30736 raft_consensus.cc:1275] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:42.085940 30803 consensus_queue.cc:1048] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:42.104714 30664 raft_consensus.cc:1275] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:42.105911 30868 consensus_queue.cc:1048] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:42.113935 30590 raft_consensus.cc:1275] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:42.115567 30871 consensus_queue.cc:1048] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.168998 30488 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49490:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:44.171170 30488 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:44.221626 30575 tablet_service.cc:1511] Processing CreateTablet for tablet 031c39bbbe8b475d9fe9e7086d915f8e (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:44.222915 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031c39bbbe8b475d9fe9e7086d915f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.223241 30652 tablet_service.cc:1511] Processing CreateTablet for tablet 031c39bbbe8b475d9fe9e7086d915f8e (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:44.224601 30652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031c39bbbe8b475d9fe9e7086d915f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.227386 30725 tablet_service.cc:1511] Processing CreateTablet for tablet 031c39bbbe8b475d9fe9e7086d915f8e (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:44.228745 30725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031c39bbbe8b475d9fe9e7086d915f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.229171 30729 tablet_service.cc:1511] Processing CreateTablet for tablet 47d308c4e27746f5af4abc0025bf0c0d (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:44.230437 30729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d308c4e27746f5af4abc0025bf0c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.230124 30577 tablet_service.cc:1511] Processing CreateTablet for tablet 5957fd8b788149868c5940ed39304cff (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:44.231431 30577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5957fd8b788149868c5940ed39304cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.231426 30574 tablet_service.cc:1511] Processing CreateTablet for tablet 47d308c4e27746f5af4abc0025bf0c0d (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:44.233211 30574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d308c4e27746f5af4abc0025bf0c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.234126 30578 tablet_service.cc:1511] Processing CreateTablet for tablet c8954a56efd64deabd904e0cfc8f5e9f (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:44.235373 30578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8954a56efd64deabd904e0cfc8f5e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.236364 30726 tablet_service.cc:1511] Processing CreateTablet for tablet 5957fd8b788149868c5940ed39304cff (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:44.237665 30726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5957fd8b788149868c5940ed39304cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.235384 30653 tablet_service.cc:1511] Processing CreateTablet for tablet 5957fd8b788149868c5940ed39304cff (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:44.239148 30653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5957fd8b788149868c5940ed39304cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.243057 30655 tablet_service.cc:1511] Processing CreateTablet for tablet c8954a56efd64deabd904e0cfc8f5e9f (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:44.244406 30655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8954a56efd64deabd904e0cfc8f5e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.244827 30728 tablet_service.cc:1511] Processing CreateTablet for tablet c8954a56efd64deabd904e0cfc8f5e9f (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:44.246140 30728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8954a56efd64deabd904e0cfc8f5e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.247181 30579 tablet_service.cc:1511] Processing CreateTablet for tablet be16b61b8e5f4174918c0f36b05e76fe (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:44.248472 30579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be16b61b8e5f4174918c0f36b05e76fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.249285 30651 tablet_service.cc:1511] Processing CreateTablet for tablet be16b61b8e5f4174918c0f36b05e76fe (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:44.250656 30651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be16b61b8e5f4174918c0f36b05e76fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.227475 30654 tablet_service.cc:1511] Processing CreateTablet for tablet 47d308c4e27746f5af4abc0025bf0c0d (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:44.251341 30727 tablet_service.cc:1511] Processing CreateTablet for tablet be16b61b8e5f4174918c0f36b05e76fe (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:44.252094 30654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d308c4e27746f5af4abc0025bf0c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.252652 30727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be16b61b8e5f4174918c0f36b05e76fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.265448 30576 tablet_service.cc:1511] Processing CreateTablet for tablet 55bdc0e1cb924dcba797b753d292bd54 (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:44.266947 30576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bdc0e1cb924dcba797b753d292bd54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.271550 30650 tablet_service.cc:1511] Processing CreateTablet for tablet 55bdc0e1cb924dcba797b753d292bd54 (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:44.272980 30650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bdc0e1cb924dcba797b753d292bd54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.277959 30724 tablet_service.cc:1511] Processing CreateTablet for tablet 55bdc0e1cb924dcba797b753d292bd54 (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:44.279467 30724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55bdc0e1cb924dcba797b753d292bd54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.282526 30580 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff1d209edf948f6b262b265de0bdff8 (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:44.283842 30580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff1d209edf948f6b262b265de0bdff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.284677 30723 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff1d209edf948f6b262b265de0bdff8 (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:44.286067 30723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff1d209edf948f6b262b265de0bdff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.286890 30573 tablet_service.cc:1511] Processing CreateTablet for tablet 872199f9f7ed455c87ae9d8c3c77f9ab (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:44.287441 30649 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff1d209edf948f6b262b265de0bdff8 (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:44.288163 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872199f9f7ed455c87ae9d8c3c77f9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.288753 30649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff1d209edf948f6b262b265de0bdff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.300410 30648 tablet_service.cc:1511] Processing CreateTablet for tablet 872199f9f7ed455c87ae9d8c3c77f9ab (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
W20260709 12:13:44.301510 30555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:44833, user_credentials={real_user=slave}} blocked reactor thread for 46658.5us
I20260709 12:13:44.301937 30648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872199f9f7ed455c87ae9d8c3c77f9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.303620 30722 tablet_service.cc:1511] Processing CreateTablet for tablet 872199f9f7ed455c87ae9d8c3c77f9ab (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:44.305063 30722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872199f9f7ed455c87ae9d8c3c77f9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.309949 30572 tablet_service.cc:1511] Processing CreateTablet for tablet 8175854989d74380aac6a42a4d631808 (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:44.311460 30572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8175854989d74380aac6a42a4d631808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.329159 30647 tablet_service.cc:1511] Processing CreateTablet for tablet 8175854989d74380aac6a42a4d631808 (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:44.331151 30647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8175854989d74380aac6a42a4d631808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.337736 30721 tablet_service.cc:1511] Processing CreateTablet for tablet 8175854989d74380aac6a42a4d631808 (DEFAULT_TABLE table=soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:44.339155 30721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8175854989d74380aac6a42a4d631808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:44.351547 30893 tablet_bootstrap.cc:492] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
W20260709 12:13:44.364928 30536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:44.400802 30893 tablet_bootstrap.cc:654] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.421633 30895 tablet_bootstrap.cc:492] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:44.423362 30894 tablet_bootstrap.cc:492] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:44.438868 30895 tablet_bootstrap.cc:654] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.440261 30894 tablet_bootstrap.cc:654] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.440691 30893 tablet_bootstrap.cc:492] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:44.441390 30893 ts_tablet_manager.cc:1403] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.000s
I20260709 12:13:44.445438 30893 raft_consensus.cc:359] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.446461 30893 raft_consensus.cc:385] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.446857 30893 raft_consensus.cc:740] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.447762 30893 consensus_queue.cc:260] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.448484 30895 tablet_bootstrap.cc:492] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:44.449045 30895 ts_tablet_manager.cc:1403] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 12:13:44.449096 30894 tablet_bootstrap.cc:492] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:44.449667 30894 ts_tablet_manager.cc:1403] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 12:13:44.452105 30895 raft_consensus.cc:359] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.452916 30895 raft_consensus.cc:385] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.452735 30894 raft_consensus.cc:359] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.453348 30895 raft_consensus.cc:740] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.453461 30893 ts_tablet_manager.cc:1434] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.005s
I20260709 12:13:44.453743 30894 raft_consensus.cc:385] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.454124 30894 raft_consensus.cc:740] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.454829 30893 tablet_bootstrap.cc:492] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:44.454322 30895 consensus_queue.cc:260] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.454945 30894 consensus_queue.cc:260] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.457434 30894 ts_tablet_manager.cc:1434] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:13:44.457901 30895 ts_tablet_manager.cc:1434] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:44.458526 30894 tablet_bootstrap.cc:492] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:44.459081 30895 tablet_bootstrap.cc:492] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:44.466049 30894 tablet_bootstrap.cc:654] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.468955 30895 tablet_bootstrap.cc:654] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.478282 30894 tablet_bootstrap.cc:492] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:44.478914 30894 ts_tablet_manager.cc:1403] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 12:13:44.482059 30894 raft_consensus.cc:359] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.483043 30894 raft_consensus.cc:385] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.483446 30894 raft_consensus.cc:740] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.485481 30893 tablet_bootstrap.cc:654] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.485445 30894 consensus_queue.cc:260] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.487109 30895 tablet_bootstrap.cc:492] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:44.487910 30895 ts_tablet_manager.cc:1403] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 12:13:44.491647 30895 raft_consensus.cc:359] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.492481 30895 raft_consensus.cc:385] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.492826 30895 raft_consensus.cc:740] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.493654 30895 consensus_queue.cc:260] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.495440 30894 ts_tablet_manager.cc:1434] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.016s	user 0.013s	sys 0.001s
I20260709 12:13:44.496145 30895 ts_tablet_manager.cc:1434] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:44.496616 30894 tablet_bootstrap.cc:492] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:44.497401 30895 tablet_bootstrap.cc:492] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:44.499217 30893 tablet_bootstrap.cc:492] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:44.499853 30893 ts_tablet_manager.cc:1403] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.002s
I20260709 12:13:44.503242 30893 raft_consensus.cc:359] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.504177 30893 raft_consensus.cc:385] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.504558 30893 raft_consensus.cc:740] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.504760 30894 tablet_bootstrap.cc:654] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.505450 30893 consensus_queue.cc:260] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.516719 30895 tablet_bootstrap.cc:654] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.525347 30893 ts_tablet_manager.cc:1434] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 12:13:44.526681 30893 tablet_bootstrap.cc:492] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:44.527757 30894 tablet_bootstrap.cc:492] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:44.528406 30894 ts_tablet_manager.cc:1403] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.012s
I20260709 12:13:44.532480 30894 raft_consensus.cc:359] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.533295 30894 raft_consensus.cc:385] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.533636 30894 raft_consensus.cc:740] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.534754 30902 raft_consensus.cc:493] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.535204 30902 raft_consensus.cc:515] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.537482 30902 leader_election.cc:290] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.537961 30894 consensus_queue.cc:260] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.540839 30894 ts_tablet_manager.cc:1434] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:13:44.541467 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:44.542068 30894 tablet_bootstrap.cc:492] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:44.544384 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:44.546087 30893 tablet_bootstrap.cc:654] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:44.547987 30631 leader_election.cc:343] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.550012 30894 tablet_bootstrap.cc:654] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.553248 30895 tablet_bootstrap.cc:492] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:44.553776 30895 ts_tablet_manager.cc:1403] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.020s
I20260709 12:13:44.556953 30895 raft_consensus.cc:359] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.557685 30895 raft_consensus.cc:385] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.557982 30895 raft_consensus.cc:740] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.558861 30895 consensus_queue.cc:260] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
W20260709 12:13:44.560547 30630 leader_election.cc:343] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.560842 30895 ts_tablet_manager.cc:1434] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:44.561095 30630 leader_election.cc:304] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:44.561908 30895 tablet_bootstrap.cc:492] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:44.565629 30902 raft_consensus.cc:2749] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.570261 30895 tablet_bootstrap.cc:654] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.572578 30894 tablet_bootstrap.cc:492] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:44.573438 30894 ts_tablet_manager.cc:1403] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.010s
I20260709 12:13:44.576892 30894 raft_consensus.cc:359] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.577695 30894 raft_consensus.cc:385] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.577996 30894 raft_consensus.cc:740] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.578744 30894 consensus_queue.cc:260] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.580964 30895 tablet_bootstrap.cc:492] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:44.581534 30894 ts_tablet_manager.cc:1434] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:44.581532 30895 ts_tablet_manager.cc:1403] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 12:13:44.582796 30894 tablet_bootstrap.cc:492] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:44.582846 30893 tablet_bootstrap.cc:492] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:44.583462 30893 ts_tablet_manager.cc:1403] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.015s
I20260709 12:13:44.585223 30895 raft_consensus.cc:359] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.586334 30895 raft_consensus.cc:385] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.586632 30893 raft_consensus.cc:359] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.586717 30895 raft_consensus.cc:740] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.587500 30893 raft_consensus.cc:385] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.588057 30895 consensus_queue.cc:260] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.590109 30894 tablet_bootstrap.cc:654] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.590399 30895 ts_tablet_manager.cc:1434] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:44.591521 30895 tablet_bootstrap.cc:492] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:44.587898 30893 raft_consensus.cc:740] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.592399 30893 consensus_queue.cc:260] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.595559 30893 ts_tablet_manager.cc:1434] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:13:44.596897 30893 tablet_bootstrap.cc:492] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:44.602063 30894 tablet_bootstrap.cc:492] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:44.602563 30895 tablet_bootstrap.cc:654] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.602701 30894 ts_tablet_manager.cc:1403] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 12:13:44.604166 30893 tablet_bootstrap.cc:654] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.606082 30894 raft_consensus.cc:359] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.606935 30894 raft_consensus.cc:385] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.607307 30894 raft_consensus.cc:740] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.608301 30894 consensus_queue.cc:260] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.611411 30881 raft_consensus.cc:493] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.611913 30894 ts_tablet_manager.cc:1434] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:13:44.611953 30881 raft_consensus.cc:515] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.613495 30894 tablet_bootstrap.cc:492] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:44.614583 30881 leader_election.cc:290] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:44.611990 30892 raft_consensus.cc:493] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.615658 30892 raft_consensus.cc:515] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.615921 30893 tablet_bootstrap.cc:492] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:44.616860 30893 ts_tablet_manager.cc:1403] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260709 12:13:44.616977 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:44.618808 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:44.620026 30893 raft_consensus.cc:359] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
W20260709 12:13:44.620512 30705 leader_election.cc:343] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.620658 30894 tablet_bootstrap.cc:654] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.620849 30892 leader_election.cc:290] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.620810 30893 raft_consensus.cc:385] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:44.621327 30704 leader_election.cc:343] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.621549 30893 raft_consensus.cc:740] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.621809 30704 leader_election.cc:304] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e; no voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:44.622498 30893 consensus_queue.cc:260] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.623193 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8175854989d74380aac6a42a4d631808" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:44.624184 30881 raft_consensus.cc:2749] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.625288 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8175854989d74380aac6a42a4d631808" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
W20260709 12:13:44.626159 30555 leader_election.cc:343] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:44.628278 30555 leader_election.cc:343] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.628758 30555 leader_election.cc:304] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e; no voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:44.629868 30892 raft_consensus.cc:2749] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:44.632428 30895 tablet_bootstrap.cc:492] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:44.632978 30895 ts_tablet_manager.cc:1403] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.003s
I20260709 12:13:44.636404 30895 raft_consensus.cc:359] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.637343 30895 raft_consensus.cc:385] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.637523 30893 ts_tablet_manager.cc:1434] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:13:44.637737 30895 raft_consensus.cc:740] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.638772 30895 consensus_queue.cc:260] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.639292 30893 tablet_bootstrap.cc:492] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:44.641907 30895 ts_tablet_manager.cc:1434] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:13:44.647382 30895 tablet_bootstrap.cc:492] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:44.655501 30893 tablet_bootstrap.cc:654] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.656822 30895 tablet_bootstrap.cc:654] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.657369 30894 tablet_bootstrap.cc:492] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:44.657924 30894 ts_tablet_manager.cc:1403] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.012s
I20260709 12:13:44.669441 30893 tablet_bootstrap.cc:492] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:44.669417 30894 raft_consensus.cc:359] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.670152 30893 ts_tablet_manager.cc:1403] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.004s
I20260709 12:13:44.670184 30894 raft_consensus.cc:385] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.670660 30894 raft_consensus.cc:740] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.671437 30894 consensus_queue.cc:260] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.673250 30893 raft_consensus.cc:359] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.673844 30894 ts_tablet_manager.cc:1434] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:13:44.674060 30893 raft_consensus.cc:385] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.674386 30893 raft_consensus.cc:740] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.675123 30894 tablet_bootstrap.cc:492] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:44.675160 30893 consensus_queue.cc:260] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.677757 30893 ts_tablet_manager.cc:1434] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:13:44.678822 30893 tablet_bootstrap.cc:492] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:44.682356 30894 tablet_bootstrap.cc:654] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.685465 30893 tablet_bootstrap.cc:654] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.694775 30894 tablet_bootstrap.cc:492] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:44.695415 30894 ts_tablet_manager.cc:1403] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:13:44.696780 30895 tablet_bootstrap.cc:492] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:44.697285 30895 ts_tablet_manager.cc:1403] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.011s
I20260709 12:13:44.697775 30893 tablet_bootstrap.cc:492] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:44.698318 30893 ts_tablet_manager.cc:1403] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:13:44.698675 30894 raft_consensus.cc:359] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.699479 30894 raft_consensus.cc:385] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.699783 30894 raft_consensus.cc:740] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.699819 30895 raft_consensus.cc:359] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.700547 30895 raft_consensus.cc:385] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.700865 30895 raft_consensus.cc:740] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.700637 30894 consensus_queue.cc:260] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.701383 30893 raft_consensus.cc:359] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.702136 30893 raft_consensus.cc:385] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.702457 30893 raft_consensus.cc:740] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.703495 30894 ts_tablet_manager.cc:1434] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:44.703264 30893 consensus_queue.cc:260] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.704567 30894 tablet_bootstrap.cc:492] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:44.701604 30895 consensus_queue.cc:260] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.705741 30893 ts_tablet_manager.cc:1434] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:13:44.706879 30893 tablet_bootstrap.cc:492] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:44.711886 30894 tablet_bootstrap.cc:654] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.713357 30893 tablet_bootstrap.cc:654] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.707675 30895 ts_tablet_manager.cc:1434] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:13:44.725010 30894 tablet_bootstrap.cc:492] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:44.725696 30894 ts_tablet_manager.cc:1403] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:13:44.729354 30894 raft_consensus.cc:359] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.730324 30894 raft_consensus.cc:385] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.730681 30894 raft_consensus.cc:740] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.731323 30895 tablet_bootstrap.cc:492] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:44.732807 30894 consensus_queue.cc:260] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.734004 30893 tablet_bootstrap.cc:492] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:44.734545 30893 ts_tablet_manager.cc:1403] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.012s
I20260709 12:13:44.735157 30894 ts_tablet_manager.cc:1434] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:13:44.736114 30894 tablet_bootstrap.cc:492] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae: Bootstrap starting.
I20260709 12:13:44.737380 30893 raft_consensus.cc:359] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.738209 30893 raft_consensus.cc:385] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.738515 30893 raft_consensus.cc:740] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.739380 30893 consensus_queue.cc:260] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.740178 30895 tablet_bootstrap.cc:654] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.741820 30893 ts_tablet_manager.cc:1434] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:13:44.742854 30894 tablet_bootstrap.cc:654] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.742894 30893 tablet_bootstrap.cc:492] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:44.751616 30893 tablet_bootstrap.cc:654] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.754528 30894 tablet_bootstrap.cc:492] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae: No bootstrap required, opened a new log
I20260709 12:13:44.755024 30894 ts_tablet_manager.cc:1403] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:13:44.757815 30895 tablet_bootstrap.cc:492] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:44.758463 30895 ts_tablet_manager.cc:1403] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 12:13:44.758574 30894 raft_consensus.cc:359] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.759639 30894 raft_consensus.cc:385] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.759980 30894 raft_consensus.cc:740] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.760879 30894 consensus_queue.cc:260] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.762348 30895 raft_consensus.cc:359] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.763906 30895 raft_consensus.cc:385] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.764199 30894 ts_tablet_manager.cc:1434] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:13:44.764271 30895 raft_consensus.cc:740] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.765623 30895 consensus_queue.cc:260] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.767872 30893 tablet_bootstrap.cc:492] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:44.768432 30893 ts_tablet_manager.cc:1403] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 12:13:44.768769 30895 ts_tablet_manager.cc:1434] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:13:44.770309 30895 tablet_bootstrap.cc:492] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:44.771265 30893 raft_consensus.cc:359] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.772076 30893 raft_consensus.cc:385] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.772378 30893 raft_consensus.cc:740] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.773166 30893 consensus_queue.cc:260] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.775384 30893 ts_tablet_manager.cc:1434] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:44.777719 30895 tablet_bootstrap.cc:654] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.779295 30893 tablet_bootstrap.cc:492] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e: Bootstrap starting.
I20260709 12:13:44.781183 30811 raft_consensus.cc:493] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.782015 30811 raft_consensus.cc:515] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.784940 30893 tablet_bootstrap.cc:654] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.785709 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1d209edf948f6b262b265de0bdff8" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:44.786012 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1d209edf948f6b262b265de0bdff8" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:44.786391 30590 raft_consensus.cc:2468] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:44.786808 30738 raft_consensus.cc:2468] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:44.787968 30631 leader_election.cc:304] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:44.789136 30902 raft_consensus.cc:2804] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.786182 30811 leader_election.cc:290] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.789637 30902 raft_consensus.cc:493] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.790126 30902 raft_consensus.cc:3060] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.794181 30895 tablet_bootstrap.cc:492] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:44.794814 30895 ts_tablet_manager.cc:1403] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.010s
I20260709 12:13:44.797820 30895 raft_consensus.cc:359] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.798559 30895 raft_consensus.cc:385] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.798897 30895 raft_consensus.cc:740] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.799641 30895 consensus_queue.cc:260] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.809880 30902 raft_consensus.cc:515] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.812682 30913 raft_consensus.cc:493] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.813445 30913 raft_consensus.cc:515] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.821408 30895 ts_tablet_manager.cc:1434] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.026s	user 0.018s	sys 0.006s
I20260709 12:13:44.822542 30895 tablet_bootstrap.cc:492] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e: Bootstrap starting.
I20260709 12:13:44.824786 30913 leader_election.cc:290] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:44.826682 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:44.827414 30664 raft_consensus.cc:2468] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 0.
I20260709 12:13:44.828192 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:44.829013 30704 leader_election.cc:304] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:44.829159 30590 raft_consensus.cc:2468] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 0.
I20260709 12:13:44.829936 30902 leader_election.cc:290] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.831122 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1d209edf948f6b262b265de0bdff8" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:44.831702 30590 raft_consensus.cc:3060] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.832592 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1d209edf948f6b262b265de0bdff8" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:44.833444 30738 raft_consensus.cc:3060] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.833895 30895 tablet_bootstrap.cc:654] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:44.837666 30811 raft_consensus.cc:493] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.838383 30811 raft_consensus.cc:515] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.838883 30899 raft_consensus.cc:493] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.841895 30913 raft_consensus.cc:2804] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.842335 30913 raft_consensus.cc:493] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.842361 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872199f9f7ed455c87ae9d8c3c77f9ab" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:44.843118 30738 raft_consensus.cc:2468] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:44.843380 30589 raft_consensus.cc:2468] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:44.844453 30630 leader_election.cc:304] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:44.845134 30893 tablet_bootstrap.cc:492] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e: No bootstrap required, opened a new log
I20260709 12:13:44.845242 30631 leader_election.cc:304] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:44.845885 30893 ts_tablet_manager.cc:1403] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e: Time spent bootstrapping tablet: real 0.067s	user 0.028s	sys 0.021s
I20260709 12:13:44.847568 30881 raft_consensus.cc:493] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.848201 30881 raft_consensus.cc:515] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.849789 30893 raft_consensus.cc:359] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.850931 30893 raft_consensus.cc:385] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.841917 30899 raft_consensus.cc:515] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.851313 30893 raft_consensus.cc:740] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.852425 30893 consensus_queue.cc:260] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.853497 30899 leader_election.cc:290] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.853986 30881 leader_election.cc:290] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:44.854068 30899 raft_consensus.cc:2804] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.869823 30926 raft_consensus.cc:493] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.875869 30899 raft_consensus.cc:697] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:44.866959 30811 leader_election.cc:290] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.865475 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d308c4e27746f5af4abc0025bf0c0d" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:44.876860 30899 consensus_queue.cc:237] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.855381 30893 ts_tablet_manager.cc:1434] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:13:44.877447 30664 raft_consensus.cc:2468] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 0.
I20260709 12:13:44.876387 30926 raft_consensus.cc:515] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.865373 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957fd8b788149868c5940ed39304cff" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:44.879274 30588 raft_consensus.cc:2468] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:44.880606 30631 leader_election.cc:304] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:44.881482 30811 raft_consensus.cc:2804] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.881971 30811 raft_consensus.cc:493] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.882334 30811 raft_consensus.cc:3060] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.882812 30926 leader_election.cc:290] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.882261 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8954a56efd64deabd904e0cfc8f5e9f" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:44.883646 30738 raft_consensus.cc:2468] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:44.884775 30555 leader_election.cc:304] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:44.885640 30926 raft_consensus.cc:2804] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.885985 30926 raft_consensus.cc:493] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.842764 30913 raft_consensus.cc:3060] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.886314 30926 raft_consensus.cc:3060] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.888675 30704 leader_election.cc:304] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:44.889662 30881 raft_consensus.cc:2804] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.890025 30881 raft_consensus.cc:493] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.890373 30881 raft_consensus.cc:3060] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.862119 30929 raft_consensus.cc:2804] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.890971 30929 raft_consensus.cc:493] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.891321 30929 raft_consensus.cc:3060] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.855604 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d308c4e27746f5af4abc0025bf0c0d" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
W20260709 12:13:44.897166 30630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:35849, user_credentials={real_user=slave}} blocked reactor thread for 52803.5us
W20260709 12:13:44.898193 30705 leader_election.cc:343] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:44.900964 30811 raft_consensus.cc:515] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.901254 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872199f9f7ed455c87ae9d8c3c77f9ab" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:44.902206 30736 raft_consensus.cc:2468] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:44.903193 30926 raft_consensus.cc:515] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.904100 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957fd8b788149868c5940ed39304cff" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:44.904874 30588 raft_consensus.cc:3060] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.905277 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8954a56efd64deabd904e0cfc8f5e9f" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:44.907339 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8954a56efd64deabd904e0cfc8f5e9f" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:44.908998 30665 raft_consensus.cc:3060] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.911500 30895 tablet_bootstrap.cc:492] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e: No bootstrap required, opened a new log
I20260709 12:13:44.912217 30895 ts_tablet_manager.cc:1403] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e: Time spent bootstrapping tablet: real 0.090s	user 0.027s	sys 0.050s
I20260709 12:13:44.912853 30588 raft_consensus.cc:2468] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:44.913897 30929 raft_consensus.cc:515] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.914131 30631 leader_election.cc:304] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:44.915238 30928 raft_consensus.cc:2804] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.903975 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957fd8b788149868c5940ed39304cff" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:44.915937 30895 raft_consensus.cc:359] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.915544 30881 raft_consensus.cc:515] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.918229 30895 raft_consensus.cc:385] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:44.918857 30590 raft_consensus.cc:2468] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:44.920099 30809 raft_consensus.cc:493] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.918695 30895 raft_consensus.cc:740] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Initialized, Role: FOLLOWER
I20260709 12:13:44.919680 30738 raft_consensus.cc:2468] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 0.
I20260709 12:13:44.921824 30809 raft_consensus.cc:515] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.924079 30809 leader_election.cc:290] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.924841 30811 leader_election.cc:290] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.926668 30665 raft_consensus.cc:2468] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:44.926659 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d308c4e27746f5af4abc0025bf0c0d" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:44.927778 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:44.928227 30555 leader_election.cc:304] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:44.928440 30738 raft_consensus.cc:2468] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:44.928722 30926 leader_election.cc:290] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.929343 30926 raft_consensus.cc:2804] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.928447 30881 leader_election.cc:290] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:44.930438 30926 raft_consensus.cc:697] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:44.930625 30892 raft_consensus.cc:493] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.931231 30892 raft_consensus.cc:515] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.931519 30926 consensus_queue.cc:237] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.932349 30929 leader_election.cc:290] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.932603 30895 consensus_queue.cc:260] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.934883 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8954a56efd64deabd904e0cfc8f5e9f" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:44.934975 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957fd8b788149868c5940ed39304cff" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:44.935710 30588 raft_consensus.cc:3060] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.935920 30736 raft_consensus.cc:3060] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.930130 30555 leader_election.cc:304] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:44.937976 30809 raft_consensus.cc:2804] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.938064 30928 raft_consensus.cc:697] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:44.938530 30809 raft_consensus.cc:493] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.939033 30809 raft_consensus.cc:3060] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.939708 30895 ts_tablet_manager.cc:1434] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:13:44.939523 30928 consensus_queue.cc:237] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.943094 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:44.943909 30737 raft_consensus.cc:2468] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:44.944286 30736 raft_consensus.cc:2468] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:44.946224 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:44.947094 30664 raft_consensus.cc:2468] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:44.933481 30892 leader_election.cc:290] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.950698 30555 leader_election.cc:304] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:44.950906 30588 raft_consensus.cc:2468] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 1.
I20260709 12:13:44.951982 30892 raft_consensus.cc:2804] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:44.952483 30892 raft_consensus.cc:493] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.952955 30892 raft_consensus.cc:3060] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.954353 30705 leader_election.cc:304] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:44.955502 30881 raft_consensus.cc:2804] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:44.956115 30881 raft_consensus.cc:697] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Becoming Leader. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:44.957129 30881 consensus_queue.cc:237] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.972975 30928 raft_consensus.cc:493] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.973569 30928 raft_consensus.cc:515] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.977216 30486 catalog_manager.cc:5697] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 1 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.979676 30485 catalog_manager.cc:5697] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 28e7b02b11384174a618730bc6a07d5e (127.20.56.67). New cstate: current_term: 1 leader_uuid: "28e7b02b11384174a618730bc6a07d5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:44.936431 30738 raft_consensus.cc:3060] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.984678 30928 leader_election.cc:290] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.988870 30809 raft_consensus.cc:515] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.990320 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872199f9f7ed455c87ae9d8c3c77f9ab" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:44.991219 30736 raft_consensus.cc:3060] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.991583 30892 raft_consensus.cc:515] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.992690 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:44.993304 30737 raft_consensus.cc:3060] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.993718 30892 leader_election.cc:290] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:44.994519 30881 raft_consensus.cc:493] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.995502 30881 raft_consensus.cc:515] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.997539 30881 leader_election.cc:290] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:44.994935 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:44.998504 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872199f9f7ed455c87ae9d8c3c77f9ab" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:44.998658 30735 raft_consensus.cc:3060] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.999176 30588 raft_consensus.cc:3060] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.998859 30913 raft_consensus.cc:515] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.000628 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28e7b02b11384174a618730bc6a07d5e" is_pre_election: true
I20260709 12:13:45.002787 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8175854989d74380aac6a42a4d631808" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:44.998562 30488 catalog_manager.cc:5697] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 1 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.003453 30589 raft_consensus.cc:2468] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 0.
I20260709 12:13:45.004606 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:45.004714 30705 leader_election.cc:304] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:45.005348 30587 raft_consensus.cc:3060] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.006104 30881 raft_consensus.cc:2804] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:45.006547 30881 raft_consensus.cc:493] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.006903 30881 raft_consensus.cc:3060] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.008371 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:45.008663 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:45.009070 30664 raft_consensus.cc:2468] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 0.
I20260709 12:13:45.009326 30665 raft_consensus.cc:3060] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.012197 30588 raft_consensus.cc:2468] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:45.013294 30587 raft_consensus.cc:2468] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 1.
I20260709 12:13:45.014289 30913 leader_election.cc:290] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:45.014674 30705 leader_election.cc:304] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:45.016352 30913 raft_consensus.cc:2804] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.017336 30665 raft_consensus.cc:2468] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:45.018301 30913 raft_consensus.cc:697] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Becoming Leader. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:45.018277 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8175854989d74380aac6a42a4d631808" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" is_pre_election: true
I20260709 12:13:45.019198 30663 raft_consensus.cc:2468] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 0.
I20260709 12:13:45.019975 30631 leader_election.cc:304] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:45.020949 30932 raft_consensus.cc:2804] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.021008 30736 raft_consensus.cc:2468] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 1.
I20260709 12:13:45.021512 30932 raft_consensus.cc:697] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:45.022598 30555 leader_election.cc:304] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:45.024034 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:45.024714 30662 raft_consensus.cc:3060] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.024587 30932 consensus_queue.cc:237] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.026137 30926 raft_consensus.cc:2804] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.026692 30926 raft_consensus.cc:697] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:45.026809 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d308c4e27746f5af4abc0025bf0c0d" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:45.027508 30664 raft_consensus.cc:3060] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.023046 30913 consensus_queue.cc:237] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.019250 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:45.027591 30926 consensus_queue.cc:237] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:44.994067 30809 leader_election.cc:290] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:45.033068 30665 raft_consensus.cc:3060] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.041132 30881 raft_consensus.cc:515] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.045396 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8175854989d74380aac6a42a4d631808" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:45.046187 30590 raft_consensus.cc:3060] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.046727 30662 raft_consensus.cc:2468] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 1.
I20260709 12:13:45.047015 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7aa2de38104af2ad409269ad19f00e" is_pre_election: true
I20260709 12:13:45.069180 30737 raft_consensus.cc:2468] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:45.072341 30588 raft_consensus.cc:2393] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7080d73d0ad44ecea8b5c9b7914913ae in current term 1: Already voted for candidate 1c7aa2de38104af2ad409269ad19f00e in this term.
I20260709 12:13:45.073834 30665 raft_consensus.cc:2468] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:45.066201 30735 raft_consensus.cc:2468] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:45.069612 30738 raft_consensus.cc:2468] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 1.
I20260709 12:13:45.047765 30664 raft_consensus.cc:2468] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 1.
I20260709 12:13:45.085786 30590 raft_consensus.cc:2468] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 1.
I20260709 12:13:45.082430 30881 leader_election.cc:290] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:45.090399 30705 leader_election.cc:304] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:45.090914 30631 leader_election.cc:304] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:45.092195 30932 raft_consensus.cc:2749] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:45.093917 30555 leader_election.cc:304] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:45.093379 30881 raft_consensus.cc:2804] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.095114 30881 raft_consensus.cc:697] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Becoming Leader. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:45.095686 30892 raft_consensus.cc:2804] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:45.096216 30892 raft_consensus.cc:697] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:45.096537 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8175854989d74380aac6a42a4d631808" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:45.095960 30881 consensus_queue.cc:237] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.097074 30892 consensus_queue.cc:237] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.097102 30665 raft_consensus.cc:3060] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:45.117547 30488 catalog_manager.cc:5697] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 1 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.119550 30488 catalog_manager.cc:5697] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 1 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.123898 30665 raft_consensus.cc:2468] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 1.
I20260709 12:13:45.123744 30485 catalog_manager.cc:5697] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 28e7b02b11384174a618730bc6a07d5e (127.20.56.67). New cstate: current_term: 1 leader_uuid: "28e7b02b11384174a618730bc6a07d5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.125294 30486 catalog_manager.cc:5697] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 1 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.128427 30486 catalog_manager.cc:5697] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 1 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.129127 30485 catalog_manager.cc:5697] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 28e7b02b11384174a618730bc6a07d5e (127.20.56.67). New cstate: current_term: 1 leader_uuid: "28e7b02b11384174a618730bc6a07d5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.273974 30738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e"
dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
mode: GRACEFUL
new_leader_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:37144
I20260709 12:13:45.274633 30738 raft_consensus.cc:606] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Received request to transfer leadership to TS 1c7aa2de38104af2ad409269ad19f00e
I20260709 12:13:45.280215 30738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47d308c4e27746f5af4abc0025bf0c0d"
dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
mode: GRACEFUL
new_leader_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:37144
I20260709 12:13:45.280742 30738 raft_consensus.cc:606] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Received request to transfer leadership to TS 1c7aa2de38104af2ad409269ad19f00e
I20260709 12:13:45.285910 30665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5957fd8b788149868c5940ed39304cff"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
mode: GRACEFUL
new_leader_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:42192
I20260709 12:13:45.286381 30665 raft_consensus.cc:606] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Received request to transfer leadership to TS 1c7aa2de38104af2ad409269ad19f00e
I20260709 12:13:45.293808 30588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
mode: GRACEFUL
new_leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:34450
I20260709 12:13:45.294294 30588 raft_consensus.cc:606] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Received request to transfer leadership to TS 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:45.299518 30588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
mode: GRACEFUL
new_leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:34450
I20260709 12:13:45.299999 30588 raft_consensus.cc:606] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Received request to transfer leadership to TS 7080d73d0ad44ecea8b5c9b7914913ae
I20260709 12:13:45.348019 30881 consensus_queue.cc:1048] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.361907 30912 consensus_queue.cc:1048] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.381184 30913 raft_consensus.cc:993] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e: : Instructing follower 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:45.381675 30913 raft_consensus.cc:1081] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Signalling peer 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:45.383735 30590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47d308c4e27746f5af4abc0025bf0c0d"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:13:45.384321 30590 raft_consensus.cc:493] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:45.384115 30902 consensus_queue.cc:1048] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.384761 30590 raft_consensus.cc:3060] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.394304 30590 raft_consensus.cc:515] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.400559 30665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d308c4e27746f5af4abc0025bf0c0d" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:45.401188 30665 raft_consensus.cc:3060] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.400964 30931 consensus_queue.cc:1048] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.408361 30931 consensus_queue.cc:1048] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.409065 30665 raft_consensus.cc:2468] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:45.410264 30590 leader_election.cc:290] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:45.412117 30555 leader_election.cc:304] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:45.413112 30939 raft_consensus.cc:2804] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:45.413599 30939 raft_consensus.cc:697] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:45.414113 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d308c4e27746f5af4abc0025bf0c0d" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:45.414853 30736 raft_consensus.cc:3055] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:45.415371 30736 raft_consensus.cc:740] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:45.414741 30939 consensus_queue.cc:237] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.417268 30736 consensus_queue.cc:260] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.419175 30899 raft_consensus.cc:993] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae: : Instructing follower 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:45.422680 30899 raft_consensus.cc:1081] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Signalling peer 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:45.425015 30590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5957fd8b788149868c5940ed39304cff"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:33042
I20260709 12:13:45.425565 30590 raft_consensus.cc:493] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:45.425927 30590 raft_consensus.cc:3060] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.427359 30926 consensus_queue.cc:1048] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:45.429399 30736 raft_consensus.cc:3060] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.432807 30899 consensus_queue.cc:1048] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:45.436020 30590 raft_consensus.cc:515] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.436757 30736 raft_consensus.cc:2468] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:45.436940 30926 consensus_queue.cc:1048] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.438194 30590 leader_election.cc:290] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:45.448560 30664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957fd8b788149868c5940ed39304cff" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:45.449393 30664 raft_consensus.cc:3055] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:45.449747 30664 raft_consensus.cc:740] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:45.450575 30664 consensus_queue.cc:260] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.451700 30664 raft_consensus.cc:3060] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.452054 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957fd8b788149868c5940ed39304cff" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:45.464951 30926 consensus_queue.cc:1048] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:45.471072 30488 catalog_manager.cc:5697] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 1 to 2, leader changed from 28e7b02b11384174a618730bc6a07d5e (127.20.56.67) to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 2 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.472105 30939 raft_consensus.cc:993] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e: : Instructing follower 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:45.472661 30938 raft_consensus.cc:1081] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Signalling peer 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:45.477994 30662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:50812
I20260709 12:13:45.478668 30662 raft_consensus.cc:493] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:45.479072 30662 raft_consensus.cc:3060] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.485662 30938 consensus_queue.cc:1048] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.489449 30664 raft_consensus.cc:2468] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:45.490762 30555 leader_election.cc:304] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:45.492120 30892 raft_consensus.cc:2804] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:45.492664 30892 raft_consensus.cc:697] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:45.493512 30892 consensus_queue.cc:237] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.495178 30662 raft_consensus.cc:515] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.497478 30662 leader_election.cc:290] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:45.498202 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:45.498844 30590 raft_consensus.cc:3055] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:45.498951 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:45.499168 30590 raft_consensus.cc:740] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:45.499938 30590 consensus_queue.cc:260] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.501094 30590 raft_consensus.cc:3060] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.505204 30902 consensus_queue.cc:1048] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.512907 30590 raft_consensus.cc:2468] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 2.
I20260709 12:13:45.514034 30631 leader_election.cc:304] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:45.515283 30902 raft_consensus.cc:2804] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:45.514168 30488 catalog_manager.cc:5697] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 1 to 2, leader changed from 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66) to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 2 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.515878 30902 raft_consensus.cc:697] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:45.516819 30902 consensus_queue.cc:237] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.522085 30902 consensus_queue.cc:1048] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.529248 30486 catalog_manager.cc:5697] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 1 to 2, leader changed from 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65) to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 2 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.542009 30881 consensus_queue.cc:1048] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.553356 30913 consensus_queue.cc:1048] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.599635 30881 consensus_queue.cc:1048] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.606266 30913 raft_consensus.cc:993] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e: : Instructing follower 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:45.606814 30912 raft_consensus.cc:1081] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Signalling peer 1c7aa2de38104af2ad409269ad19f00e to start an election
I20260709 12:13:45.608577 30587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:13:45.610543 30587 raft_consensus.cc:493] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:45.610953 30587 raft_consensus.cc:3060] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.612461 30881 consensus_queue.cc:1048] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.618350 30587 raft_consensus.cc:515] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.622242 30587 leader_election.cc:290] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Requested vote from peers 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:45.623178 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:45.623817 30738 raft_consensus.cc:3055] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:45.623898 30662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e" candidate_uuid: "1c7aa2de38104af2ad409269ad19f00e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:45.624156 30738 raft_consensus.cc:740] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:45.624562 30662 raft_consensus.cc:3060] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.625100 30738 consensus_queue.cc:260] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.626456 30738 raft_consensus.cc:3060] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.633353 30662 raft_consensus.cc:2468] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:45.633860 30738 raft_consensus.cc:2468] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c7aa2de38104af2ad409269ad19f00e in term 2.
I20260709 12:13:45.634547 30555 leader_election.cc:304] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:45.635272 30892 raft_consensus.cc:2804] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:45.635732 30892 raft_consensus.cc:697] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Becoming Leader. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:45.635628 30938 consensus_queue.cc:1048] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.636659 30892 consensus_queue.cc:237] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.648722 30485 catalog_manager.cc:5697] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e reported cstate change: term changed from 1 to 2, leader changed from 28e7b02b11384174a618730bc6a07d5e (127.20.56.67) to 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65). New cstate: current_term: 2 leader_uuid: "1c7aa2de38104af2ad409269ad19f00e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.649617 30926 consensus_queue.cc:1048] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:45.658996 30926 raft_consensus.cc:993] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e: : Instructing follower 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:45.659508 30892 raft_consensus.cc:1081] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Signalling peer 7080d73d0ad44ecea8b5c9b7914913ae to start an election
I20260709 12:13:45.661306 30664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
 from {username='slave'} at 127.0.0.1:50812
I20260709 12:13:45.661892 30664 raft_consensus.cc:493] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:45.662611 30664 raft_consensus.cc:3060] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.669245 30664 raft_consensus.cc:515] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.671528 30664 leader_election.cc:290] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 28e7b02b11384174a618730bc6a07d5e (127.20.56.67:35849)
I20260709 12:13:45.672667 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:45.672715 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be16b61b8e5f4174918c0f36b05e76fe" candidate_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
I20260709 12:13:45.673638 30587 raft_consensus.cc:3055] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:45.673653 30738 raft_consensus.cc:3060] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.674121 30587 raft_consensus.cc:740] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:45.675001 30587 consensus_queue.cc:260] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.676296 30587 raft_consensus.cc:3060] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.681048 30738 raft_consensus.cc:2468] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 2.
I20260709 12:13:45.682284 30630 leader_election.cc:304] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:45.682977 30902 raft_consensus.cc:2804] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:45.683261 30587 raft_consensus.cc:2468] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7080d73d0ad44ecea8b5c9b7914913ae in term 2.
I20260709 12:13:45.683385 30902 raft_consensus.cc:697] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Becoming Leader. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:45.684590 30902 consensus_queue.cc:237] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:45.690960 30485 catalog_manager.cc:5697] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae reported cstate change: term changed from 1 to 2, leader changed from 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65) to 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66). New cstate: current_term: 2 leader_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.903194 30664 raft_consensus.cc:1275] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:45.905007 30892 consensus_queue.cc:1048] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:45.917848 30738 raft_consensus.cc:1275] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:45.919555 30939 consensus_queue.cc:1048] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:46.023321 30738 raft_consensus.cc:3060] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.032899 30736 raft_consensus.cc:3060] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.036262 30738 raft_consensus.cc:1275] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.037634 30939 consensus_queue.cc:1048] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.041085 30736 raft_consensus.cc:1275] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.043021 30811 consensus_queue.cc:1048] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:46.049659 30664 raft_consensus.cc:1275] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.051865 30892 consensus_queue.cc:1048] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.056077 30587 raft_consensus.cc:1275] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.058604 30928 consensus_queue.cc:1048] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:46.083251 30738 raft_consensus.cc:1275] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.084494 30928 consensus_queue.cc:1048] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.095563 30587 raft_consensus.cc:1275] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Refusing update from remote peer 7080d73d0ad44ecea8b5c9b7914913ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.101191 30811 consensus_queue.cc:1048] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.239064 30664 raft_consensus.cc:1275] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.240363 30926 consensus_queue.cc:1048] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.248510 30736 raft_consensus.cc:1275] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Refusing update from remote peer 1c7aa2de38104af2ad409269ad19f00e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:46.250540 30938 consensus_queue.cc:1048] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:48.311916 30485 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49490:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:13:48.334625 30485 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49490:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:13:48.426046 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:48.482573 31006 tablet.cc:1724] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.498112 31005 tablet.cc:1724] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.507917 31009 tablet.cc:1724] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:13:48.509745 30691 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:031c39bbbe8b475d9fe9e7086d915f8e)
W20260709 12:13:48.553612 30691 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:031c39bbbe8b475d9fe9e7086d915f8e)
W20260709 12:13:48.579921 30691 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:031c39bbbe8b475d9fe9e7086d915f8e)
W20260709 12:13:48.618017 30989 log.cc:927] Time spent T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.003s
I20260709 12:13:48.791935 31009 tablet.cc:1724] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.794776 31033 tablet.cc:1724] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.822587 31036 tablet.cc:1724] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.831641 31006 tablet.cc:1724] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:13:48.835880 31024 log.cc:927] Time spent T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
I20260709 12:13:48.845014 31037 tablet.cc:1724] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.849529 31031 tablet.cc:1724] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.868693 31009 tablet.cc:1724] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.874581 31038 tablet.cc:1724] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.896075 31009 tablet.cc:1724] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.899290 30588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
mode: GRACEFUL
new_leader_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:34456
I20260709 12:13:48.900128 30588 raft_consensus.cc:606] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Received request to transfer leadership to TS 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:48.913378 31044 tablet.cc:1724] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.935111 31006 tablet.cc:1724] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.925187 31039 tablet.cc:1724] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.879124 31045 tablet.cc:1724] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.950632 31005 tablet.cc:1724] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.965293 31038 tablet.cc:1724] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.966667 31036 tablet.cc:1724] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.952911 31031 tablet.cc:1724] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.973912 31046 tablet.cc:1724] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.985726 31039 tablet.cc:1724] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.988371 31038 tablet.cc:1724] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:49.003566 31037 tablet.cc:1724] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:48.989722 31033 tablet.cc:1724] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:49.020548 30663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
mode: GRACEFUL
new_leader_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:42206
I20260709 12:13:49.021207 30663 raft_consensus.cc:606] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Received request to transfer leadership to TS 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:49.023129 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:13:49.024149 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:49.035005 31044 tablet.cc:1724] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:49.038388 30589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750"
dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
mode: GRACEFUL
new_leader_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:34456
I20260709 12:13:49.039155 30589 raft_consensus.cc:606] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Received request to transfer leadership to TS 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:49.040591 31036 tablet.cc:1724] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:49.042619 30663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9"
dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
mode: GRACEFUL
new_leader_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:42206
I20260709 12:13:49.043349 30663 raft_consensus.cc:606] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Received request to transfer leadership to TS 28e7b02b11384174a618730bc6a07d5e
I20260709 12:13:49.047842 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:49.048571 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:49.069885 30486 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e: soft_deleted_table [id=ddf97748e5d6497fae9f8bdf6550242b] alter complete (version 1)
I20260709 12:13:49.100960 31022 raft_consensus.cc:993] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e: : Instructing follower 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:49.101522 31022 raft_consensus.cc:1081] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Signalling peer 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:49.103140 30739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e"
dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:49.103662 30739 raft_consensus.cc:493] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:49.103947 30739 raft_consensus.cc:3060] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.109844 30739 raft_consensus.cc:515] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.111718 30739 leader_election.cc:290] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 3 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:49.112532 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:49.112905 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031c39bbbe8b475d9fe9e7086d915f8e" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:49.113348 30589 raft_consensus.cc:3055] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:49.113503 30663 raft_consensus.cc:3060] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.113711 30589 raft_consensus.cc:740] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:49.114704 30589 consensus_queue.cc:260] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.116132 30589 raft_consensus.cc:3060] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.122148 30663 raft_consensus.cc:2468] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 3.
I20260709 12:13:49.123793 30704 leader_election.cc:304] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:49.124301 30589 raft_consensus.cc:2468] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 3.
I20260709 12:13:49.125052 31020 raft_consensus.cc:2804] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:49.125732 31020 raft_consensus.cc:697] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 3 LEADER]: Becoming Leader. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:49.126955 31020 consensus_queue.cc:237] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.136926 30485 catalog_manager.cc:5697] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e reported cstate change: term changed from 2 to 3, leader changed from 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65) to 28e7b02b11384174a618730bc6a07d5e (127.20.56.67). New cstate: current_term: 3 leader_uuid: "28e7b02b11384174a618730bc6a07d5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.190531 31015 raft_consensus.cc:993] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae: : Instructing follower 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:49.191119 30973 raft_consensus.cc:1081] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Signalling peer 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:49.192710 30739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54"
dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:57692
I20260709 12:13:49.193207 30739 raft_consensus.cc:493] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:49.193526 30739 raft_consensus.cc:3060] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.198988 30739 raft_consensus.cc:515] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.200654 30739 leader_election.cc:290] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 3 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:49.201522 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:49.201679 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55bdc0e1cb924dcba797b753d292bd54" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:49.202178 30589 raft_consensus.cc:3060] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.202262 30663 raft_consensus.cc:3055] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:49.202700 30663 raft_consensus.cc:740] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:49.203362 30663 consensus_queue.cc:260] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.204360 30663 raft_consensus.cc:3060] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.207480 30589 raft_consensus.cc:2468] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 3.
I20260709 12:13:49.208830 30705 leader_election.cc:304] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:49.209573 31020 raft_consensus.cc:2804] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:49.209992 31020 raft_consensus.cc:697] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 3 LEADER]: Becoming Leader. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:49.210791 31020 consensus_queue.cc:237] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.211230 30663 raft_consensus.cc:2468] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 3.
I20260709 12:13:49.217419 30485 catalog_manager.cc:5697] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e reported cstate change: term changed from 2 to 3, leader changed from 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66) to 28e7b02b11384174a618730bc6a07d5e (127.20.56.67). New cstate: current_term: 3 leader_uuid: "28e7b02b11384174a618730bc6a07d5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.422127 30973 raft_consensus.cc:993] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae: : Instructing follower 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:49.422724 31015 raft_consensus.cc:1081] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Signalling peer 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:49.424438 30734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9"
dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:57692
I20260709 12:13:49.425014 30734 raft_consensus.cc:493] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:49.425405 30734 raft_consensus.cc:3060] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.431872 30734 raft_consensus.cc:515] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.433619 30734 leader_election.cc:290] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 3 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:49.434258 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:49.434670 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4da8ffaf9e440ea40ad7bd54994be9" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:49.434919 30589 raft_consensus.cc:3060] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.435272 30663 raft_consensus.cc:3055] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:49.435582 30663 raft_consensus.cc:740] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7080d73d0ad44ecea8b5c9b7914913ae, State: Running, Role: LEADER
I20260709 12:13:49.436278 30663 consensus_queue.cc:260] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.437335 30663 raft_consensus.cc:3060] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.441215 30589 raft_consensus.cc:2468] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 3.
I20260709 12:13:49.442243 30705 leader_election.cc:304] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7aa2de38104af2ad409269ad19f00e, 28e7b02b11384174a618730bc6a07d5e; no voters: 
I20260709 12:13:49.443054 31020 raft_consensus.cc:2804] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:49.443523 31020 raft_consensus.cc:697] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 3 LEADER]: Becoming Leader. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:49.444113 30663 raft_consensus.cc:2468] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 3.
I20260709 12:13:49.444476 31020 consensus_queue.cc:237] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.445732 31021 raft_consensus.cc:993] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e: : Instructing follower 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:49.446295 31021 raft_consensus.cc:1081] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Signalling peer 28e7b02b11384174a618730bc6a07d5e to start an election
I20260709 12:13:49.447865 30734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750"
dest_uuid: "28e7b02b11384174a618730bc6a07d5e"
 from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:49.448328 30734 raft_consensus.cc:493] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:49.448653 30734 raft_consensus.cc:3060] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.453917 30734 raft_consensus.cc:515] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.456530 30589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c7aa2de38104af2ad409269ad19f00e"
I20260709 12:13:49.456571 30734 leader_election.cc:290] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 2 election: Requested vote from peers 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829), 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833)
I20260709 12:13:49.457213 30589 raft_consensus.cc:3055] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:49.457743 30589 raft_consensus.cc:740] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c7aa2de38104af2ad409269ad19f00e, State: Running, Role: LEADER
I20260709 12:13:49.457131 30663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f49cd1c6fc4a443f9693d0399bbb3750" candidate_uuid: "28e7b02b11384174a618730bc6a07d5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7080d73d0ad44ecea8b5c9b7914913ae"
I20260709 12:13:49.458796 30663 raft_consensus.cc:3060] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.458622 30589 consensus_queue.cc:260] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.460057 30589 raft_consensus.cc:3060] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.459904 30485 catalog_manager.cc:5697] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e reported cstate change: term changed from 2 to 3, leader changed from 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66) to 28e7b02b11384174a618730bc6a07d5e (127.20.56.67). New cstate: current_term: 3 leader_uuid: "28e7b02b11384174a618730bc6a07d5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.465734 30663 raft_consensus.cc:2468] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 2.
I20260709 12:13:49.467216 30704 leader_election.cc:304] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28e7b02b11384174a618730bc6a07d5e, 7080d73d0ad44ecea8b5c9b7914913ae; no voters: 
I20260709 12:13:49.468067 30589 raft_consensus.cc:2468] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28e7b02b11384174a618730bc6a07d5e in term 2.
I20260709 12:13:49.468253 31020 raft_consensus.cc:2804] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:49.468885 31020 raft_consensus.cc:697] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 2 LEADER]: Becoming Leader. State: Replica: 28e7b02b11384174a618730bc6a07d5e, State: Running, Role: LEADER
I20260709 12:13:49.469884 31020 consensus_queue.cc:237] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } }
I20260709 12:13:49.477286 30485 catalog_manager.cc:5697] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e reported cstate change: term changed from 1 to 2, leader changed from 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65) to 28e7b02b11384174a618730bc6a07d5e (127.20.56.67). New cstate: current_term: 2 leader_uuid: "28e7b02b11384174a618730bc6a07d5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28e7b02b11384174a618730bc6a07d5e" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 35849 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:49.638247 30661 raft_consensus.cc:1275] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:49.639515 31020 consensus_queue.cc:1048] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:49.645097 30587 raft_consensus.cc:1275] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:49.647203 30912 consensus_queue.cc:1048] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:49.653822 30663 raft_consensus.cc:1275] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:49.659034 31020 consensus_queue.cc:1048] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:49.670053 30587 raft_consensus.cc:1275] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:49.671614 31020 consensus_queue.cc:1048] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:49.826311 30661 raft_consensus.cc:1275] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:49.827759 31020 consensus_queue.cc:1048] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:49.837419 30587 raft_consensus.cc:1275] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:49.840847 31020 consensus_queue.cc:1048] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:49.939486 30587 raft_consensus.cc:1275] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:49.940757 31020 consensus_queue.cc:1048] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7aa2de38104af2ad409269ad19f00e" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:49.951798 30663 raft_consensus.cc:1275] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Refusing update from remote peer 28e7b02b11384174a618730bc6a07d5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:49.953222 30912 consensus_queue.cc:1048] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7080d73d0ad44ecea8b5c9b7914913ae" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:50.049726 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:50.055166 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:50.055605 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:50.060221 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:50.060691 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:51.061698 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:51.067220 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:51.067718 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:51.072393 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:51.072818 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:52.073845 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:52.078985 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:52.079464 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:52.084105 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:52.084517 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:53.085628 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:53.091892 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:53.092444 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:53.098488 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:53.098981 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:54.100059 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:54.105613 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:54.106038 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:54.110894 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:54.111253 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:55.112108 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:55.117429 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:55.117878 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:55.125245 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:55.125730 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:56.127061 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:56.135105 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:56.135507 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:56.144297 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:56.144942 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:57.146287 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:57.151836 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:57.152309 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:57.156991 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:57.157445 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:58.158516 20705 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:58.163652 20705 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:58.164155 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:58.169615 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:58.170151 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:59.226648 20705 tablet_server.cc:179] TabletServer@127.20.56.65:0 shutting down...
W20260709 12:13:59.241780 30631 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 12:13:59.251127 30631 consensus_peers.cc:597] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae -> Peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Couldn't send request to peer 1c7aa2de38104af2ad409269ad19f00e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.278699 30631 consensus_peers.cc:597] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae -> Peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Couldn't send request to peer 1c7aa2de38104af2ad409269ad19f00e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.279019 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:59.279838 20705 tablet_replica.cc:333] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.282169 20705 raft_consensus.cc:2243] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.283030 20705 raft_consensus.cc:2272] T 872199f9f7ed455c87ae9d8c3c77f9ab P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.286547 20705 tablet_replica.cc:333] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.287530 20705 raft_consensus.cc:2243] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.288147 20705 raft_consensus.cc:2272] T be16b61b8e5f4174918c0f36b05e76fe P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.290699 20705 tablet_replica.cc:333] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.291354 20705 raft_consensus.cc:2243] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.292366 20705 raft_consensus.cc:2272] T 5957fd8b788149868c5940ed39304cff P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.294970 20705 tablet_replica.cc:333] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.295567 20705 raft_consensus.cc:2243] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.296053 20705 raft_consensus.cc:2272] T 031c39bbbe8b475d9fe9e7086d915f8e P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.298328 20705 tablet_replica.cc:333] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.298981 20705 raft_consensus.cc:2243] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.299887 20705 raft_consensus.cc:2272] T 47d308c4e27746f5af4abc0025bf0c0d P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.302526 20705 tablet_replica.cc:333] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.303185 20705 raft_consensus.cc:2243] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.304188 20705 raft_consensus.cc:2272] T 70b71b015e47483a9cda60722b2dcba2 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.306911 20705 tablet_replica.cc:333] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.307487 20705 raft_consensus.cc:2243] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.308418 20705 raft_consensus.cc:2272] T 1b398442b4934b51bd0b32e3dc08bbfc P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.310846 20705 tablet_replica.cc:333] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.311467 20705 raft_consensus.cc:2243] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.312038 20705 raft_consensus.cc:2272] T 8175854989d74380aac6a42a4d631808 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.314532 20705 tablet_replica.cc:333] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.315122 20705 raft_consensus.cc:2243] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.316111 20705 raft_consensus.cc:2272] T c8954a56efd64deabd904e0cfc8f5e9f P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.318938 20705 tablet_replica.cc:333] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.319543 20705 raft_consensus.cc:2243] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.320036 20705 raft_consensus.cc:2272] T f2ecf66b1bc048938456e496c030a992 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.322389 20705 tablet_replica.cc:333] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.322964 20705 raft_consensus.cc:2243] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.323452 20705 raft_consensus.cc:2272] T f49cd1c6fc4a443f9693d0399bbb3750 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.326663 20705 tablet_replica.cc:333] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.327553 20705 raft_consensus.cc:2243] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.328282 20705 raft_consensus.cc:2272] T 55bdc0e1cb924dcba797b753d292bd54 P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.330929 20705 tablet_replica.cc:333] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.331663 20705 raft_consensus.cc:2243] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.332751 20705 raft_consensus.cc:2272] T 7026d97b6d9b4e30b780f9755e68e075 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.335305 20705 tablet_replica.cc:333] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.335839 20705 raft_consensus.cc:2243] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.336367 20705 raft_consensus.cc:2272] T e52d6afc2c11471a8041ddf87f0777c0 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.339038 20705 tablet_replica.cc:333] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.339584 20705 raft_consensus.cc:2243] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.340083 20705 raft_consensus.cc:2272] T fc4da8ffaf9e440ea40ad7bd54994be9 P 1c7aa2de38104af2ad409269ad19f00e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.342553 20705 tablet_replica.cc:333] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.343320 20705 raft_consensus.cc:2243] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.344008 20705 raft_consensus.cc:2272] T 7ff1d209edf948f6b262b265de0bdff8 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.347002 20705 tablet_replica.cc:333] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.347501 20705 raft_consensus.cc:2243] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.348013 20705 raft_consensus.cc:2272] T 775d5a7c35364a83bbc17334b67a51b1 P 1c7aa2de38104af2ad409269ad19f00e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.350354 20705 tablet_replica.cc:333] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e: stopping tablet replica
I20260709 12:13:59.350824 20705 raft_consensus.cc:2243] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.351291 20705 raft_consensus.cc:2272] T 03907c95f073409399d08fff594fad21 P 1c7aa2de38104af2ad409269ad19f00e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.383770 30556 connection.cc:466] server connection from 127.0.0.1:33048 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33048 (request call id 180) could send its response
W20260709 12:13:59.384851 30705 consensus_peers.cc:597] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e -> Peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Couldn't send request to peer 1c7aa2de38104af2ad409269ad19f00e. Status: Network error: recv got EOF from 127.20.56.65:46829 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.390591 30705 consensus_peers.cc:597] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e -> Peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Couldn't send request to peer 1c7aa2de38104af2ad409269ad19f00e. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.403024 20705 tablet_server.cc:196] TabletServer@127.20.56.65:0 shutdown complete.
I20260709 12:13:59.448015 20705 tablet_server.cc:179] TabletServer@127.20.56.66:0 shutting down...
W20260709 12:13:59.468154 30704 consensus_peers.cc:597] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e -> Peer 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833): Couldn't send request to peer 7080d73d0ad44ecea8b5c9b7914913ae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.483186 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:59.484041 20705 tablet_replica.cc:333] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.484956 20705 raft_consensus.cc:2243] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.485654 20705 raft_consensus.cc:2272] T 031c39bbbe8b475d9fe9e7086d915f8e P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.488215 20705 tablet_replica.cc:333] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.489008 20705 raft_consensus.cc:2243] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.489974 20705 raft_consensus.cc:2272] T be16b61b8e5f4174918c0f36b05e76fe P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.492333 20705 tablet_replica.cc:333] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.492921 20705 raft_consensus.cc:2243] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.493825 20705 raft_consensus.cc:2272] T 872199f9f7ed455c87ae9d8c3c77f9ab P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.496126 20705 tablet_replica.cc:333] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.496790 20705 raft_consensus.cc:2243] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.497277 20705 raft_consensus.cc:2272] T 7026d97b6d9b4e30b780f9755e68e075 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.499642 20705 tablet_replica.cc:333] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.500216 20705 raft_consensus.cc:2243] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.500700 20705 raft_consensus.cc:2272] T 55bdc0e1cb924dcba797b753d292bd54 P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.502955 20705 tablet_replica.cc:333] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.503486 20705 raft_consensus.cc:2243] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.504024 20705 raft_consensus.cc:2272] T 5957fd8b788149868c5940ed39304cff P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.506271 20705 tablet_replica.cc:333] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.506850 20705 raft_consensus.cc:2243] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.507319 20705 raft_consensus.cc:2272] T fc4da8ffaf9e440ea40ad7bd54994be9 P 7080d73d0ad44ecea8b5c9b7914913ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.509497 20705 tablet_replica.cc:333] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.510102 20705 raft_consensus.cc:2243] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.510661 20705 raft_consensus.cc:2272] T f2ecf66b1bc048938456e496c030a992 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.512799 20705 tablet_replica.cc:333] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.513300 20705 raft_consensus.cc:2243] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.513788 20705 raft_consensus.cc:2272] T f49cd1c6fc4a443f9693d0399bbb3750 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.516044 20705 tablet_replica.cc:333] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.516542 20705 raft_consensus.cc:2243] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.517647 20705 raft_consensus.cc:2272] T 03907c95f073409399d08fff594fad21 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.520826 20705 tablet_replica.cc:333] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.521489 20705 raft_consensus.cc:2243] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.522203 20705 raft_consensus.cc:2272] T 8175854989d74380aac6a42a4d631808 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.525108 20705 tablet_replica.cc:333] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.525645 20705 raft_consensus.cc:2243] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.526125 20705 raft_consensus.cc:2272] T c8954a56efd64deabd904e0cfc8f5e9f P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.528319 20705 tablet_replica.cc:333] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.528779 20705 raft_consensus.cc:2243] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.529232 20705 raft_consensus.cc:2272] T 47d308c4e27746f5af4abc0025bf0c0d P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.531565 20705 tablet_replica.cc:333] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.532172 20705 raft_consensus.cc:2243] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.532752 20705 raft_consensus.cc:2272] T 1b398442b4934b51bd0b32e3dc08bbfc P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.533712 30704 consensus_peers.cc:597] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e -> Peer 7080d73d0ad44ecea8b5c9b7914913ae (127.20.56.66:44833): Couldn't send request to peer 7080d73d0ad44ecea8b5c9b7914913ae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.535221 20705 tablet_replica.cc:333] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.535898 20705 raft_consensus.cc:2243] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.536401 20705 raft_consensus.cc:2272] T 70b71b015e47483a9cda60722b2dcba2 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.538913 20705 tablet_replica.cc:333] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.539455 20705 raft_consensus.cc:2243] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.540416 20705 raft_consensus.cc:2272] T e52d6afc2c11471a8041ddf87f0777c0 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.542706 20705 tablet_replica.cc:333] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.543251 20705 raft_consensus.cc:2243] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.544091 20705 raft_consensus.cc:2272] T 7ff1d209edf948f6b262b265de0bdff8 P 7080d73d0ad44ecea8b5c9b7914913ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.546655 20705 tablet_replica.cc:333] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae: stopping tablet replica
I20260709 12:13:59.547219 20705 raft_consensus.cc:2243] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.548202 20705 raft_consensus.cc:2272] T 775d5a7c35364a83bbc17334b67a51b1 P 7080d73d0ad44ecea8b5c9b7914913ae [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:59.549266 30705 consensus_peers.cc:597] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e -> Peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Couldn't send request to peer 1c7aa2de38104af2ad409269ad19f00e. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.592350 20705 tablet_server.cc:196] TabletServer@127.20.56.66:0 shutdown complete.
I20260709 12:13:59.631871 20705 tablet_server.cc:179] TabletServer@127.20.56.67:0 shutting down...
W20260709 12:13:59.664963 30705 consensus_peers.cc:597] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e -> Peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Couldn't send request to peer 1c7aa2de38104af2ad409269ad19f00e. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.666143 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:59.667099 20705 tablet_replica.cc:333] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.667793 20705 raft_consensus.cc:2243] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.668340 20705 raft_consensus.cc:2272] T 5957fd8b788149868c5940ed39304cff P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.670644 20705 tablet_replica.cc:333] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.671324 20705 raft_consensus.cc:2243] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.671846 20705 raft_consensus.cc:2272] T 872199f9f7ed455c87ae9d8c3c77f9ab P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.674049 20705 tablet_replica.cc:333] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.674723 20705 raft_consensus.cc:2243] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.675766 20705 raft_consensus.cc:2272] T 031c39bbbe8b475d9fe9e7086d915f8e P 28e7b02b11384174a618730bc6a07d5e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.678117 20705 tablet_replica.cc:333] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.678768 20705 raft_consensus.cc:2243] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.679641 20705 raft_consensus.cc:2272] T 8175854989d74380aac6a42a4d631808 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.681638 20705 tablet_replica.cc:333] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.682199 20705 raft_consensus.cc:2243] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.682695 20705 raft_consensus.cc:2272] T c8954a56efd64deabd904e0cfc8f5e9f P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.684916 20705 tablet_replica.cc:333] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.685587 20705 raft_consensus.cc:2243] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.686182 20705 raft_consensus.cc:2272] T 1b398442b4934b51bd0b32e3dc08bbfc P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.689481 20705 tablet_replica.cc:333] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
W20260709 12:13:59.690276 30705 consensus_peers.cc:597] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e -> Peer 1c7aa2de38104af2ad409269ad19f00e (127.20.56.65:46829): Couldn't send request to peer 1c7aa2de38104af2ad409269ad19f00e. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.690301 20705 raft_consensus.cc:2243] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.691049 20705 raft_consensus.cc:2272] T 70b71b015e47483a9cda60722b2dcba2 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.693167 20705 tablet_replica.cc:333] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.693714 20705 raft_consensus.cc:2243] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.694228 20705 raft_consensus.cc:2272] T 47d308c4e27746f5af4abc0025bf0c0d P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.696380 20705 tablet_replica.cc:333] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.696990 20705 raft_consensus.cc:2243] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.697528 20705 raft_consensus.cc:2272] T be16b61b8e5f4174918c0f36b05e76fe P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.699734 20705 tablet_replica.cc:333] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.700371 20705 raft_consensus.cc:2243] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.700762 20705 raft_consensus.cc:2272] T 03907c95f073409399d08fff594fad21 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.702832 20705 tablet_replica.cc:333] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.703305 20705 raft_consensus.cc:2243] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.704116 20705 raft_consensus.cc:2272] T fc4da8ffaf9e440ea40ad7bd54994be9 P 28e7b02b11384174a618730bc6a07d5e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.706158 20705 tablet_replica.cc:333] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.706720 20705 raft_consensus.cc:2243] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.707114 20705 raft_consensus.cc:2272] T e52d6afc2c11471a8041ddf87f0777c0 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.709019 20705 tablet_replica.cc:333] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.709476 20705 raft_consensus.cc:2243] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.710227 20705 raft_consensus.cc:2272] T 55bdc0e1cb924dcba797b753d292bd54 P 28e7b02b11384174a618730bc6a07d5e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.712312 20705 tablet_replica.cc:333] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.712751 20705 raft_consensus.cc:2243] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.713133 20705 raft_consensus.cc:2272] T 7026d97b6d9b4e30b780f9755e68e075 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.715097 20705 tablet_replica.cc:333] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.715536 20705 raft_consensus.cc:2243] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.716029 20705 raft_consensus.cc:2272] T 7ff1d209edf948f6b262b265de0bdff8 P 28e7b02b11384174a618730bc6a07d5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.718225 20705 tablet_replica.cc:333] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.718745 20705 raft_consensus.cc:2243] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:59.719215 20705 raft_consensus.cc:2272] T 775d5a7c35364a83bbc17334b67a51b1 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.721203 20705 tablet_replica.cc:333] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.721693 20705 raft_consensus.cc:2243] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.722589 20705 raft_consensus.cc:2272] T f2ecf66b1bc048938456e496c030a992 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.724654 20705 tablet_replica.cc:333] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e: stopping tablet replica
I20260709 12:13:59.725106 20705 raft_consensus.cc:2243] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.725988 20705 raft_consensus.cc:2272] T f49cd1c6fc4a443f9693d0399bbb3750 P 28e7b02b11384174a618730bc6a07d5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.769060 20705 tablet_server.cc:196] TabletServer@127.20.56.67:0 shutdown complete.
I20260709 12:13:59.807955 20705 master.cc:562] Master@127.20.56.126:40845 shutting down...
I20260709 12:13:59.835238 20705 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:59.836256 20705 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.836762 20705 tablet_replica.cc:333] T 00000000000000000000000000000000 P 231bf61d7df74645895805718ea7a52e: stopping tablet replica
I20260709 12:13:59.859261 20705 master.cc:584] Master@127.20.56.126:40845 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20724 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:13:59.912019 20705 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.56.126:46635
I20260709 12:13:59.913192 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:59.918574 31088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:59.918589 31089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:59.920115 31091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:59.920917 20705 server_base.cc:1061] running on GCE node
I20260709 12:13:59.921808 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:59.922025 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:59.922180 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599239922163 us; error 0 us; skew 500 ppm
I20260709 12:13:59.922742 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:59.925149 20705 webserver.cc:533] Webserver started at http://127.20.56.126:35757/ using document root <none> and password file <none>
I20260709 12:13:59.925668 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:59.925871 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:59.926142 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:59.927706 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/master-0-root/instance:
uuid: "f3ecfdce122347649353e66cf8ff3f8c"
format_stamp: "Formatted at 2026-07-09 12:13:59 on dist-test-slave-2dwh"
I20260709 12:13:59.932044 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:13:59.935485 31096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:59.936540 20705 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:13:59.936892 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/master-0-root
uuid: "f3ecfdce122347649353e66cf8ff3f8c"
format_stamp: "Formatted at 2026-07-09 12:13:59 on dist-test-slave-2dwh"
I20260709 12:13:59.937161 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:59.964660 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:59.965903 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:00.005842 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.126:46635
I20260709 12:14:00.005949 31147 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.126:46635 every 8 connection(s)
I20260709 12:14:00.010082 31148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.021751 31148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c: Bootstrap starting.
I20260709 12:14:00.027159 31148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.031646 31148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c: No bootstrap required, opened a new log
I20260709 12:14:00.033870 31148 raft_consensus.cc:359] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ecfdce122347649353e66cf8ff3f8c" member_type: VOTER }
I20260709 12:14:00.034281 31148 raft_consensus.cc:385] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.034487 31148 raft_consensus.cc:740] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ecfdce122347649353e66cf8ff3f8c, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.035131 31148 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ecfdce122347649353e66cf8ff3f8c" member_type: VOTER }
I20260709 12:14:00.035547 31148 raft_consensus.cc:399] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:00.035745 31148 raft_consensus.cc:493] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:00.035956 31148 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.040813 31148 raft_consensus.cc:515] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ecfdce122347649353e66cf8ff3f8c" member_type: VOTER }
I20260709 12:14:00.041266 31148 leader_election.cc:304] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3ecfdce122347649353e66cf8ff3f8c; no voters: 
I20260709 12:14:00.042333 31148 leader_election.cc:290] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:00.042797 31151 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:00.044133 31151 raft_consensus.cc:697] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 1 LEADER]: Becoming Leader. State: Replica: f3ecfdce122347649353e66cf8ff3f8c, State: Running, Role: LEADER
I20260709 12:14:00.044826 31151 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ecfdce122347649353e66cf8ff3f8c" member_type: VOTER }
I20260709 12:14:00.045351 31148 sys_catalog.cc:565] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:00.049459 31152 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3ecfdce122347649353e66cf8ff3f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ecfdce122347649353e66cf8ff3f8c" member_type: VOTER } }
I20260709 12:14:00.049625 31153 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3ecfdce122347649353e66cf8ff3f8c. Latest consensus state: current_term: 1 leader_uuid: "f3ecfdce122347649353e66cf8ff3f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3ecfdce122347649353e66cf8ff3f8c" member_type: VOTER } }
I20260709 12:14:00.050300 31152 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:00.050554 31153 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:00.055361 31157 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:00.060464 31157 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:00.063762 20705 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:00.069482 31157 catalog_manager.cc:1383] Generated new cluster ID: 4c179656cb9b466f98923f64567caa73
I20260709 12:14:00.069763 31157 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:00.103178 31157 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:00.104552 31157 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:00.131736 31157 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c: Generated new TSK 0
I20260709 12:14:00.132382 31157 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:00.195052 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:00.200829 31169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:00.201978 31170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:00.203496 20705 server_base.cc:1061] running on GCE node
W20260709 12:14:00.203680 31172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:00.204649 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:00.204838 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:00.204989 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599240204977 us; error 0 us; skew 500 ppm
I20260709 12:14:00.205454 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:00.207651 20705 webserver.cc:533] Webserver started at http://127.20.56.65:33909/ using document root <none> and password file <none>
I20260709 12:14:00.208076 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:00.208220 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:00.208427 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:00.209446 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-0-root/instance:
uuid: "66a655080eee468baa6cd2a0cc015020"
format_stamp: "Formatted at 2026-07-09 12:14:00 on dist-test-slave-2dwh"
I20260709 12:14:00.213636 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:14:00.216784 31177 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.217525 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:00.217818 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-0-root
uuid: "66a655080eee468baa6cd2a0cc015020"
format_stamp: "Formatted at 2026-07-09 12:14:00 on dist-test-slave-2dwh"
I20260709 12:14:00.218088 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:00.230020 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:00.231346 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:00.232847 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:00.235172 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:00.235392 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.235631 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:00.235828 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.276727 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.65:41421
I20260709 12:14:00.276831 31239 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.65:41421 every 8 connection(s)
I20260709 12:14:00.281783 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:00.288628 31244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:00.290831 31245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:00.293061 20705 server_base.cc:1061] running on GCE node
W20260709 12:14:00.293579 31247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:00.295100 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:14:00.295164 31240 heartbeater.cc:344] Connected to a master server at 127.20.56.126:46635
W20260709 12:14:00.295346 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:00.295652 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599240295630 us; error 0 us; skew 500 ppm
I20260709 12:14:00.295696 31240 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:00.296283 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:00.296573 31240 heartbeater.cc:507] Master 127.20.56.126:46635 requested a full tablet report, sending...
I20260709 12:14:00.299079 31113 ts_manager.cc:194] Registered new tserver with Master: 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421)
I20260709 12:14:00.299157 20705 webserver.cc:533] Webserver started at http://127.20.56.66:35469/ using document root <none> and password file <none>
I20260709 12:14:00.299853 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:00.300077 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:00.300343 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:00.301115 31113 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52116
I20260709 12:14:00.301559 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-1-root/instance:
uuid: "77972579842b4256b07d8d95e2026c79"
format_stamp: "Formatted at 2026-07-09 12:14:00 on dist-test-slave-2dwh"
I20260709 12:14:00.306224 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:14:00.309489 31252 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.310273 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:00.310593 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-1-root
uuid: "77972579842b4256b07d8d95e2026c79"
format_stamp: "Formatted at 2026-07-09 12:14:00 on dist-test-slave-2dwh"
I20260709 12:14:00.310895 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:00.325980 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:00.327240 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:00.328665 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:00.331003 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:00.331225 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.331463 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:00.331637 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.372222 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.66:38781
I20260709 12:14:00.372334 31314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.66:38781 every 8 connection(s)
I20260709 12:14:00.377252 20705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:00.385684 31319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:00.387318 31318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:00.389278 31321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:00.390583 20705 server_base.cc:1061] running on GCE node
I20260709 12:14:00.391776 20705 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:00.392002 20705 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:00.392004 31315 heartbeater.cc:344] Connected to a master server at 127.20.56.126:46635
I20260709 12:14:00.392270 20705 hybrid_clock.cc:648] HybridClock initialized: now 1783599240392251 us; error 0 us; skew 500 ppm
I20260709 12:14:00.392653 31315 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:00.393041 20705 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:00.393476 31315 heartbeater.cc:507] Master 127.20.56.126:46635 requested a full tablet report, sending...
I20260709 12:14:00.395615 20705 webserver.cc:533] Webserver started at http://127.20.56.67:36649/ using document root <none> and password file <none>
I20260709 12:14:00.395937 31113 ts_manager.cc:194] Registered new tserver with Master: 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:00.396345 20705 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:00.396667 20705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:00.396996 20705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:00.397812 31113 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52132
I20260709 12:14:00.398571 20705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-2-root/instance:
uuid: "2c10d756449b40a7a756e47931f0cab1"
format_stamp: "Formatted at 2026-07-09 12:14:00 on dist-test-slave-2dwh"
I20260709 12:14:00.403074 20705 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:14:00.406584 31326 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.407357 20705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:14:00.407699 20705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-2-root
uuid: "2c10d756449b40a7a756e47931f0cab1"
format_stamp: "Formatted at 2026-07-09 12:14:00 on dist-test-slave-2dwh"
I20260709 12:14:00.408010 20705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task37jmSM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895630772-20705-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:00.424026 20705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:00.425414 20705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:00.427102 20705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:00.429528 20705 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:00.429804 20705 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.430075 20705 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:00.430279 20705 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.473438 20705 rpc_server.cc:307] RPC server started. Bound to: 127.20.56.67:32899
I20260709 12:14:00.473533 31388 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.56.67:32899 every 8 connection(s)
I20260709 12:14:00.487766 31389 heartbeater.cc:344] Connected to a master server at 127.20.56.126:46635
I20260709 12:14:00.488184 31389 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:00.488864 31389 heartbeater.cc:507] Master 127.20.56.126:46635 requested a full tablet report, sending...
I20260709 12:14:00.490983 31113 ts_manager.cc:194] Registered new tserver with Master: 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:00.491549 20705 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01447265s
I20260709 12:14:00.492388 31113 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52148
I20260709 12:14:00.516899 31113 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52154:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:00.519747 31113 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:00.592464 31205 tablet_service.cc:1511] Processing CreateTablet for tablet fbc151f3076c47c9a28851205ca739af (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:00.592756 31204 tablet_service.cc:1511] Processing CreateTablet for tablet 489237d9c34c4f04be8287bef9ddcfa9 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:00.594007 31205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc151f3076c47c9a28851205ca739af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.594810 31204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489237d9c34c4f04be8287bef9ddcfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.600432 31203 tablet_service.cc:1511] Processing CreateTablet for tablet 21e3f90ab38b4133a52ef03dba456b64 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:00.601938 31203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e3f90ab38b4133a52ef03dba456b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.601780 31202 tablet_service.cc:1511] Processing CreateTablet for tablet 4e92a3344a454901ac15091909781083 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:00.603250 31202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e92a3344a454901ac15091909781083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.603868 31280 tablet_service.cc:1511] Processing CreateTablet for tablet fbc151f3076c47c9a28851205ca739af (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:00.605305 31280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc151f3076c47c9a28851205ca739af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.607555 31279 tablet_service.cc:1511] Processing CreateTablet for tablet 489237d9c34c4f04be8287bef9ddcfa9 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:00.608603 31276 tablet_service.cc:1511] Processing CreateTablet for tablet 7abb74109ca748499bdcfda11938b772 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:00.610447 31278 tablet_service.cc:1511] Processing CreateTablet for tablet 21e3f90ab38b4133a52ef03dba456b64 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:00.612012 31200 tablet_service.cc:1511] Processing CreateTablet for tablet 606a4579d4324331a1e639105f033a8e (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:00.612668 31277 tablet_service.cc:1511] Processing CreateTablet for tablet 4e92a3344a454901ac15091909781083 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:00.613379 31200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606a4579d4324331a1e639105f033a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.609078 31201 tablet_service.cc:1511] Processing CreateTablet for tablet 7abb74109ca748499bdcfda11938b772 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:00.609021 31279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489237d9c34c4f04be8287bef9ddcfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.617602 31278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e3f90ab38b4133a52ef03dba456b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.618216 31275 tablet_service.cc:1511] Processing CreateTablet for tablet 606a4579d4324331a1e639105f033a8e (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:00.619632 31275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606a4579d4324331a1e639105f033a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.622741 31277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e92a3344a454901ac15091909781083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.623690 31274 tablet_service.cc:1511] Processing CreateTablet for tablet 18f1a2555c7847668ac6afbe2469e361 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:00.625120 31274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f1a2555c7847668ac6afbe2469e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.626788 31276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abb74109ca748499bdcfda11938b772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.629189 31273 tablet_service.cc:1511] Processing CreateTablet for tablet b3861db98a2c42cea249f3f25dca4490 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:00.630640 31273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3861db98a2c42cea249f3f25dca4490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.630736 31201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abb74109ca748499bdcfda11938b772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.633435 31272 tablet_service.cc:1511] Processing CreateTablet for tablet 3763069f09b340458156360dd9eba15a (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:00.634106 31354 tablet_service.cc:1511] Processing CreateTablet for tablet fbc151f3076c47c9a28851205ca739af (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:00.636312 31198 tablet_service.cc:1511] Processing CreateTablet for tablet b3861db98a2c42cea249f3f25dca4490 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:00.635568 31354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc151f3076c47c9a28851205ca739af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.637446 31199 tablet_service.cc:1511] Processing CreateTablet for tablet 18f1a2555c7847668ac6afbe2469e361 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:00.637916 31198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3861db98a2c42cea249f3f25dca4490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.636945 31272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3763069f09b340458156360dd9eba15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.638794 31199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f1a2555c7847668ac6afbe2469e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.648576 31197 tablet_service.cc:1511] Processing CreateTablet for tablet 3763069f09b340458156360dd9eba15a (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:00.650177 31197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3763069f09b340458156360dd9eba15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.655745 31353 tablet_service.cc:1511] Processing CreateTablet for tablet 489237d9c34c4f04be8287bef9ddcfa9 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:00.657322 31353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489237d9c34c4f04be8287bef9ddcfa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.676712 31352 tablet_service.cc:1511] Processing CreateTablet for tablet 21e3f90ab38b4133a52ef03dba456b64 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:00.678232 31352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e3f90ab38b4133a52ef03dba456b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.687713 31351 tablet_service.cc:1511] Processing CreateTablet for tablet 4e92a3344a454901ac15091909781083 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:00.689821 31351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e92a3344a454901ac15091909781083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.697527 31350 tablet_service.cc:1511] Processing CreateTablet for tablet 7abb74109ca748499bdcfda11938b772 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:00.699081 31350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abb74109ca748499bdcfda11938b772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.704339 31349 tablet_service.cc:1511] Processing CreateTablet for tablet 606a4579d4324331a1e639105f033a8e (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:00.705839 31349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606a4579d4324331a1e639105f033a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.712220 31348 tablet_service.cc:1511] Processing CreateTablet for tablet 18f1a2555c7847668ac6afbe2469e361 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:00.713742 31348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f1a2555c7847668ac6afbe2469e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.715643 31347 tablet_service.cc:1511] Processing CreateTablet for tablet b3861db98a2c42cea249f3f25dca4490 (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:00.717032 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3861db98a2c42cea249f3f25dca4490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.719626 31346 tablet_service.cc:1511] Processing CreateTablet for tablet 3763069f09b340458156360dd9eba15a (DEFAULT_TABLE table=test-workload [id=ac411a0c88b94796b7d45f471533affa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:00.721031 31346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3763069f09b340458156360dd9eba15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:00.766678 31404 tablet_bootstrap.cc:492] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:00.779717 31405 tablet_bootstrap.cc:492] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:00.782539 31406 tablet_bootstrap.cc:492] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:00.787326 31404 tablet_bootstrap.cc:654] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.788811 31406 tablet_bootstrap.cc:654] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.791685 31405 tablet_bootstrap.cc:654] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.800586 31404 tablet_bootstrap.cc:492] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:00.801085 31404 ts_tablet_manager.cc:1403] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.009s
I20260709 12:14:00.807737 31404 raft_consensus.cc:359] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.809078 31404 raft_consensus.cc:385] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.809393 31404 raft_consensus.cc:740] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.809796 31406 tablet_bootstrap.cc:492] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:00.810433 31406 ts_tablet_manager.cc:1403] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.004s
I20260709 12:14:00.810141 31404 consensus_queue.cc:260] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.811510 31405 tablet_bootstrap.cc:492] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:00.812088 31405 ts_tablet_manager.cc:1403] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
I20260709 12:14:00.812505 31240 heartbeater.cc:499] Master 127.20.56.126:46635 was elected leader, sending a full tablet report...
I20260709 12:14:00.812963 31404 ts_tablet_manager.cc:1434] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:14:00.814002 31404 tablet_bootstrap.cc:492] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:00.813954 31406 raft_consensus.cc:359] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.814879 31406 raft_consensus.cc:385] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.815156 31406 raft_consensus.cc:740] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.815137 31405 raft_consensus.cc:359] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.816109 31405 raft_consensus.cc:385] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.816468 31405 raft_consensus.cc:740] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.816215 31406 consensus_queue.cc:260] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.817369 31405 consensus_queue.cc:260] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.821868 31404 tablet_bootstrap.cc:654] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.826067 31315 heartbeater.cc:499] Master 127.20.56.126:46635 was elected leader, sending a full tablet report...
I20260709 12:14:00.827121 31405 ts_tablet_manager.cc:1434] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:14:00.828312 31405 tablet_bootstrap.cc:492] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:00.835119 31405 tablet_bootstrap.cc:654] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.843008 31389 heartbeater.cc:499] Master 127.20.56.126:46635 was elected leader, sending a full tablet report...
I20260709 12:14:00.843518 31406 ts_tablet_manager.cc:1434] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.033s	user 0.015s	sys 0.016s
I20260709 12:14:00.844990 31406 tablet_bootstrap.cc:492] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:00.847574 31404 tablet_bootstrap.cc:492] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:00.848205 31404 ts_tablet_manager.cc:1403] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.008s
I20260709 12:14:00.849272 31405 tablet_bootstrap.cc:492] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:00.849835 31405 ts_tablet_manager.cc:1403] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:14:00.851613 31406 tablet_bootstrap.cc:654] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.851250 31404 raft_consensus.cc:359] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.852068 31404 raft_consensus.cc:385] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.852375 31404 raft_consensus.cc:740] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.853152 31405 raft_consensus.cc:359] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.853420 31404 consensus_queue.cc:260] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.853960 31405 raft_consensus.cc:385] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.854398 31405 raft_consensus.cc:740] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.855410 31405 consensus_queue.cc:260] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.857941 31405 ts_tablet_manager.cc:1434] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:14:00.858800 31404 ts_tablet_manager.cc:1434] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:00.858976 31405 tablet_bootstrap.cc:492] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:00.860388 31404 tablet_bootstrap.cc:492] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:00.866848 31405 tablet_bootstrap.cc:654] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.869194 31406 tablet_bootstrap.cc:492] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:00.869802 31406 ts_tablet_manager.cc:1403] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 12:14:00.870134 31404 tablet_bootstrap.cc:654] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.873054 31406 raft_consensus.cc:359] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.874138 31406 raft_consensus.cc:385] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.874559 31406 raft_consensus.cc:740] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.875818 31406 consensus_queue.cc:260] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
W20260709 12:14:00.876361 31316 tablet.cc:2406] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:00.878286 31406 ts_tablet_manager.cc:1434] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 12:14:00.879649 31406 tablet_bootstrap.cc:492] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:00.884214 31404 tablet_bootstrap.cc:492] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:00.884903 31404 ts_tablet_manager.cc:1403] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.006s
I20260709 12:14:00.886775 31406 tablet_bootstrap.cc:654] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.888067 31404 raft_consensus.cc:359] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.888878 31404 raft_consensus.cc:385] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.889179 31404 raft_consensus.cc:740] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.890312 31404 consensus_queue.cc:260] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.898551 31406 tablet_bootstrap.cc:492] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:00.899147 31406 ts_tablet_manager.cc:1403] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:14:00.902189 31406 raft_consensus.cc:359] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.902992 31406 raft_consensus.cc:385] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.903297 31406 raft_consensus.cc:740] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.903638 31412 raft_consensus.cc:493] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.904204 31412 raft_consensus.cc:515] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.904289 31406 consensus_queue.cc:260] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.904381 31404 ts_tablet_manager.cc:1434] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:14:00.909004 31406 ts_tablet_manager.cc:1434] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:14:00.910135 31406 tablet_bootstrap.cc:492] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:00.911260 31404 tablet_bootstrap.cc:492] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:00.916713 31406 tablet_bootstrap.cc:654] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.917258 31412 leader_election.cc:290] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:00.918532 31404 tablet_bootstrap.cc:654] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.926182 31405 tablet_bootstrap.cc:492] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:00.926934 31405 ts_tablet_manager.cc:1403] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.025s
I20260709 12:14:00.930018 31406 tablet_bootstrap.cc:492] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:00.930855 31406 ts_tablet_manager.cc:1403] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:14:00.930135 31405 raft_consensus.cc:359] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.931469 31405 raft_consensus.cc:385] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.931860 31405 raft_consensus.cc:740] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.932804 31405 consensus_queue.cc:260] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.935532 31405 ts_tablet_manager.cc:1434] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:14:00.935216 31406 raft_consensus.cc:359] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.937604 31406 raft_consensus.cc:385] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.938274 31406 raft_consensus.cc:740] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.939196 31406 consensus_queue.cc:260] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.941687 31406 ts_tablet_manager.cc:1434] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:14:00.942874 31406 tablet_bootstrap.cc:492] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:00.945046 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e92a3344a454901ac15091909781083" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:00.946002 31364 raft_consensus.cc:2468] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:00.946364 31405 tablet_bootstrap.cc:492] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:00.947813 31254 leader_election.cc:304] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:00.948758 31412 raft_consensus.cc:2804] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:00.949150 31412 raft_consensus.cc:493] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.949497 31412 raft_consensus.cc:3060] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.950384 31406 tablet_bootstrap.cc:654] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.956462 31405 tablet_bootstrap.cc:654] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.956550 31404 tablet_bootstrap.cc:492] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:00.957446 31404 ts_tablet_manager.cc:1403] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.026s
I20260709 12:14:00.961243 31404 raft_consensus.cc:359] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.961478 31412 raft_consensus.cc:515] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.962034 31404 raft_consensus.cc:385] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.962361 31404 raft_consensus.cc:740] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.963270 31404 consensus_queue.cc:260] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.966588 31406 tablet_bootstrap.cc:492] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:00.967181 31406 ts_tablet_manager.cc:1403] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.005s
I20260709 12:14:00.970261 31406 raft_consensus.cc:359] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.971040 31406 raft_consensus.cc:385] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.971354 31406 raft_consensus.cc:740] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.972834 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e92a3344a454901ac15091909781083" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:00.974301 31404 ts_tablet_manager.cc:1434] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:14:00.973824 31214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e92a3344a454901ac15091909781083" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:00.975790 31404 tablet_bootstrap.cc:492] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:00.975955 31406 consensus_queue.cc:260] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:00.978482 31406 ts_tablet_manager.cc:1434] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:14:00.979542 31406 tablet_bootstrap.cc:492] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:00.985378 31404 tablet_bootstrap.cc:654] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.987577 31406 tablet_bootstrap.cc:654] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:00.979463 31253 leader_election.cc:343] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:00.994027 31253 leader_election.cc:343] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:01.000101 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e92a3344a454901ac15091909781083" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.000749 31364 raft_consensus.cc:3060] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.006943 31404 tablet_bootstrap.cc:492] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:01.007547 31404 ts_tablet_manager.cc:1403] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.003s
I20260709 12:14:01.009084 31364 raft_consensus.cc:2468] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:01.009964 31412 leader_election.cc:290] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.011397 31254 leader_election.cc:304] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:01.012943 31412 raft_consensus.cc:2804] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.011397 31404 raft_consensus.cc:359] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.013437 31404 raft_consensus.cc:385] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.013782 31404 raft_consensus.cc:740] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.014591 31404 consensus_queue.cc:260] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.015899 31406 tablet_bootstrap.cc:492] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:01.016444 31406 ts_tablet_manager.cc:1403] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.037s	user 0.029s	sys 0.005s
I20260709 12:14:01.016714 31404 ts_tablet_manager.cc:1434] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:01.017278 31405 tablet_bootstrap.cc:492] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:01.017735 31404 tablet_bootstrap.cc:492] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:01.017802 31405 ts_tablet_manager.cc:1403] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.072s	user 0.042s	sys 0.022s
I20260709 12:14:01.019975 31406 raft_consensus.cc:359] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.020771 31406 raft_consensus.cc:385] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.021064 31406 raft_consensus.cc:740] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.022119 31412 raft_consensus.cc:697] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:01.023293 31427 raft_consensus.cc:493] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.023114 31412 consensus_queue.cc:237] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.023799 31427 raft_consensus.cc:515] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.027273 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3861db98a2c42cea249f3f25dca4490" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:01.027220 31406 consensus_queue.cc:260] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.028082 31405 raft_consensus.cc:359] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.028867 31405 raft_consensus.cc:385] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.029152 31405 raft_consensus.cc:740] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.029882 31406 ts_tablet_manager.cc:1434] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:14:01.030026 31405 consensus_queue.cc:260] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.031072 31406 tablet_bootstrap.cc:492] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:01.036015 31405 ts_tablet_manager.cc:1434] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:14:01.037194 31405 tablet_bootstrap.cc:492] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:01.037091 31427 leader_election.cc:290] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.037689 31404 tablet_bootstrap.cc:654] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:01.039613 31254 leader_election.cc:343] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:01.041431 31406 tablet_bootstrap.cc:654] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.047857 31406 tablet_bootstrap.cc:492] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:01.048374 31406 ts_tablet_manager.cc:1403] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.008s
I20260709 12:14:01.048714 31110 catalog_manager.cc:5697] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 1 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.049686 31410 raft_consensus.cc:493] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.050189 31410 raft_consensus.cc:515] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.050799 31214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3861db98a2c42cea249f3f25dca4490" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:01.051491 31406 raft_consensus.cc:359] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.052371 31406 raft_consensus.cc:385] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.052644 31406 raft_consensus.cc:740] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.051474 31214 raft_consensus.cc:2468] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:01.053412 31406 consensus_queue.cc:260] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.054041 31405 tablet_bootstrap.cc:654] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.055881 31406 ts_tablet_manager.cc:1434] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:01.057030 31406 tablet_bootstrap.cc:492] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:01.053426 31404 tablet_bootstrap.cc:492] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:01.058472 31404 ts_tablet_manager.cc:1403] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.000s
W20260709 12:14:01.059989 31161 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:01.062721 31404 raft_consensus.cc:359] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.063786 31404 raft_consensus.cc:385] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.064177 31404 raft_consensus.cc:740] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.065153 31404 consensus_queue.cc:260] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.066308 31410 leader_election.cc:290] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.071090 31253 leader_election.cc:304] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 2c10d756449b40a7a756e47931f0cab1
I20260709 12:14:01.077940 31406 tablet_bootstrap.cc:654] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.084456 31411 raft_consensus.cc:493] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.085031 31411 raft_consensus.cc:515] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.089365 31411 leader_election.cc:290] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:01.096340 31428 raft_consensus.cc:2804] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:01.097643 31428 raft_consensus.cc:493] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.098946 31428 raft_consensus.cc:3060] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.106331 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc151f3076c47c9a28851205ca739af" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:01.107110 31364 raft_consensus.cc:2468] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 0.
I20260709 12:14:01.108753 31179 leader_election.cc:304] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:01.109773 31410 raft_consensus.cc:2804] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:01.110140 31410 raft_consensus.cc:493] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.110491 31410 raft_consensus.cc:3060] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.112612 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc151f3076c47c9a28851205ca739af" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
W20260709 12:14:01.114630 31178 leader_election.cc:343] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:01.118780 31410 raft_consensus.cc:515] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.121202 31405 tablet_bootstrap.cc:492] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:01.121940 31405 ts_tablet_manager.cc:1403] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.085s	user 0.034s	sys 0.036s
I20260709 12:14:01.121989 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc151f3076c47c9a28851205ca739af" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:01.122371 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc151f3076c47c9a28851205ca739af" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.123783 31364 raft_consensus.cc:3060] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.125895 31410 leader_election.cc:290] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
W20260709 12:14:01.126717 31178 leader_election.cc:343] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:01.128719 31404 ts_tablet_manager.cc:1434] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.070s	user 0.012s	sys 0.022s
I20260709 12:14:01.132032 31404 tablet_bootstrap.cc:492] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:01.135231 31405 raft_consensus.cc:359] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.136044 31405 raft_consensus.cc:385] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.136354 31405 raft_consensus.cc:740] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.137123 31405 consensus_queue.cc:260] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.139115 31406 tablet_bootstrap.cc:492] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:01.139675 31406 ts_tablet_manager.cc:1403] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.016s
I20260709 12:14:01.140313 31411 raft_consensus.cc:493] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.140849 31411 raft_consensus.cc:515] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.142789 31405 ts_tablet_manager.cc:1434] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:14:01.142726 31406 raft_consensus.cc:359] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.143592 31406 raft_consensus.cc:385] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.142988 31411 leader_election.cc:290] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:01.143909 31406 raft_consensus.cc:740] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.144017 31405 tablet_bootstrap.cc:492] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:01.146257 31404 tablet_bootstrap.cc:654] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.149516 31406 consensus_queue.cc:260] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.151222 31405 tablet_bootstrap.cc:654] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.152411 31406 ts_tablet_manager.cc:1434] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:14:01.153091 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a4579d4324331a1e639105f033a8e" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:01.153442 31406 tablet_bootstrap.cc:492] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:01.154903 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
W20260709 12:14:01.156602 31327 leader_election.cc:343] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:01.157295 31327 leader_election.cc:343] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:01.158174 31428 raft_consensus.cc:515] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.161228 31214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3861db98a2c42cea249f3f25dca4490" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:01.161811 31214 raft_consensus.cc:3060] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.163962 31412 raft_consensus.cc:493] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.164455 31406 tablet_bootstrap.cc:654] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.164492 31412 raft_consensus.cc:515] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.167562 31412 leader_election.cc:290] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.168358 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3763069f09b340458156360dd9eba15a" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:01.169080 31363 raft_consensus.cc:2468] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:01.170640 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3763069f09b340458156360dd9eba15a" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:01.171330 31215 raft_consensus.cc:2468] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:01.172302 31411 raft_consensus.cc:493] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.172760 31253 leader_election.cc:304] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.173060 31411 raft_consensus.cc:515] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.174165 31412 raft_consensus.cc:2804] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:01.174639 31412 raft_consensus.cc:493] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.175024 31412 raft_consensus.cc:3060] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.176011 31411 leader_election.cc:290] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:01.177096 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb74109ca748499bdcfda11938b772" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:01.177781 31290 raft_consensus.cc:2468] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 0.
I20260709 12:14:01.141036 31364 raft_consensus.cc:2468] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 1.
I20260709 12:14:01.179093 31327 leader_election.cc:304] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.181079 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:01.181969 31213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a4579d4324331a1e639105f033a8e" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
W20260709 12:14:01.182675 31327 leader_election.cc:343] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:01.183225 31327 leader_election.cc:304] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1; no voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79
I20260709 12:14:01.183444 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb74109ca748499bdcfda11938b772" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:01.184160 31212 raft_consensus.cc:2468] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 0.
I20260709 12:14:01.185492 31411 raft_consensus.cc:2804] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:01.185933 31411 raft_consensus.cc:493] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.186267 31411 raft_consensus.cc:3060] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.188946 31214 raft_consensus.cc:2468] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:01.195565 31179 leader_election.cc:304] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 77972579842b4256b07d8d95e2026c79
I20260709 12:14:01.196625 31435 raft_consensus.cc:2804] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.197105 31435 raft_consensus.cc:697] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:01.199556 31253 leader_election.cc:304] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.193948 31411 raft_consensus.cc:515] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.197983 31435 consensus_queue.cc:237] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.200488 31427 raft_consensus.cc:2804] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.201885 31411 leader_election.cc:290] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:01.202555 31411 raft_consensus.cc:2749] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:01.208166 31405 tablet_bootstrap.cc:492] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:01.208977 31405 ts_tablet_manager.cc:1403] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.065s	user 0.030s	sys 0.032s
I20260709 12:14:01.195120 31428 leader_election.cc:290] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.208310 31404 tablet_bootstrap.cc:492] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:01.210590 31404 ts_tablet_manager.cc:1403] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.011s
I20260709 12:14:01.216096 31214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb74109ca748499bdcfda11938b772" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:01.212499 31405 raft_consensus.cc:359] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.216321 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb74109ca748499bdcfda11938b772" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:01.216759 31405 raft_consensus.cc:385] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:01.217116 31327 leader_election.cc:343] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:01.217005 31290 raft_consensus.cc:3060] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.217272 31405 raft_consensus.cc:740] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.216768 31214 raft_consensus.cc:3060] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.218068 31327 leader_election.cc:304] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1; no voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79
I20260709 12:14:01.218844 31405 consensus_queue.cc:260] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.214222 31112 catalog_manager.cc:5697] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.221273 31405 ts_tablet_manager.cc:1434] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:14:01.222697 31405 tablet_bootstrap.cc:492] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:01.223104 31442 raft_consensus.cc:2749] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:01.227643 31406 tablet_bootstrap.cc:492] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:01.228195 31406 ts_tablet_manager.cc:1403] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.011s
I20260709 12:14:01.216830 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3861db98a2c42cea249f3f25dca4490" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.229143 31364 raft_consensus.cc:3060] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.230062 31405 tablet_bootstrap.cc:654] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.230870 31290 raft_consensus.cc:2468] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 1.
I20260709 12:14:01.232348 31327 leader_election.cc:304] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.212321 31412 raft_consensus.cc:515] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.234833 31442 raft_consensus.cc:2804] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.235493 31442 raft_consensus.cc:697] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Leader. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:01.237761 31442 consensus_queue.cc:237] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.238924 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3763069f09b340458156360dd9eba15a" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.239432 31364 raft_consensus.cc:2468] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:01.239598 31363 raft_consensus.cc:3060] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.215571 31427 raft_consensus.cc:697] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:01.236416 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3763069f09b340458156360dd9eba15a" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:01.240438 31212 raft_consensus.cc:3060] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.228232 31214 raft_consensus.cc:2468] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 1.
I20260709 12:14:01.213253 31404 raft_consensus.cc:359] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.243219 31404 raft_consensus.cc:385] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.243513 31404 raft_consensus.cc:740] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.244668 31404 consensus_queue.cc:260] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.246591 31427 consensus_queue.cc:237] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.247566 31404 ts_tablet_manager.cc:1434] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:14:01.248775 31404 tablet_bootstrap.cc:492] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:01.255486 31404 tablet_bootstrap.cc:654] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.231103 31406 raft_consensus.cc:359] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.257761 31406 raft_consensus.cc:385] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.263795 31406 raft_consensus.cc:740] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.265161 31406 consensus_queue.cc:260] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.275169 31406 ts_tablet_manager.cc:1434] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.003s
I20260709 12:14:01.275759 31112 catalog_manager.cc:5697] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "2c10d756449b40a7a756e47931f0cab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.281492 31435 raft_consensus.cc:493] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.282109 31435 raft_consensus.cc:515] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.284403 31435 leader_election.cc:290] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.286829 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:01.287562 31290 raft_consensus.cc:2468] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 0.
I20260709 12:14:01.261412 31212 raft_consensus.cc:2468] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:01.288967 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:01.289565 31253 leader_election.cc:304] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.266328 31412 leader_election.cc:290] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.290314 31405 tablet_bootstrap.cc:492] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:01.290875 31412 raft_consensus.cc:2804] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.291039 31405 ts_tablet_manager.cc:1403] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.040s
I20260709 12:14:01.289676 31364 raft_consensus.cc:2468] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 0.
I20260709 12:14:01.290733 31113 catalog_manager.cc:5697] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 1 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.291891 31412 raft_consensus.cc:697] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:01.290872 31178 leader_election.cc:304] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.292788 31412 consensus_queue.cc:237] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.293938 31435 raft_consensus.cc:2804] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:01.266014 31363 raft_consensus.cc:2468] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:01.294390 31435 raft_consensus.cc:493] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.294934 31435 raft_consensus.cc:3060] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.294720 31405 raft_consensus.cc:359] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.295648 31405 raft_consensus.cc:385] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.296084 31405 raft_consensus.cc:740] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.296900 31405 consensus_queue.cc:260] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.276237 31442 raft_consensus.cc:493] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.298245 31442 raft_consensus.cc:515] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.299712 31405 ts_tablet_manager.cc:1434] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:01.300887 31405 tablet_bootstrap.cc:492] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:01.301131 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489237d9c34c4f04be8287bef9ddcfa9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:01.301836 31212 raft_consensus.cc:2468] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 0.
I20260709 12:14:01.302275 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489237d9c34c4f04be8287bef9ddcfa9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:01.303006 31290 raft_consensus.cc:2468] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 0.
I20260709 12:14:01.303006 31327 leader_election.cc:304] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:01.304621 31411 raft_consensus.cc:2804] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:01.305042 31411 raft_consensus.cc:493] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.305410 31411 raft_consensus.cc:3060] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.308277 31405 tablet_bootstrap.cc:654] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.310111 31442 leader_election.cc:290] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:01.310737 31435 raft_consensus.cc:515] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.313865 31435 leader_election.cc:290] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.314705 31404 tablet_bootstrap.cc:492] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:01.315325 31404 ts_tablet_manager.cc:1403] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.023s
I20260709 12:14:01.315928 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.316598 31363 raft_consensus.cc:3060] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.318288 31404 raft_consensus.cc:359] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.319134 31404 raft_consensus.cc:385] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.314783 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:01.319772 31405 tablet_bootstrap.cc:492] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:01.320056 31290 raft_consensus.cc:3060] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.320523 31405 ts_tablet_manager.cc:1403] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:14:01.320502 31111 catalog_manager.cc:5697] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 1 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.323611 31405 raft_consensus.cc:359] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.324311 31405 raft_consensus.cc:385] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.324656 31405 raft_consensus.cc:740] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.325063 31363 raft_consensus.cc:2468] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 1.
I20260709 12:14:01.319520 31404 raft_consensus.cc:740] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.325600 31405 consensus_queue.cc:260] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.326542 31179 leader_election.cc:304] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:01.326498 31404 consensus_queue.cc:260] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.327569 31410 raft_consensus.cc:2804] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.328157 31405 ts_tablet_manager.cc:1434] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:01.328689 31404 ts_tablet_manager.cc:1434] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:14:01.329416 31405 tablet_bootstrap.cc:492] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:01.329653 31404 tablet_bootstrap.cc:492] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:01.333763 31290 raft_consensus.cc:2468] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 1.
I20260709 12:14:01.335896 31404 tablet_bootstrap.cc:654] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.336789 31405 tablet_bootstrap.cc:654] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:01.341846 31404 tablet_bootstrap.cc:492] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:01.342423 31404 ts_tablet_manager.cc:1403] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:14:01.342641 31405 tablet_bootstrap.cc:492] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:01.343247 31405 ts_tablet_manager.cc:1403] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:14:01.345551 31404 raft_consensus.cc:359] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.346040 31405 raft_consensus.cc:359] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.346336 31404 raft_consensus.cc:385] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.346920 31405 raft_consensus.cc:385] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:01.347091 31404 raft_consensus.cc:740] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.347532 31405 raft_consensus.cc:740] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.346275 31411 raft_consensus.cc:515] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.348279 31404 consensus_queue.cc:260] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.348757 31405 consensus_queue.cc:260] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.350646 31404 ts_tablet_manager.cc:1434] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:01.350616 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489237d9c34c4f04be8287bef9ddcfa9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:01.351265 31405 ts_tablet_manager.cc:1434] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:01.351336 31212 raft_consensus.cc:3060] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.356158 31410 raft_consensus.cc:697] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:01.357239 31410 consensus_queue.cc:237] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.359611 31212 raft_consensus.cc:2468] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 1.
I20260709 12:14:01.360944 31411 leader_election.cc:290] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:01.360899 31327 leader_election.cc:304] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:01.362123 31451 raft_consensus.cc:493] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.362649 31451 raft_consensus.cc:515] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.363258 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489237d9c34c4f04be8287bef9ddcfa9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:01.364077 31290 raft_consensus.cc:3060] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.365463 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e92a3344a454901ac15091909781083" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:01.366781 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e92a3344a454901ac15091909781083" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:01.367566 31363 raft_consensus.cc:2393] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66a655080eee468baa6cd2a0cc015020 in current term 1: Already voted for candidate 77972579842b4256b07d8d95e2026c79 in this term.
I20260709 12:14:01.369136 31179 leader_election.cc:304] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020; no voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79
I20260709 12:14:01.369997 31435 raft_consensus.cc:3060] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.370811 31411 raft_consensus.cc:2804] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.371417 31411 raft_consensus.cc:697] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Leader. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:01.372284 31411 consensus_queue.cc:237] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.374449 31290 raft_consensus.cc:2468] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 1.
I20260709 12:14:01.376571 31435 raft_consensus.cc:2749] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:01.377400 31451 leader_election.cc:290] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.380997 31112 catalog_manager.cc:5697] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.384341 31111 catalog_manager.cc:5697] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "2c10d756449b40a7a756e47931f0cab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.426748 31451 raft_consensus.cc:493] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.427331 31451 raft_consensus.cc:515] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.429005 31451 leader_election.cc:290] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.429924 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a4579d4324331a1e639105f033a8e" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:01.430023 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a4579d4324331a1e639105f033a8e" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:01.430883 31290 raft_consensus.cc:2468] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 0.
I20260709 12:14:01.430881 31363 raft_consensus.cc:2468] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 0.
I20260709 12:14:01.432034 31178 leader_election.cc:304] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.432699 31451 raft_consensus.cc:2804] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:01.433007 31451 raft_consensus.cc:493] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.433312 31451 raft_consensus.cc:3060] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.439620 31451 raft_consensus.cc:515] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.441262 31451 leader_election.cc:290] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.442200 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a4579d4324331a1e639105f033a8e" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:01.442308 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a4579d4324331a1e639105f033a8e" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.442904 31290 raft_consensus.cc:3060] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.442991 31363 raft_consensus.cc:3060] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.448438 31290 raft_consensus.cc:2468] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 1.
I20260709 12:14:01.448439 31363 raft_consensus.cc:2468] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 1.
I20260709 12:14:01.449637 31178 leader_election.cc:304] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.450369 31451 raft_consensus.cc:2804] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.450850 31451 raft_consensus.cc:697] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:01.451645 31451 consensus_queue.cc:237] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.452067 31412 raft_consensus.cc:493] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.452601 31412 raft_consensus.cc:515] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.454569 31412 leader_election.cc:290] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.455727 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:01.455727 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:01.456571 31363 raft_consensus.cc:2468] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:01.457078 31212 raft_consensus.cc:2468] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:01.457974 31254 leader_election.cc:304] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.458871 31412 raft_consensus.cc:2804] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:01.459184 31412 raft_consensus.cc:493] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.459537 31412 raft_consensus.cc:3060] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.461293 31111 catalog_manager.cc:5697] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.462709 31427 consensus_queue.cc:1048] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.467806 31412 raft_consensus.cc:515] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.472088 31412 leader_election.cc:290] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.471997 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:01.472867 31212 raft_consensus.cc:3060] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.473240 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.473773 31364 raft_consensus.cc:3060] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.477849 31412 consensus_queue.cc:1048] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.481564 31364 raft_consensus.cc:2468] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:01.482702 31254 leader_election.cc:304] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.483496 31412 raft_consensus.cc:2804] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:01.483963 31412 raft_consensus.cc:697] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:01.484772 31412 consensus_queue.cc:237] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.484211 31212 raft_consensus.cc:2468] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:01.502693 31112 catalog_manager.cc:5697] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 1 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.531409 31363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "489237d9c34c4f04be8287bef9ddcfa9"
dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
mode: GRACEFUL
new_leader_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:36384
I20260709 12:14:01.532012 31363 raft_consensus.cc:606] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Received request to transfer leadership to TS 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:01.544710 31290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
mode: GRACEFUL
new_leader_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:52138
I20260709 12:14:01.545258 31290 raft_consensus.cc:606] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Received request to transfer leadership to TS 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:01.550591 31290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e92a3344a454901ac15091909781083"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
mode: GRACEFUL
new_leader_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:52138
I20260709 12:14:01.551122 31290 raft_consensus.cc:606] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Received request to transfer leadership to TS 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:01.556109 31363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7abb74109ca748499bdcfda11938b772"
dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
mode: GRACEFUL
new_leader_uuid: "77972579842b4256b07d8d95e2026c79"
 from {username='slave'} at 127.0.0.1:36384
I20260709 12:14:01.556648 31363 raft_consensus.cc:606] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Received request to transfer leadership to TS 77972579842b4256b07d8d95e2026c79
I20260709 12:14:01.569403 31214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "606a4579d4324331a1e639105f033a8e"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
mode: GRACEFUL
new_leader_uuid: "77972579842b4256b07d8d95e2026c79"
 from {username='slave'} at 127.0.0.1:41508
I20260709 12:14:01.569897 31214 raft_consensus.cc:606] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Received request to transfer leadership to TS 77972579842b4256b07d8d95e2026c79
I20260709 12:14:01.574826 31214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
mode: GRACEFUL
new_leader_uuid: "77972579842b4256b07d8d95e2026c79"
 from {username='slave'} at 127.0.0.1:41508
I20260709 12:14:01.575302 31214 raft_consensus.cc:606] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Received request to transfer leadership to TS 77972579842b4256b07d8d95e2026c79
I20260709 12:14:01.582780 31290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3763069f09b340458156360dd9eba15a"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
mode: GRACEFUL
new_leader_uuid: "2c10d756449b40a7a756e47931f0cab1"
 from {username='slave'} at 127.0.0.1:52138
I20260709 12:14:01.583273 31290 raft_consensus.cc:606] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Received request to transfer leadership to TS 2c10d756449b40a7a756e47931f0cab1
I20260709 12:14:01.594404 31290 raft_consensus.cc:3060] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:01.600903 31451 consensus_queue.cc:1048] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.611266 31435 consensus_queue.cc:1048] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.742565 31412 consensus_queue.cc:1048] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.744226 31411 consensus_queue.cc:1048] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.759584 31468 consensus_queue.cc:1048] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:01.759850 31443 consensus_queue.cc:1048] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:01.770922 31411 raft_consensus.cc:993] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1: : Instructing follower 77972579842b4256b07d8d95e2026c79 to start an election
I20260709 12:14:01.771458 31442 raft_consensus.cc:1081] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Signalling peer 77972579842b4256b07d8d95e2026c79 to start an election
I20260709 12:14:01.773962 31290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7abb74109ca748499bdcfda11938b772"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
 from {username='slave'} at 127.0.0.1:52122
I20260709 12:14:01.774631 31290 raft_consensus.cc:493] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.775046 31290 raft_consensus.cc:3060] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.781253 31290 raft_consensus.cc:515] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.783591 31290 leader_election.cc:290] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 2 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.783928 31214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb74109ca748499bdcfda11938b772" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:01.784307 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abb74109ca748499bdcfda11938b772" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.784650 31214 raft_consensus.cc:3060] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.785112 31363 raft_consensus.cc:3055] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.785449 31363 raft_consensus.cc:740] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:01.785555 31468 consensus_queue.cc:1048] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.786509 31363 consensus_queue.cc:260] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.787982 31363 raft_consensus.cc:3060] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.792490 31214 raft_consensus.cc:2468] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 2.
I20260709 12:14:01.793995 31253 leader_election.cc:304] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.794925 31443 raft_consensus.cc:2804] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.795522 31443 raft_consensus.cc:697] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:01.795987 31363 raft_consensus.cc:2468] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 2.
I20260709 12:14:01.796407 31443 consensus_queue.cc:237] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.801811 31468 consensus_queue.cc:1048] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:01.813637 31442 raft_consensus.cc:993] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1: : Instructing follower 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:01.814266 31472 raft_consensus.cc:1081] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Signalling peer 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:01.816093 31214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "489237d9c34c4f04be8287bef9ddcfa9"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:41496
I20260709 12:14:01.816695 31214 raft_consensus.cc:493] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.817135 31214 raft_consensus.cc:3060] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.816524 31111 catalog_manager.cc:5697] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 1 to 2, leader changed from 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67) to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 2 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.823100 31214 raft_consensus.cc:515] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.825183 31214 leader_election.cc:290] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.826318 31290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489237d9c34c4f04be8287bef9ddcfa9" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:01.826738 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489237d9c34c4f04be8287bef9ddcfa9" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.827044 31290 raft_consensus.cc:3060] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.827373 31363 raft_consensus.cc:3055] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.827723 31363 raft_consensus.cc:740] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:01.828609 31363 consensus_queue.cc:260] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.829909 31363 raft_consensus.cc:3060] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.835357 31290 raft_consensus.cc:2468] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:01.836539 31178 leader_election.cc:304] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.837370 31435 raft_consensus.cc:2804] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.837235 31363 raft_consensus.cc:2468] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:01.837944 31435 raft_consensus.cc:697] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:01.838639 31410 consensus_queue.cc:1048] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.838896 31435 consensus_queue.cc:237] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.844515 31443 consensus_queue.cc:1048] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.849139 31435 consensus_queue.cc:1048] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:01.850011 31410 consensus_queue.cc:1048] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.854259 31443 consensus_queue.cc:1048] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.872574 31435 raft_consensus.cc:993] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020: : Instructing follower 77972579842b4256b07d8d95e2026c79 to start an election
I20260709 12:14:01.873143 31435 raft_consensus.cc:1081] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Signalling peer 77972579842b4256b07d8d95e2026c79 to start an election
I20260709 12:14:01.855379 31110 catalog_manager.cc:5697] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 1 to 2, leader changed from 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67) to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.876024 31287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "606a4579d4324331a1e639105f033a8e"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
 from {username='slave'} at 127.0.0.1:52110
I20260709 12:14:01.881546 31412 raft_consensus.cc:993] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79: : Instructing follower 2c10d756449b40a7a756e47931f0cab1 to start an election
I20260709 12:14:01.882038 31412 raft_consensus.cc:1081] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Signalling peer 2c10d756449b40a7a756e47931f0cab1 to start an election
I20260709 12:14:01.884847 31451 consensus_queue.cc:1048] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.886559 31287 raft_consensus.cc:493] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.887069 31287 raft_consensus.cc:3060] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.889485 31428 consensus_queue.cc:1048] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.895845 31363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3763069f09b340458156360dd9eba15a"
dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
 from {username='slave'} at 127.0.0.1:36356
I20260709 12:14:01.896559 31363 raft_consensus.cc:493] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.896945 31363 raft_consensus.cc:3060] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.898943 31287 raft_consensus.cc:515] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.903642 31451 raft_consensus.cc:993] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020: : Instructing follower 77972579842b4256b07d8d95e2026c79 to start an election
I20260709 12:14:01.904115 31451 raft_consensus.cc:1081] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Signalling peer 77972579842b4256b07d8d95e2026c79 to start an election
I20260709 12:14:01.906152 31290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
 from {username='slave'} at 127.0.0.1:52110
I20260709 12:14:01.906827 31290 raft_consensus.cc:493] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.907294 31290 raft_consensus.cc:3060] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.907176 31363 raft_consensus.cc:515] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.909708 31363 leader_election.cc:290] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 2 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:01.913030 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3763069f09b340458156360dd9eba15a" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:01.913276 31427 raft_consensus.cc:993] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79: : Instructing follower 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:01.913690 31289 raft_consensus.cc:3055] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.913806 31427 raft_consensus.cc:1081] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Signalling peer 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:01.914080 31289 raft_consensus.cc:740] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:01.914284 31214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3763069f09b340458156360dd9eba15a" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:01.918615 31214 raft_consensus.cc:3060] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.919193 31290 raft_consensus.cc:515] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.921262 31213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a4579d4324331a1e639105f033a8e" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:01.921927 31213 raft_consensus.cc:3055] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.922245 31213 raft_consensus.cc:740] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:01.923125 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.923079 31213 consensus_queue.cc:260] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.923826 31364 raft_consensus.cc:3060] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.924300 31213 raft_consensus.cc:3060] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.925614 31287 leader_election.cc:290] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 2 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.915004 31289 consensus_queue.cc:260] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.915788 31212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:41490
I20260709 12:14:01.927971 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:01.928617 31215 raft_consensus.cc:3055] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.928961 31215 raft_consensus.cc:740] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:01.926612 31214 raft_consensus.cc:2468] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 2.
I20260709 12:14:01.927979 31212 raft_consensus.cc:493] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.931022 31212 raft_consensus.cc:3060] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.929803 31215 consensus_queue.cc:260] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.931835 31215 raft_consensus.cc:3060] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.933507 31213 raft_consensus.cc:2468] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 2.
I20260709 12:14:01.935254 31443 consensus_queue.cc:1048] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.937646 31327 leader_election.cc:304] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:01.938042 31212 raft_consensus.cc:515] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.938567 31472 raft_consensus.cc:2804] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.939235 31472 raft_consensus.cc:697] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 2 LEADER]: Becoming Leader. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:01.939939 31215 raft_consensus.cc:2468] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 2.
I20260709 12:14:01.940056 31472 consensus_queue.cc:237] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.941130 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606a4579d4324331a1e639105f033a8e" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.941284 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:01.941783 31363 raft_consensus.cc:3060] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.941926 31287 raft_consensus.cc:3055] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.942459 31287 raft_consensus.cc:740] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:01.943290 31287 consensus_queue.cc:260] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.943744 31364 raft_consensus.cc:2468] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 2.
I20260709 12:14:01.944320 31287 raft_consensus.cc:3060] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.944892 31254 leader_election.cc:304] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.945823 31290 leader_election.cc:290] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 2 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.928632 31289 raft_consensus.cc:3060] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.947643 31253 leader_election.cc:304] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:01.948678 31443 raft_consensus.cc:2804] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.949335 31412 raft_consensus.cc:2804] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.950013 31412 raft_consensus.cc:697] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:01.951154 31412 consensus_queue.cc:237] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.953485 31443 raft_consensus.cc:697] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:01.954780 31443 consensus_queue.cc:237] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.954730 31289 raft_consensus.cc:2468] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 2.
I20260709 12:14:01.961091 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:01.963356 31212 leader_election.cc:290] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:01.963929 31363 raft_consensus.cc:2468] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 2.
I20260709 12:14:01.967396 31287 raft_consensus.cc:2468] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:01.968729 31178 leader_election.cc:304] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 2c10d756449b40a7a756e47931f0cab1
I20260709 12:14:01.969601 31435 raft_consensus.cc:2804] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.970130 31435 raft_consensus.cc:697] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:01.969796 31111 catalog_manager.cc:5697] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 1 to 2, leader changed from 66a655080eee468baa6cd2a0cc015020 (127.20.56.65) to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 2 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.971032 31435 consensus_queue.cc:237] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:01.971403 31111 catalog_manager.cc:5697] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 1 to 2, leader changed from 66a655080eee468baa6cd2a0cc015020 (127.20.56.65) to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 2 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:01.980523 31112 catalog_manager.cc:5697] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 reported cstate change: term changed from 1 to 2, leader changed from 77972579842b4256b07d8d95e2026c79 (127.20.56.66) to 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67). New cstate: current_term: 2 leader_uuid: "2c10d756449b40a7a756e47931f0cab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.989964 31110 catalog_manager.cc:5697] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 1 to 2, leader changed from 77972579842b4256b07d8d95e2026c79 (127.20.56.66) to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:02.056114 31443 raft_consensus.cc:993] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79: : Instructing follower 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:02.056632 31427 raft_consensus.cc:1081] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Signalling peer 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:02.058384 31212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e92a3344a454901ac15091909781083"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:41490
I20260709 12:14:02.059026 31212 raft_consensus.cc:493] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:02.059412 31212 raft_consensus.cc:3060] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.064808 31212 raft_consensus.cc:515] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:02.066619 31212 leader_election.cc:290] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:02.067442 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e92a3344a454901ac15091909781083" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:02.067821 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e92a3344a454901ac15091909781083" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:02.068171 31287 raft_consensus.cc:3055] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:02.068509 31362 raft_consensus.cc:3060] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.068570 31287 raft_consensus.cc:740] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:02.069708 31287 consensus_queue.cc:260] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:02.071100 31287 raft_consensus.cc:3060] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.074246 31362 raft_consensus.cc:2468] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:02.075425 31179 leader_election.cc:304] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:02.076124 31435 raft_consensus.cc:2804] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:02.076612 31435 raft_consensus.cc:697] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:02.077417 31435 consensus_queue.cc:237] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:02.078590 31287 raft_consensus.cc:2468] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:02.084493 31112 catalog_manager.cc:5697] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 1 to 2, leader changed from 77972579842b4256b07d8d95e2026c79 (127.20.56.66) to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:02.252794 31212 raft_consensus.cc:1275] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Refusing update from remote peer 77972579842b4256b07d8d95e2026c79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.254175 31412 consensus_queue.cc:1048] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.258934 31287 raft_consensus.cc:1275] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.260486 31451 consensus_queue.cc:1048] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.264994 31362 raft_consensus.cc:1275] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 77972579842b4256b07d8d95e2026c79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.267009 31412 consensus_queue.cc:1048] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.276124 31362 raft_consensus.cc:1275] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.278046 31435 consensus_queue.cc:1048] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:02.343855 31212 raft_consensus.cc:1275] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Refusing update from remote peer 2c10d756449b40a7a756e47931f0cab1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.345054 31472 consensus_queue.cc:1048] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.353241 31289 raft_consensus.cc:1275] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Refusing update from remote peer 2c10d756449b40a7a756e47931f0cab1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.354894 31411 consensus_queue.cc:1048] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.359661 31362 raft_consensus.cc:1275] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 77972579842b4256b07d8d95e2026c79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.362773 31412 consensus_queue.cc:1048] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.370770 31215 raft_consensus.cc:1275] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Refusing update from remote peer 77972579842b4256b07d8d95e2026c79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.371977 31289 raft_consensus.cc:1275] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.372983 31427 consensus_queue.cc:1048] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.373620 31435 consensus_queue.cc:1048] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.385388 31362 raft_consensus.cc:3060] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.393476 31362 raft_consensus.cc:1275] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.395082 31410 consensus_queue.cc:1048] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.438028 31362 raft_consensus.cc:1275] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 77972579842b4256b07d8d95e2026c79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.439458 31427 consensus_queue.cc:1048] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.443437 31215 raft_consensus.cc:1275] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Refusing update from remote peer 77972579842b4256b07d8d95e2026c79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.444900 31428 consensus_queue.cc:1048] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.462702 31362 raft_consensus.cc:1275] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.463917 31410 consensus_queue.cc:1048] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.471346 31289 raft_consensus.cc:1275] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.473272 31451 consensus_queue.cc:1048] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:03.956296 31385 debug-util.cc:398] Leaking SignalData structure 0x7b08001bfda0 after lost signal to thread 20708
W20260709 12:14:03.957414 31385 debug-util.cc:398] Leaking SignalData structure 0x7b0800112100 after lost signal to thread 31147
W20260709 12:14:03.958657 31385 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff7c0 after lost signal to thread 31239
W20260709 12:14:03.959684 31385 debug-util.cc:398] Leaking SignalData structure 0x7b0800129ac0 after lost signal to thread 31314
W20260709 12:14:03.960685 31385 debug-util.cc:398] Leaking SignalData structure 0x7b08000f79e0 after lost signal to thread 31388
I20260709 12:14:04.723779 31111 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60706:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:04.726734 31111 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:04.780995 31200 tablet_service.cc:1511] Processing CreateTablet for tablet 541da387c08e4c19be7e51273946dc64 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:04.782382 31200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541da387c08e4c19be7e51273946dc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.783252 31280 tablet_service.cc:1511] Processing CreateTablet for tablet 541da387c08e4c19be7e51273946dc64 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:04.784607 31280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541da387c08e4c19be7e51273946dc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.785698 31203 tablet_service.cc:1511] Processing CreateTablet for tablet 88ff89cfbab14579af1338ac175d26af (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:04.787038 31203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ff89cfbab14579af1338ac175d26af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.788019 31278 tablet_service.cc:1511] Processing CreateTablet for tablet 88ff89cfbab14579af1338ac175d26af (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:04.789068 31348 tablet_service.cc:1511] Processing CreateTablet for tablet 541da387c08e4c19be7e51273946dc64 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:04.790428 31348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541da387c08e4c19be7e51273946dc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.794541 31202 tablet_service.cc:1511] Processing CreateTablet for tablet 85c40f40c0484488a8250d628f929df6 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:04.795863 31202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c40f40c0484488a8250d628f929df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.797490 31272 tablet_service.cc:1511] Processing CreateTablet for tablet 85c40f40c0484488a8250d628f929df6 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:04.804689 31347 tablet_service.cc:1511] Processing CreateTablet for tablet 88ff89cfbab14579af1338ac175d26af (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:04.806130 31347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ff89cfbab14579af1338ac175d26af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.789448 31278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ff89cfbab14579af1338ac175d26af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.810393 31346 tablet_service.cc:1511] Processing CreateTablet for tablet 85c40f40c0484488a8250d628f929df6 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:04.812803 31272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c40f40c0484488a8250d628f929df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.819892 31346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c40f40c0484488a8250d628f929df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.845871 31205 tablet_service.cc:1511] Processing CreateTablet for tablet ff026103535f4354b2e205f423dfa2ca (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:04.847378 31205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff026103535f4354b2e205f423dfa2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.849152 31274 tablet_service.cc:1511] Processing CreateTablet for tablet ff026103535f4354b2e205f423dfa2ca (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:04.850579 31274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff026103535f4354b2e205f423dfa2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.850636 31349 tablet_service.cc:1511] Processing CreateTablet for tablet ff026103535f4354b2e205f423dfa2ca (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:04.853045 31349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff026103535f4354b2e205f423dfa2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.860623 31199 tablet_service.cc:1511] Processing CreateTablet for tablet a1bea3c6ec0340dbbf8c05fd5b0620b9 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:04.862112 31199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bea3c6ec0340dbbf8c05fd5b0620b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.862974 31277 tablet_service.cc:1511] Processing CreateTablet for tablet a1bea3c6ec0340dbbf8c05fd5b0620b9 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:04.864344 31277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bea3c6ec0340dbbf8c05fd5b0620b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.867682 31352 tablet_service.cc:1511] Processing CreateTablet for tablet a1bea3c6ec0340dbbf8c05fd5b0620b9 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:04.869057 31352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1bea3c6ec0340dbbf8c05fd5b0620b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.871465 31201 tablet_service.cc:1511] Processing CreateTablet for tablet 3bbc7319e9114b6aa9ccf9e45d139395 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:04.872828 31201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bbc7319e9114b6aa9ccf9e45d139395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.889043 31275 tablet_service.cc:1511] Processing CreateTablet for tablet 3bbc7319e9114b6aa9ccf9e45d139395 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:04.890753 31275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bbc7319e9114b6aa9ccf9e45d139395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.907272 31351 tablet_service.cc:1511] Processing CreateTablet for tablet 3bbc7319e9114b6aa9ccf9e45d139395 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:04.908733 31351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bbc7319e9114b6aa9ccf9e45d139395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.927585 31502 tablet_bootstrap.cc:492] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:04.929699 31353 tablet_service.cc:1511] Processing CreateTablet for tablet 787a18b9766e4344aab94ba5e721fce9 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:04.935385 31353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787a18b9766e4344aab94ba5e721fce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.941905 31204 tablet_service.cc:1511] Processing CreateTablet for tablet 787a18b9766e4344aab94ba5e721fce9 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:04.945036 31204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787a18b9766e4344aab94ba5e721fce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.946116 31280 tablet_service.cc:1511] Processing CreateTablet for tablet 787a18b9766e4344aab94ba5e721fce9 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:04.947749 31280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787a18b9766e4344aab94ba5e721fce9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:04.961755 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:32899, user_credentials={real_user=slave}} blocked reactor thread for 85958us
I20260709 12:14:04.967854 31197 tablet_service.cc:1511] Processing CreateTablet for tablet 985ea95dac1249598cfd3a30f9d516f2 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:04.969486 31197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985ea95dac1249598cfd3a30f9d516f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.988894 31354 tablet_service.cc:1511] Processing CreateTablet for tablet 985ea95dac1249598cfd3a30f9d516f2 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:04.990561 31502 tablet_bootstrap.cc:654] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:04.991894 31198 tablet_service.cc:1511] Processing CreateTablet for tablet 97dfe0682e4f4047a55dc92a0b5f6831 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:04.992969 31198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dfe0682e4f4047a55dc92a0b5f6831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:04.998344 31350 tablet_service.cc:1511] Processing CreateTablet for tablet 97dfe0682e4f4047a55dc92a0b5f6831 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:04.999907 31350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dfe0682e4f4047a55dc92a0b5f6831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.002049 31354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985ea95dac1249598cfd3a30f9d516f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.037712 31277 tablet_service.cc:1511] Processing CreateTablet for tablet 97dfe0682e4f4047a55dc92a0b5f6831 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:05.039716 31277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97dfe0682e4f4047a55dc92a0b5f6831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.041695 31502 tablet_bootstrap.cc:492] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:05.043915 31502 ts_tablet_manager.cc:1403] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.000s
I20260709 12:14:05.048537 31506 tablet_bootstrap.cc:492] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:05.048774 31502 raft_consensus.cc:359] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.049742 31502 raft_consensus.cc:385] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.050110 31502 raft_consensus.cc:740] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.050971 31502 consensus_queue.cc:260] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.053323 31502 ts_tablet_manager.cc:1434] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:05.054432 31502 tablet_bootstrap.cc:492] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:05.061148 31502 tablet_bootstrap.cc:654] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.043206 31278 tablet_service.cc:1511] Processing CreateTablet for tablet 985ea95dac1249598cfd3a30f9d516f2 (DEFAULT_TABLE table=soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:05.065896 31278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985ea95dac1249598cfd3a30f9d516f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:05.089004 31506 tablet_bootstrap.cc:654] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:05.103956 31161 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:05.109532 31502 tablet_bootstrap.cc:492] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:05.110877 31509 tablet_bootstrap.cc:492] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:05.111001 31502 ts_tablet_manager.cc:1403] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.014s
I20260709 12:14:05.114719 31502 raft_consensus.cc:359] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.115291 31502 raft_consensus.cc:385] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.115540 31502 raft_consensus.cc:740] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.116199 31502 consensus_queue.cc:260] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.118289 31502 ts_tablet_manager.cc:1434] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.003s
I20260709 12:14:05.118618 31509 tablet_bootstrap.cc:654] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.121771 31506 tablet_bootstrap.cc:492] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:05.119566 31502 tablet_bootstrap.cc:492] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:05.124321 31506 ts_tablet_manager.cc:1403] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.000s
I20260709 12:14:05.133174 31506 raft_consensus.cc:359] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.141965 31502 tablet_bootstrap.cc:654] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.142191 31509 tablet_bootstrap.cc:492] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:05.142289 31506 raft_consensus.cc:385] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.143078 31506 raft_consensus.cc:740] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.143186 31509 ts_tablet_manager.cc:1403] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.015s
I20260709 12:14:05.144186 31506 consensus_queue.cc:260] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.146752 31506 ts_tablet_manager.cc:1434] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:14:05.147087 31509 raft_consensus.cc:359] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.147962 31506 tablet_bootstrap.cc:492] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:05.148093 31509 raft_consensus.cc:385] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.148569 31509 raft_consensus.cc:740] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.149571 31509 consensus_queue.cc:260] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.152544 31509 ts_tablet_manager.cc:1434] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:05.153834 31509 tablet_bootstrap.cc:492] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:05.165853 31506 tablet_bootstrap.cc:654] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.166661 31509 tablet_bootstrap.cc:654] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.169457 31502 tablet_bootstrap.cc:492] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:05.170083 31502 ts_tablet_manager.cc:1403] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.003s
I20260709 12:14:05.174219 31502 raft_consensus.cc:359] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.175374 31502 raft_consensus.cc:385] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.175741 31502 raft_consensus.cc:740] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.176785 31502 consensus_queue.cc:260] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.189332 31502 ts_tablet_manager.cc:1434] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:14:05.192524 31502 tablet_bootstrap.cc:492] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:05.193450 31506 tablet_bootstrap.cc:492] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:05.194252 31506 ts_tablet_manager.cc:1403] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.021s
I20260709 12:14:05.197783 31506 raft_consensus.cc:359] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.198731 31506 raft_consensus.cc:385] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.199102 31506 raft_consensus.cc:740] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.199515 31502 tablet_bootstrap.cc:654] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.200067 31506 consensus_queue.cc:260] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.201463 31509 tablet_bootstrap.cc:492] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:05.202049 31509 ts_tablet_manager.cc:1403] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.007s
I20260709 12:14:05.206779 31506 ts_tablet_manager.cc:1434] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:14:05.211283 31509 raft_consensus.cc:359] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.212746 31509 raft_consensus.cc:385] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.213243 31509 raft_consensus.cc:740] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.214342 31506 tablet_bootstrap.cc:492] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:05.223276 31509 consensus_queue.cc:260] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.225886 31502 tablet_bootstrap.cc:492] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:05.225886 31506 tablet_bootstrap.cc:654] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.226686 31509 ts_tablet_manager.cc:1434] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:14:05.226728 31502 ts_tablet_manager.cc:1403] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.013s
I20260709 12:14:05.228252 31509 tablet_bootstrap.cc:492] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:05.230472 31502 raft_consensus.cc:359] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.231245 31502 raft_consensus.cc:385] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.231549 31502 raft_consensus.cc:740] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.239336 31504 raft_consensus.cc:493] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.240162 31504 raft_consensus.cc:515] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.240463 31502 consensus_queue.cc:260] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.243574 31502 ts_tablet_manager.cc:1434] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:14:05.244056 31504 leader_election.cc:290] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.244762 31502 tablet_bootstrap.cc:492] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:05.244876 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
W20260709 12:14:05.246699 31254 leader_election.cc:343] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.246753 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
W20260709 12:14:05.252722 31253 leader_election.cc:343] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.252722 31502 tablet_bootstrap.cc:654] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.253575 31253 leader_election.cc:304] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77972579842b4256b07d8d95e2026c79; no voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:05.254599 31504 raft_consensus.cc:2749] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:05.257896 31506 tablet_bootstrap.cc:492] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:05.258518 31506 ts_tablet_manager.cc:1403] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.016s
I20260709 12:14:05.261207 31509 tablet_bootstrap.cc:654] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.261819 31506 raft_consensus.cc:359] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.262710 31506 raft_consensus.cc:385] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.263010 31506 raft_consensus.cc:740] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.263851 31506 consensus_queue.cc:260] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.269484 31506 ts_tablet_manager.cc:1434] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:14:05.269788 31502 tablet_bootstrap.cc:492] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:05.270354 31502 ts_tablet_manager.cc:1403] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.006s
I20260709 12:14:05.270663 31506 tablet_bootstrap.cc:492] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:05.273388 31502 raft_consensus.cc:359] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.274158 31502 raft_consensus.cc:385] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.274507 31502 raft_consensus.cc:740] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.275404 31502 consensus_queue.cc:260] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.277776 31502 ts_tablet_manager.cc:1434] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:05.280114 31502 tablet_bootstrap.cc:492] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:05.287145 31502 tablet_bootstrap.cc:654] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.287911 31509 tablet_bootstrap.cc:492] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:05.288520 31509 ts_tablet_manager.cc:1403] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.003s
I20260709 12:14:05.291469 31506 tablet_bootstrap.cc:654] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.302457 31509 raft_consensus.cc:359] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.303398 31509 raft_consensus.cc:385] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.303747 31509 raft_consensus.cc:740] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.304781 31509 consensus_queue.cc:260] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.312186 31502 tablet_bootstrap.cc:492] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:05.312808 31502 ts_tablet_manager.cc:1403] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
I20260709 12:14:05.315874 31502 raft_consensus.cc:359] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.316642 31502 raft_consensus.cc:385] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.316926 31502 raft_consensus.cc:740] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.317683 31502 consensus_queue.cc:260] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.319991 31502 ts_tablet_manager.cc:1434] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:05.331471 31502 tablet_bootstrap.cc:492] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:05.338197 31502 tablet_bootstrap.cc:654] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.328696 31509 ts_tablet_manager.cc:1434] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 12:14:05.354244 31509 tablet_bootstrap.cc:492] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:05.368413 31506 tablet_bootstrap.cc:492] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:05.369092 31506 ts_tablet_manager.cc:1403] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.099s	user 0.040s	sys 0.037s
I20260709 12:14:05.369772 31509 tablet_bootstrap.cc:654] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.372859 31506 raft_consensus.cc:359] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.373849 31506 raft_consensus.cc:385] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.374225 31506 raft_consensus.cc:740] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.375216 31506 consensus_queue.cc:260] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.384037 31506 ts_tablet_manager.cc:1434] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:14:05.385174 31506 tablet_bootstrap.cc:492] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:05.397575 31502 tablet_bootstrap.cc:492] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:05.398545 31502 ts_tablet_manager.cc:1403] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.032s
I20260709 12:14:05.398644 31509 tablet_bootstrap.cc:492] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:05.399269 31509 ts_tablet_manager.cc:1403] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.016s
I20260709 12:14:05.401893 31502 raft_consensus.cc:359] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.402261 31509 raft_consensus.cc:359] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.402812 31502 raft_consensus.cc:385] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.403149 31509 raft_consensus.cc:385] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.403192 31502 raft_consensus.cc:740] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.403568 31509 raft_consensus.cc:740] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.403637 31506 tablet_bootstrap.cc:654] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.404157 31502 consensus_queue.cc:260] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.406742 31502 ts_tablet_manager.cc:1434] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:05.404758 31509 consensus_queue.cc:260] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.407819 31502 tablet_bootstrap.cc:492] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:05.414839 31502 tablet_bootstrap.cc:654] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.430658 31503 raft_consensus.cc:493] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.431411 31503 raft_consensus.cc:515] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.437448 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.438405 31215 raft_consensus.cc:2468] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:05.442056 31253 leader_election.cc:304] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:05.445073 31491 raft_consensus.cc:493] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.445771 31491 raft_consensus.cc:515] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.449497 31504 raft_consensus.cc:2804] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.450181 31504 raft_consensus.cc:493] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.450650 31504 raft_consensus.cc:3060] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.450750 31442 raft_consensus.cc:493] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.451432 31442 raft_consensus.cc:515] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.453773 31442 leader_election.cc:290] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:05.456367 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bea3c6ec0340dbbf8c05fd5b0620b9" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:05.456683 31491 leader_election.cc:290] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
W20260709 12:14:05.458160 31254 leader_election.cc:343] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.459043 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:05.460961 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bea3c6ec0340dbbf8c05fd5b0620b9" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.461638 31212 raft_consensus.cc:2468] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:05.466850 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.467633 31215 raft_consensus.cc:2468] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 0.
I20260709 12:14:05.469358 31327 leader_election.cc:304] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:05.470666 31442 raft_consensus.cc:2804] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.471174 31442 raft_consensus.cc:493] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.471632 31442 raft_consensus.cc:3060] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.479972 31491 raft_consensus.cc:493] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.480754 31491 raft_consensus.cc:515] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.484560 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:05.485296 31363 raft_consensus.cc:2468] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:05.486847 31254 leader_election.cc:304] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:05.487236 31253 leader_election.cc:304] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 2c10d756449b40a7a756e47931f0cab1
I20260709 12:14:05.489347 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.491389 31503 leader_election.cc:290] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.492324 31503 raft_consensus.cc:2804] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.491393 31491 leader_election.cc:290] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.493278 31491 raft_consensus.cc:2804] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.494797 31491 raft_consensus.cc:493] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.496058 31491 raft_consensus.cc:3060] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.498813 31509 ts_tablet_manager.cc:1434] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.099s	user 0.002s	sys 0.007s
W20260709 12:14:05.504503 31253 leader_election.cc:343] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.505679 31526 raft_consensus.cc:493] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.511483 31442 raft_consensus.cc:515] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.515796 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:05.516623 31215 raft_consensus.cc:3060] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.526350 31491 raft_consensus.cc:515] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.533731 31509 tablet_bootstrap.cc:492] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:05.537298 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bea3c6ec0340dbbf8c05fd5b0620b9" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:05.538060 31212 raft_consensus.cc:3060] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.547482 31212 raft_consensus.cc:2468] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:05.549044 31253 leader_election.cc:304] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:05.495697 31504 raft_consensus.cc:515] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.492699 31503 raft_consensus.cc:493] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.551994 31503 raft_consensus.cc:3060] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.553473 31491 leader_election.cc:290] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.555213 31287 raft_consensus.cc:2393] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c10d756449b40a7a756e47931f0cab1 in current term 1: Already voted for candidate 77972579842b4256b07d8d95e2026c79 in this term.
I20260709 12:14:05.555410 31491 raft_consensus.cc:2804] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.557679 31491 raft_consensus.cc:697] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:05.565907 31491 consensus_queue.cc:237] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
W20260709 12:14:05.572516 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.56.67:32899, user_credentials={real_user=slave}} blocked reactor thread for 85768us
I20260709 12:14:05.579006 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:05.509652 31526 raft_consensus.cc:515] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.606552 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ff89cfbab14579af1338ac175d26af" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.614708 31212 raft_consensus.cc:2468] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:05.616542 31253 leader_election.cc:304] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:05.617823 31525 raft_consensus.cc:2804] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.618335 31525 raft_consensus.cc:493] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.618777 31525 raft_consensus.cc:3060] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.602335 31112 catalog_manager.cc:5697] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 1 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:05.625564 31527 raft_consensus.cc:493] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.631284 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:05.632169 31530 raft_consensus.cc:493] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.651239 31363 raft_consensus.cc:2393] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77972579842b4256b07d8d95e2026c79 in current term 1: Already voted for candidate 2c10d756449b40a7a756e47931f0cab1 in this term.
I20260709 12:14:05.650981 31530 raft_consensus.cc:515] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.652598 31527 raft_consensus.cc:515] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.653467 31530 leader_election.cc:290] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:05.633003 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bea3c6ec0340dbbf8c05fd5b0620b9" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:05.635267 31442 leader_election.cc:290] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:05.637403 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:05.655400 31287 raft_consensus.cc:2393] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c10d756449b40a7a756e47931f0cab1 in current term 1: Already voted for candidate 77972579842b4256b07d8d95e2026c79 in this term.
I20260709 12:14:05.613404 31504 leader_election.cc:290] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.656424 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.659410 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:05.660249 31287 raft_consensus.cc:2468] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 0.
I20260709 12:14:05.662295 31504 raft_consensus.cc:493] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:05.662485 31327 leader_election.cc:343] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.662997 31504 raft_consensus.cc:515] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.663836 31327 leader_election.cc:304] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:05.664692 31442 raft_consensus.cc:2804] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.665096 31442 raft_consensus.cc:493] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.665522 31442 raft_consensus.cc:3060] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.666452 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbc7319e9114b6aa9ccf9e45d139395" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.667434 31212 raft_consensus.cc:2468] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:05.668883 31253 leader_election.cc:304] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:05.669857 31491 raft_consensus.cc:2804] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.641336 31526 leader_election.cc:290] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.642881 31506 tablet_bootstrap.cc:492] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:05.670944 31506 ts_tablet_manager.cc:1403] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.286s	user 0.036s	sys 0.060s
I20260709 12:14:05.670260 31491 raft_consensus.cc:493] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.672796 31491 raft_consensus.cc:3060] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.683924 31491 raft_consensus.cc:515] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.690171 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbc7319e9114b6aa9ccf9e45d139395" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.690939 31212 raft_consensus.cc:2468] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 0.
I20260709 12:14:05.684521 31509 tablet_bootstrap.cc:654] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.686461 31506 raft_consensus.cc:359] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.692555 31506 raft_consensus.cc:385] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.693445 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbc7319e9114b6aa9ccf9e45d139395" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:05.687142 31527 leader_election.cc:290] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:05.692891 31506 raft_consensus.cc:740] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
W20260709 12:14:05.694061 31254 leader_election.cc:343] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.695492 31506 consensus_queue.cc:260] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.688127 31504 leader_election.cc:290] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.694208 31212 raft_consensus.cc:3060] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.695370 31491 leader_election.cc:290] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.697825 31327 leader_election.cc:304] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:05.696565 31215 raft_consensus.cc:2468] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 1.
I20260709 12:14:05.687829 31502 tablet_bootstrap.cc:492] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:05.700801 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:05.698305 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbc7319e9114b6aa9ccf9e45d139395" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:05.701407 31502 ts_tablet_manager.cc:1403] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.294s	user 0.105s	sys 0.142s
I20260709 12:14:05.701537 31363 raft_consensus.cc:2393] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 77972579842b4256b07d8d95e2026c79 in current term 1: Already voted for candidate 2c10d756449b40a7a756e47931f0cab1 in this term.
I20260709 12:14:05.701756 31287 raft_consensus.cc:2393] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c10d756449b40a7a756e47931f0cab1 in current term 1: Already voted for candidate 77972579842b4256b07d8d95e2026c79 in this term.
I20260709 12:14:05.702507 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ff89cfbab14579af1338ac175d26af" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:05.703433 31527 raft_consensus.cc:2804] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:05.698787 31503 raft_consensus.cc:515] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.703851 31527 raft_consensus.cc:493] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.706193 31527 raft_consensus.cc:3060] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.704707 31502 raft_consensus.cc:359] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.706897 31502 raft_consensus.cc:385] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.707208 31502 raft_consensus.cc:740] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.707881 31502 consensus_queue.cc:260] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.711004 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
W20260709 12:14:05.712682 31253 leader_election.cc:343] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.715037 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbc7319e9114b6aa9ccf9e45d139395" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:05.714104 31502 ts_tablet_manager.cc:1434] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:14:05.716472 31502 tablet_bootstrap.cc:492] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79: Bootstrap starting.
I20260709 12:14:05.717368 31503 leader_election.cc:290] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.720602 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbc7319e9114b6aa9ccf9e45d139395" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:05.719734 31442 raft_consensus.cc:515] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.729151 31502 tablet_bootstrap.cc:654] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.725068 31254 leader_election.cc:304] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77972579842b4256b07d8d95e2026c79; no voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020
W20260709 12:14:05.730691 31254 leader_election.cc:343] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.735345 31506 ts_tablet_manager.cc:1434] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
I20260709 12:14:05.736022 31491 raft_consensus.cc:2749] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:05.739892 31442 leader_election.cc:290] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:05.728320 31525 raft_consensus.cc:515] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.740760 31502 tablet_bootstrap.cc:492] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79: No bootstrap required, opened a new log
I20260709 12:14:05.741300 31502 ts_tablet_manager.cc:1403] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.004s
I20260709 12:14:05.723196 31327 leader_election.cc:304] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 77972579842b4256b07d8d95e2026c79
I20260709 12:14:05.742604 31503 raft_consensus.cc:493] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.743260 31503 raft_consensus.cc:515] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.746477 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.747468 31506 tablet_bootstrap.cc:492] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
W20260709 12:14:05.748143 31253 leader_election.cc:343] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.746658 31491 raft_consensus.cc:493] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.749279 31491 raft_consensus.cc:515] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.750362 31502 raft_consensus.cc:359] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.751178 31502 raft_consensus.cc:385] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.751485 31502 raft_consensus.cc:740] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.752216 31502 consensus_queue.cc:260] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.753005 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.756857 31527 raft_consensus.cc:515] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.761360 31364 raft_consensus.cc:2393] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77972579842b4256b07d8d95e2026c79 in current term 1: Already voted for candidate 2c10d756449b40a7a756e47931f0cab1 in this term.
I20260709 12:14:05.755275 31502 ts_tablet_manager.cc:1434] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:14:05.765064 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:05.765827 31362 raft_consensus.cc:3060] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.755169 31212 raft_consensus.cc:2468] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
W20260709 12:14:05.758589 31253 leader_election.cc:343] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.768909 31527 leader_election.cc:290] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:05.770540 31506 tablet_bootstrap.cc:654] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.775879 31253 leader_election.cc:304] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:05.777555 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ff89cfbab14579af1338ac175d26af" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:05.778671 31504 raft_consensus.cc:2804] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.779398 31504 raft_consensus.cc:697] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:05.780516 31504 consensus_queue.cc:237] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.783514 31212 raft_consensus.cc:3060] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.760124 31442 raft_consensus.cc:2804] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.760520 31509 tablet_bootstrap.cc:492] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:05.789990 31509 ts_tablet_manager.cc:1403] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.257s	user 0.016s	sys 0.000s
I20260709 12:14:05.790370 31362 raft_consensus.cc:2468] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:05.792152 31442 raft_consensus.cc:697] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Leader. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:05.793208 31442 consensus_queue.cc:237] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.793267 31509 raft_consensus.cc:359] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.794483 31509 raft_consensus.cc:385] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.794821 31509 raft_consensus.cc:740] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.795673 31509 consensus_queue.cc:260] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.801412 31525 leader_election.cc:290] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.802219 31509 ts_tablet_manager.cc:1434] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:14:05.804342 31509 tablet_bootstrap.cc:492] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:05.807833 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:05.804358 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:05.808547 31287 raft_consensus.cc:3060] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.761263 31503 leader_election.cc:290] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.809882 31212 raft_consensus.cc:2468] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:05.817616 31506 tablet_bootstrap.cc:492] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:05.817768 31287 raft_consensus.cc:2468] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 1.
I20260709 12:14:05.818349 31506 ts_tablet_manager.cc:1403] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.007s
I20260709 12:14:05.819067 31253 leader_election.cc:304] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:05.821130 31503 raft_consensus.cc:2804] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.821815 31503 raft_consensus.cc:697] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:05.822057 31506 raft_consensus.cc:359] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.822926 31506 raft_consensus.cc:385] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.823377 31506 raft_consensus.cc:740] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.822822 31503 consensus_queue.cc:237] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.831388 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:05.831496 31254 leader_election.cc:304] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:05.832376 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbc7319e9114b6aa9ccf9e45d139395" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:05.834460 31528 raft_consensus.cc:2804] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.834547 31212 raft_consensus.cc:2393] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c10d756449b40a7a756e47931f0cab1 in current term 1: Already voted for candidate 77972579842b4256b07d8d95e2026c79 in this term.
W20260709 12:14:05.836447 31254 leader_election.cc:343] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.835028 31528 raft_consensus.cc:697] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:05.837085 31254 leader_election.cc:304] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77972579842b4256b07d8d95e2026c79; no voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:05.838366 31526 raft_consensus.cc:2749] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:05.837834 31112 catalog_manager.cc:5697] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 1 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:05.839984 31327 leader_election.cc:304] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:05.835983 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ff89cfbab14579af1338ac175d26af" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:05.837798 31528 consensus_queue.cc:237] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.850560 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbc7319e9114b6aa9ccf9e45d139395" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:05.856122 31442 raft_consensus.cc:2804] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:05.824275 31506 consensus_queue.cc:260] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.856973 31362 raft_consensus.cc:3060] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:05.857211 31442 raft_consensus.cc:697] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Leader. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
W20260709 12:14:05.857834 31327 leader_election.cc:343] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.858242 31506 ts_tablet_manager.cc:1434] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:14:05.859522 31506 tablet_bootstrap.cc:492] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:05.858196 31442 consensus_queue.cc:237] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.859676 31327 leader_election.cc:304] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1; no voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79
I20260709 12:14:05.860572 31527 raft_consensus.cc:2749] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:05.861732 31491 leader_election.cc:290] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:05.863263 31509 tablet_bootstrap.cc:654] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:05.866500 31362 raft_consensus.cc:2468] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:05.872450 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:05.913329 31112 catalog_manager.cc:5697] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "2c10d756449b40a7a756e47931f0cab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:05.918758 31254 leader_election.cc:343] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:05.920003 31254 leader_election.cc:304] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77972579842b4256b07d8d95e2026c79; no voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:05.928215 31504 raft_consensus.cc:2749] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:05.930574 31506 tablet_bootstrap.cc:654] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:05.938531 31542 log.cc:927] Time spent T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:05.946293 31509 tablet_bootstrap.cc:492] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:05.947551 31509 ts_tablet_manager.cc:1403] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.143s	user 0.016s	sys 0.001s
I20260709 12:14:05.953532 31509 raft_consensus.cc:359] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.954618 31509 raft_consensus.cc:385] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:05.954968 31509 raft_consensus.cc:740] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.956115 31509 consensus_queue.cc:260] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.962625 31509 ts_tablet_manager.cc:1434] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.005s
I20260709 12:14:05.964635 31509 tablet_bootstrap.cc:492] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:05.981807 31527 raft_consensus.cc:493] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.982956 31527 raft_consensus.cc:515] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:05.988222 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bea3c6ec0340dbbf8c05fd5b0620b9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:05.989579 31212 raft_consensus.cc:2393] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c10d756449b40a7a756e47931f0cab1 in current term 1: Already voted for candidate 77972579842b4256b07d8d95e2026c79 in this term.
I20260709 12:14:05.986248 31527 leader_election.cc:290] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:05.992839 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1bea3c6ec0340dbbf8c05fd5b0620b9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:05.957706 31110 catalog_manager.cc:5697] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 1 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.002672 31327 leader_election.cc:304] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1; no voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79
I20260709 12:14:06.011042 31509 tablet_bootstrap.cc:654] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.013412 31362 raft_consensus.cc:3060] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.004312 31110 catalog_manager.cc:5697] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 1 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.021588 31509 tablet_bootstrap.cc:492] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:06.022240 31509 ts_tablet_manager.cc:1403] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.058s	user 0.000s	sys 0.014s
I20260709 12:14:06.025995 31509 raft_consensus.cc:359] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.026827 31509 raft_consensus.cc:385] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.027143 31509 raft_consensus.cc:740] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.028131 31509 consensus_queue.cc:260] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.031177 31509 ts_tablet_manager.cc:1434] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:06.032789 31509 tablet_bootstrap.cc:492] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:06.039801 31112 catalog_manager.cc:5697] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "2c10d756449b40a7a756e47931f0cab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.040778 31509 tablet_bootstrap.cc:654] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.057750 31509 tablet_bootstrap.cc:492] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:06.058290 31509 ts_tablet_manager.cc:1403] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.015s
I20260709 12:14:06.062165 31509 raft_consensus.cc:359] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.062984 31509 raft_consensus.cc:385] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.063266 31509 raft_consensus.cc:740] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.064193 31509 consensus_queue.cc:260] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.068159 31528 consensus_queue.cc:1048] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.072206 31509 ts_tablet_manager.cc:1434] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:14:06.074012 31509 tablet_bootstrap.cc:492] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020: Bootstrap starting.
I20260709 12:14:06.081743 31506 tablet_bootstrap.cc:492] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:06.082743 31506 ts_tablet_manager.cc:1403] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.223s	user 0.045s	sys 0.041s
I20260709 12:14:06.084370 31527 raft_consensus.cc:2749] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:06.082675 31509 tablet_bootstrap.cc:654] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.088255 31506 raft_consensus.cc:359] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.089082 31503 consensus_queue.cc:1048] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.089641 31506 raft_consensus.cc:385] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.089965 31506 raft_consensus.cc:740] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.090919 31545 raft_consensus.cc:493] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.091778 31545 raft_consensus.cc:515] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.095281 31545 leader_election.cc:290] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:06.094849 31506 consensus_queue.cc:260] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.101120 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:06.102308 31364 raft_consensus.cc:2393] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66a655080eee468baa6cd2a0cc015020 in current term 1: Already voted for candidate 77972579842b4256b07d8d95e2026c79 in this term.
I20260709 12:14:06.103477 31506 ts_tablet_manager.cc:1434] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:14:06.106709 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:06.109253 31178 leader_election.cc:304] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020; no voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79
I20260709 12:14:06.110893 31505 raft_consensus.cc:3060] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.136029 31506 tablet_bootstrap.cc:492] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:06.140391 31505 raft_consensus.cc:2749] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:06.138214 31161 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:06.143757 31509 tablet_bootstrap.cc:492] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020: No bootstrap required, opened a new log
I20260709 12:14:06.144322 31509 ts_tablet_manager.cc:1403] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.013s
I20260709 12:14:06.147315 31509 raft_consensus.cc:359] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.148130 31509 raft_consensus.cc:385] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.153060 31506 tablet_bootstrap.cc:654] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.148535 31509 raft_consensus.cc:740] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.154129 31509 consensus_queue.cc:260] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.157982 31509 ts_tablet_manager.cc:1434] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
W20260709 12:14:06.158110 31178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.66:38781, user_credentials={real_user=slave}} blocked reactor thread for 43933.7us
I20260709 12:14:06.165593 31505 raft_consensus.cc:493] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.166177 31505 raft_consensus.cc:515] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.169248 31505 leader_election.cc:290] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:06.174173 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
W20260709 12:14:06.176002 31179 leader_election.cc:343] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.176371 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:06.177716 31287 raft_consensus.cc:2468] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 0.
I20260709 12:14:06.181867 31178 leader_election.cc:304] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 2c10d756449b40a7a756e47931f0cab1
I20260709 12:14:06.183328 31505 raft_consensus.cc:2804] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.183753 31505 raft_consensus.cc:493] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.184055 31505 raft_consensus.cc:3060] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.189178 31506 tablet_bootstrap.cc:492] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:06.189921 31506 ts_tablet_manager.cc:1403] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.024s
I20260709 12:14:06.193794 31545 raft_consensus.cc:493] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.194211 31505 raft_consensus.cc:515] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.194535 31545 raft_consensus.cc:515] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.195009 31506 raft_consensus.cc:359] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.196102 31506 raft_consensus.cc:385] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.196431 31506 raft_consensus.cc:740] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.197039 31545 leader_election.cc:290] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:06.197315 31506 consensus_queue.cc:260] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.199692 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:06.200551 31506 ts_tablet_manager.cc:1434] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:06.200763 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:06.201587 31287 raft_consensus.cc:3060] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.202801 31506 tablet_bootstrap.cc:492] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1: Bootstrap starting.
I20260709 12:14:06.203809 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:06.204587 31362 raft_consensus.cc:3060] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.205756 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:06.206849 31289 raft_consensus.cc:2393] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66a655080eee468baa6cd2a0cc015020 in current term 1: Already voted for candidate 2c10d756449b40a7a756e47931f0cab1 in this term.
I20260709 12:14:06.208155 31178 leader_election.cc:304] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020; no voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79
I20260709 12:14:06.209486 31545 raft_consensus.cc:3060] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.211053 31505 leader_election.cc:290] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:06.211858 31503 raft_consensus.cc:493] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.212553 31503 raft_consensus.cc:515] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.215440 31362 raft_consensus.cc:2468] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 1.
I20260709 12:14:06.216111 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ea95dac1249598cfd3a30f9d516f2" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:06.216825 31212 raft_consensus.cc:2468] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 0.
I20260709 12:14:06.217124 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ea95dac1249598cfd3a30f9d516f2" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1" is_pre_election: true
I20260709 12:14:06.218372 31253 leader_election.cc:304] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
W20260709 12:14:06.219034 31254 leader_election.cc:343] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.218890 31503 leader_election.cc:290] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:06.219530 31525 raft_consensus.cc:2804] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.220475 31525 raft_consensus.cc:493] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.220800 31525 raft_consensus.cc:3060] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.224926 31506 tablet_bootstrap.cc:654] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.232436 31545 raft_consensus.cc:2749] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:06.233685 31525 raft_consensus.cc:515] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.236675 31287 raft_consensus.cc:2468] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 1.
I20260709 12:14:06.238569 31179 leader_election.cc:304] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:06.240283 31545 raft_consensus.cc:2804] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.240773 31525 leader_election.cc:290] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:06.241537 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ea95dac1249598cfd3a30f9d516f2" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:06.242250 31212 raft_consensus.cc:3060] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.244078 31362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ea95dac1249598cfd3a30f9d516f2" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:06.241611 31545 raft_consensus.cc:697] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
W20260709 12:14:06.245836 31254 leader_election.cc:343] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:06.244406 31506 tablet_bootstrap.cc:492] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1: No bootstrap required, opened a new log
I20260709 12:14:06.247011 31506 ts_tablet_manager.cc:1403] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.009s
I20260709 12:14:06.245864 31545 consensus_queue.cc:237] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.250360 31506 raft_consensus.cc:359] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.251190 31506 raft_consensus.cc:385] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.251523 31506 raft_consensus.cc:740] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.252410 31506 consensus_queue.cc:260] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.252804 31212 raft_consensus.cc:2468] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 1.
I20260709 12:14:06.254122 31253 leader_election.cc:304] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 2c10d756449b40a7a756e47931f0cab1
I20260709 12:14:06.255910 31525 raft_consensus.cc:2804] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.256150 31506 ts_tablet_manager.cc:1434] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:14:06.257193 31525 raft_consensus.cc:697] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:06.258425 31525 consensus_queue.cc:237] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.277417 31527 consensus_queue.cc:1048] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.280550 31110 catalog_manager.cc:5697] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 1 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.286482 31503 consensus_queue.cc:1048] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.306375 31504 consensus_queue.cc:1048] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.336499 31527 consensus_queue.cc:1048] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.345791 31110 catalog_manager.cc:5697] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 1 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.365127 31527 consensus_queue.cc:1048] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.374431 31442 raft_consensus.cc:493] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.375206 31442 raft_consensus.cc:515] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.378482 31527 consensus_queue.cc:1048] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.380550 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:06.381490 31212 raft_consensus.cc:2468] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 0.
I20260709 12:14:06.397209 31327 leader_election.cc:304] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:06.378221 31442 leader_election.cc:290] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:06.398007 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:06.398680 31530 raft_consensus.cc:2804] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:06.398867 31287 raft_consensus.cc:2468] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 0.
I20260709 12:14:06.399242 31530 raft_consensus.cc:493] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.399577 31530 raft_consensus.cc:3060] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.409243 31530 raft_consensus.cc:515] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.420835 31530 leader_election.cc:290] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:06.422294 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:06.423020 31212 raft_consensus.cc:3060] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.424995 31525 consensus_queue.cc:1048] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.426754 31525 consensus_queue.cc:1048] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.435592 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:06.436870 31287 raft_consensus.cc:3060] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.445621 31212 raft_consensus.cc:2468] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 1.
I20260709 12:14:06.446926 31528 consensus_queue.cc:1048] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.468679 31327 leader_election.cc:304] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:06.470647 31442 raft_consensus.cc:2804] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.471206 31442 raft_consensus.cc:697] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Leader. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:06.472190 31287 raft_consensus.cc:2468] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 1.
I20260709 12:14:06.472150 31442 consensus_queue.cc:237] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.472676 31504 consensus_queue.cc:1048] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.516764 31110 catalog_manager.cc:5697] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67). New cstate: current_term: 1 leader_uuid: "2c10d756449b40a7a756e47931f0cab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.610638 31363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541da387c08e4c19be7e51273946dc64"
dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
mode: GRACEFUL
new_leader_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:36384
I20260709 12:14:06.611608 31363 raft_consensus.cc:606] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Received request to transfer leadership to TS 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:06.618314 31287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88ff89cfbab14579af1338ac175d26af"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
mode: GRACEFUL
new_leader_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:52138
I20260709 12:14:06.619095 31287 raft_consensus.cc:606] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Received request to transfer leadership to TS 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:06.625118 31363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85c40f40c0484488a8250d628f929df6"
dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
mode: GRACEFUL
new_leader_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:36384
I20260709 12:14:06.625833 31363 raft_consensus.cc:606] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Received request to transfer leadership to TS 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:06.631639 31287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
mode: GRACEFUL
new_leader_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:52138
I20260709 12:14:06.632318 31287 raft_consensus.cc:606] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Received request to transfer leadership to TS 66a655080eee468baa6cd2a0cc015020
I20260709 12:14:06.644507 31363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9"
dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
mode: GRACEFUL
new_leader_uuid: "77972579842b4256b07d8d95e2026c79"
 from {username='slave'} at 127.0.0.1:36384
I20260709 12:14:06.645283 31363 raft_consensus.cc:606] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Received request to transfer leadership to TS 77972579842b4256b07d8d95e2026c79
I20260709 12:14:06.653267 31213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
mode: GRACEFUL
new_leader_uuid: "2c10d756449b40a7a756e47931f0cab1"
 from {username='slave'} at 127.0.0.1:41508
I20260709 12:14:06.653870 31213 raft_consensus.cc:606] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Received request to transfer leadership to TS 2c10d756449b40a7a756e47931f0cab1
I20260709 12:14:06.702653 31505 consensus_queue.cc:1048] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.709790 31545 raft_consensus.cc:993] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020: : Instructing follower 2c10d756449b40a7a756e47931f0cab1 to start an election
I20260709 12:14:06.711704 31505 raft_consensus.cc:1081] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Signalling peer 2c10d756449b40a7a756e47931f0cab1 to start an election
I20260709 12:14:06.713820 31362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831"
dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
 from {username='slave'} at 127.0.0.1:36372
I20260709 12:14:06.714550 31362 raft_consensus.cc:493] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.714929 31362 raft_consensus.cc:3060] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.721144 31545 consensus_queue.cc:1048] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.725572 31362 raft_consensus.cc:515] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.727947 31362 leader_election.cc:290] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 2 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:06.729058 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:06.729174 31213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97dfe0682e4f4047a55dc92a0b5f6831" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:06.730064 31213 raft_consensus.cc:3055] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.730404 31213 raft_consensus.cc:740] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:06.731274 31213 consensus_queue.cc:260] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.729089 31363 raft_consensus.cc:1240] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Rejecting Update request from peer 66a655080eee468baa6cd2a0cc015020 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:06.732288 31213 raft_consensus.cc:3060] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.737202 31442 raft_consensus.cc:493] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.738158 31442 raft_consensus.cc:515] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.740871 31442 leader_election.cc:290] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:06.743523 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ea95dac1249598cfd3a30f9d516f2" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a655080eee468baa6cd2a0cc015020" is_pre_election: true
I20260709 12:14:06.743989 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985ea95dac1249598cfd3a30f9d516f2" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77972579842b4256b07d8d95e2026c79" is_pre_election: true
I20260709 12:14:06.744417 31212 raft_consensus.cc:2393] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c10d756449b40a7a756e47931f0cab1 in current term 1: Already voted for candidate 77972579842b4256b07d8d95e2026c79 in this term.
I20260709 12:14:06.747619 31327 leader_election.cc:304] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1; no voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79
I20260709 12:14:06.749420 31442 raft_consensus.cc:3060] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.751192 31213 raft_consensus.cc:2468] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 2.
I20260709 12:14:06.755139 31327 leader_election.cc:304] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 77972579842b4256b07d8d95e2026c79
I20260709 12:14:06.756457 31568 raft_consensus.cc:2804] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.756959 31568 raft_consensus.cc:697] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 2 LEADER]: Becoming Leader. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:06.757819 31568 consensus_queue.cc:237] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.759624 31442 raft_consensus.cc:2749] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:06.763016 31528 consensus_queue.cc:1048] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.768867 31112 catalog_manager.cc:5697] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 reported cstate change: term changed from 1 to 2, leader changed from 66a655080eee468baa6cd2a0cc015020 (127.20.56.65) to 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67). New cstate: current_term: 2 leader_uuid: "2c10d756449b40a7a756e47931f0cab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.783459 31568 raft_consensus.cc:993] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: : Instructing follower 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:06.783931 31568 raft_consensus.cc:1081] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Signalling peer 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:06.785547 31213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "541da387c08e4c19be7e51273946dc64"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:41496
I20260709 12:14:06.786119 31213 raft_consensus.cc:493] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.786469 31213 raft_consensus.cc:3060] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.790330 31525 consensus_queue.cc:1048] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.812206 31213 raft_consensus.cc:515] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.814787 31213 leader_election.cc:290] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:06.815786 31287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:06.816468 31287 raft_consensus.cc:3060] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.818255 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541da387c08e4c19be7e51273946dc64" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:06.818969 31363 raft_consensus.cc:3055] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.819288 31363 raft_consensus.cc:740] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:06.820194 31363 consensus_queue.cc:260] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.821496 31363 raft_consensus.cc:3060] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.828611 31287 raft_consensus.cc:2468] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:06.829902 31363 raft_consensus.cc:2468] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:06.830291 31178 leader_election.cc:304] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:06.831346 31545 raft_consensus.cc:2804] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.831768 31545 raft_consensus.cc:697] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:06.832559 31545 consensus_queue.cc:237] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.840404 31110 catalog_manager.cc:5697] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 1 to 2, leader changed from 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67) to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.873817 31442 consensus_queue.cc:1048] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.880940 31568 raft_consensus.cc:993] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1: : Instructing follower 77972579842b4256b07d8d95e2026c79 to start an election
I20260709 12:14:06.881551 31568 raft_consensus.cc:1081] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Signalling peer 77972579842b4256b07d8d95e2026c79 to start an election
I20260709 12:14:06.886076 31289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
 from {username='slave'} at 127.0.0.1:52122
I20260709 12:14:06.886718 31289 raft_consensus.cc:493] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.887048 31289 raft_consensus.cc:3060] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.897125 31568 consensus_queue.cc:1048] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:06.901602 31289 raft_consensus.cc:515] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.902967 31287 raft_consensus.cc:1240] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Rejecting Update request from peer 2c10d756449b40a7a756e47931f0cab1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:06.905246 31568 consensus_queue.cc:1059] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:06.906173 31568 raft_consensus.cc:3055] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.906546 31568 raft_consensus.cc:740] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:06.907485 31568 consensus_queue.cc:260] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.908643 31568 raft_consensus.cc:3060] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.909159 31289 leader_election.cc:290] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 2 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:06.912104 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:06.913681 31213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787a18b9766e4344aab94ba5e721fce9" candidate_uuid: "77972579842b4256b07d8d95e2026c79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:06.914840 31213 raft_consensus.cc:3060] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.922941 31213 raft_consensus.cc:2468] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 2.
I20260709 12:14:06.925653 31363 raft_consensus.cc:2468] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77972579842b4256b07d8d95e2026c79 in term 2.
I20260709 12:14:06.929625 31254 leader_election.cc:304] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:06.930553 31525 raft_consensus.cc:2804] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.931027 31525 raft_consensus.cc:697] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Becoming Leader. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:06.931937 31525 consensus_queue.cc:237] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.940950 31110 catalog_manager.cc:5697] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 reported cstate change: term changed from 1 to 2, leader changed from 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67) to 77972579842b4256b07d8d95e2026c79 (127.20.56.66). New cstate: current_term: 2 leader_uuid: "77972579842b4256b07d8d95e2026c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:06.972621 31530 raft_consensus.cc:993] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1: : Instructing follower 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:06.973142 31530 raft_consensus.cc:1081] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Signalling peer 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:06.974635 31213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85c40f40c0484488a8250d628f929df6"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:41496
I20260709 12:14:06.975133 31213 raft_consensus.cc:493] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.975485 31213 raft_consensus.cc:3060] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.981263 31213 raft_consensus.cc:515] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.983186 31213 leader_election.cc:290] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:06.984027 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:06.984723 31289 raft_consensus.cc:3060] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.985405 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85c40f40c0484488a8250d628f929df6" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:06.986025 31363 raft_consensus.cc:3055] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:06.986328 31363 raft_consensus.cc:740] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:06.986869 31528 raft_consensus.cc:993] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79: : Instructing follower 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:06.987380 31528 raft_consensus.cc:1081] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Signalling peer 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:06.987174 31363 consensus_queue.cc:260] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.988493 31363 raft_consensus.cc:3060] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.989444 31213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:41490
I20260709 12:14:06.990048 31213 raft_consensus.cc:493] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:06.990439 31213 raft_consensus.cc:3060] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.995289 31289 raft_consensus.cc:2468] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:06.995589 31363 raft_consensus.cc:2468] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:06.996927 31178 leader_election.cc:304] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a655080eee468baa6cd2a0cc015020, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:06.997828 31545 raft_consensus.cc:2804] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:06.997840 31213 raft_consensus.cc:515] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:06.998436 31545 raft_consensus.cc:697] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:06.999480 31545 consensus_queue.cc:237] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:07.000193 31213 leader_election.cc:290] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:07.001343 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:07.002141 31289 raft_consensus.cc:3055] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:07.002857 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff026103535f4354b2e205f423dfa2ca" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:07.003429 31363 raft_consensus.cc:3060] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.002544 31289 raft_consensus.cc:740] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:07.006191 31289 consensus_queue.cc:260] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:07.007537 31289 raft_consensus.cc:3060] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.008759 31110 catalog_manager.cc:5697] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 1 to 2, leader changed from 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67) to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.011432 31363 raft_consensus.cc:2468] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:07.012737 31179 leader_election.cc:304] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:07.013525 31545 raft_consensus.cc:2804] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.013909 31545 raft_consensus.cc:697] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:07.014683 31545 consensus_queue.cc:237] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:07.022028 31289 raft_consensus.cc:2468] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:07.024768 31528 raft_consensus.cc:993] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79: : Instructing follower 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:07.025265 31525 raft_consensus.cc:1081] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Signalling peer 66a655080eee468baa6cd2a0cc015020 to start an election
I20260709 12:14:07.026841 31213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88ff89cfbab14579af1338ac175d26af"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
 from {username='slave'} at 127.0.0.1:41490
I20260709 12:14:07.027427 31213 raft_consensus.cc:493] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.027882 31213 raft_consensus.cc:3060] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.026896 31110 catalog_manager.cc:5697] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 1 to 2, leader changed from 77972579842b4256b07d8d95e2026c79 (127.20.56.66) to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.034951 31213 raft_consensus.cc:515] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:07.037591 31213 leader_election.cc:290] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Requested vote from peers 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781), 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67:32899)
I20260709 12:14:07.038244 31289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ff89cfbab14579af1338ac175d26af" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:07.038997 31289 raft_consensus.cc:3055] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:07.039367 31289 raft_consensus.cc:740] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:07.039871 31363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ff89cfbab14579af1338ac175d26af" candidate_uuid: "66a655080eee468baa6cd2a0cc015020" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
I20260709 12:14:07.040447 31363 raft_consensus.cc:3060] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.040416 31289 consensus_queue.cc:260] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:07.042080 31289 raft_consensus.cc:3060] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.047716 31363 raft_consensus.cc:2468] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:07.048880 31179 leader_election.cc:304] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 66a655080eee468baa6cd2a0cc015020; no voters: 
I20260709 12:14:07.049068 31289 raft_consensus.cc:2468] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a655080eee468baa6cd2a0cc015020 in term 2.
I20260709 12:14:07.049747 31545 raft_consensus.cc:2804] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:07.050249 31545 raft_consensus.cc:697] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Becoming Leader. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:07.051162 31545 consensus_queue.cc:237] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:07.059237 31110 catalog_manager.cc:5697] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 reported cstate change: term changed from 1 to 2, leader changed from 77972579842b4256b07d8d95e2026c79 (127.20.56.66) to 66a655080eee468baa6cd2a0cc015020 (127.20.56.65). New cstate: current_term: 2 leader_uuid: "66a655080eee468baa6cd2a0cc015020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.175616 31289 raft_consensus.cc:3060] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:07.181396 31289 raft_consensus.cc:1275] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Refusing update from remote peer 2c10d756449b40a7a756e47931f0cab1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.182858 31530 consensus_queue.cc:1048] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.193202 31213 raft_consensus.cc:1275] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Refusing update from remote peer 2c10d756449b40a7a756e47931f0cab1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.194936 31530 consensus_queue.cc:1048] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.290964 31363 raft_consensus.cc:1275] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.292176 31545 consensus_queue.cc:1048] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.300508 31289 raft_consensus.cc:1275] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.302925 31545 consensus_queue.cc:1048] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:07.366743 31363 raft_consensus.cc:1275] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 77972579842b4256b07d8d95e2026c79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.368083 31525 consensus_queue.cc:1048] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.378500 31213 raft_consensus.cc:1275] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Refusing update from remote peer 77972579842b4256b07d8d95e2026c79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.382599 31362 raft_consensus.cc:1275] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.384763 31581 consensus_queue.cc:1048] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:07.385434 31505 consensus_queue.cc:1048] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:07.411214 31362 raft_consensus.cc:1275] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.413143 31505 consensus_queue.cc:1048] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.431340 31289 raft_consensus.cc:1275] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.432806 31545 consensus_queue.cc:1048] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.439769 31287 raft_consensus.cc:1275] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.445696 31580 consensus_queue.cc:1048] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.639074 31287 raft_consensus.cc:1275] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.640588 31580 consensus_queue.cc:1048] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:07.656356 31363 raft_consensus.cc:1275] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Refusing update from remote peer 66a655080eee468baa6cd2a0cc015020: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.660454 31586 consensus_queue.cc:1048] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:09.657857 31111 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60706:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:14:09.677567 31111 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60706:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:14:09.705776 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:09.925761 31620 log.cc:927] Time spent T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:14:09.948860 31621 log.cc:927] Time spent T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 12:14:09.980695 31625 log.cc:927] Time spent T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
W20260709 12:14:09.984799 31627 log.cc:927] Time spent T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79: Append to log took a long time: real 0.101s	user 0.000s	sys 0.003s
W20260709 12:14:09.995944 31624 log.cc:927] Time spent T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:14:10.025781 31253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.65:41421, user_credentials={real_user=slave}} blocked reactor thread for 78312.9us
I20260709 12:14:10.027032 31640 tablet.cc:1724] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:10.056900 31637 log.cc:927] Time spent T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 12:14:10.089586 31654 tablet.cc:1724] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.065354 31650 tablet.cc:1724] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.114012 31652 tablet.cc:1724] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.131489 31655 tablet.cc:1724] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.141994 31658 tablet.cc:1724] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.144322 31290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361"
dest_uuid: "77972579842b4256b07d8d95e2026c79"
mode: GRACEFUL
new_leader_uuid: "2c10d756449b40a7a756e47931f0cab1"
 from {username='slave'} at 127.0.0.1:52150
I20260709 12:14:10.145102 31290 raft_consensus.cc:606] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Received request to transfer leadership to TS 2c10d756449b40a7a756e47931f0cab1
W20260709 12:14:10.146574 31636 log.cc:927] Time spent T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:14:10.155007 31641 log.cc:927] Time spent T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:14:10.175997 31659 tablet.cc:1724] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.177389 31653 tablet.cc:1724] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.149442 31649 tablet.cc:1724] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.201004 31660 tablet.cc:1724] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.204945 31652 tablet.cc:1724] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.209743 31656 tablet.cc:1724] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.218786 31660 tablet.cc:1724] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.221982 31640 tablet.cc:1724] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.241398 31655 tablet.cc:1724] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.228279 31654 tablet.cc:1724] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.217124 31650 tablet.cc:1724] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.246282 31658 tablet.cc:1724] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.256843 31655 tablet.cc:1724] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.263669 31659 tablet.cc:1724] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.273284 31653 tablet.cc:1724] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.278241 31656 tablet.cc:1724] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:10.279357 31254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.56.67:32899, user_credentials={real_user=slave}} blocked reactor thread for 95105.3us
I20260709 12:14:10.282871 31649 tablet.cc:1724] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.291415 31656 tablet.cc:1724] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.292367 31215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64"
dest_uuid: "66a655080eee468baa6cd2a0cc015020"
mode: GRACEFUL
new_leader_uuid: "2c10d756449b40a7a756e47931f0cab1"
 from {username='slave'} at 127.0.0.1:41524
I20260709 12:14:10.293068 31215 raft_consensus.cc:606] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Received request to transfer leadership to TS 2c10d756449b40a7a756e47931f0cab1
I20260709 12:14:10.294462 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:10.295267 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:10.304527 31652 tablet.cc:1724] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.306675 31660 tablet.cc:1724] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.309139 31661 tablet.cc:1724] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:10.339974 31588 raft_consensus.cc:993] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79: : Instructing follower 2c10d756449b40a7a756e47931f0cab1 to start an election
I20260709 12:14:10.340543 31588 raft_consensus.cc:1081] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Signalling peer 2c10d756449b40a7a756e47931f0cab1 to start an election
I20260709 12:14:10.342783 31360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361"
dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
 from {username='slave'} at 127.0.0.1:36356
I20260709 12:14:10.343428 31360 raft_consensus.cc:493] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.343894 31360 raft_consensus.cc:3060] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.376585 31360 raft_consensus.cc:515] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:10.379371 31360 leader_election.cc:290] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 3 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:10.381251 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:10.381122 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f1a2555c7847668ac6afbe2469e361" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:10.382043 31288 raft_consensus.cc:3055] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:10.382088 31215 raft_consensus.cc:3060] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.382541 31288 raft_consensus.cc:740] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77972579842b4256b07d8d95e2026c79, State: Running, Role: LEADER
I20260709 12:14:10.383445 31288 consensus_queue.cc:260] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:10.384851 31288 raft_consensus.cc:3060] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.392102 31288 raft_consensus.cc:2468] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 3.
I20260709 12:14:10.393304 31327 leader_election.cc:304] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:10.393409 31215 raft_consensus.cc:2468] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 3.
I20260709 12:14:10.394198 31591 raft_consensus.cc:2804] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:10.394701 31591 raft_consensus.cc:697] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 3 LEADER]: Becoming Leader. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:10.395905 31591 consensus_queue.cc:237] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:10.407711 31110 catalog_manager.cc:6242] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c: soft_deleted_table [id=b3fd756cc3bd4b4eb3018224800fd813] alter complete (version 1)
I20260709 12:14:10.419458 31111 catalog_manager.cc:5697] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 reported cstate change: term changed from 2 to 3, leader changed from 77972579842b4256b07d8d95e2026c79 (127.20.56.66) to 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67). New cstate: current_term: 3 leader_uuid: "2c10d756449b40a7a756e47931f0cab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.436753 31657 raft_consensus.cc:993] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020: : Instructing follower 2c10d756449b40a7a756e47931f0cab1 to start an election
I20260709 12:14:10.437347 31648 raft_consensus.cc:1081] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Signalling peer 2c10d756449b40a7a756e47931f0cab1 to start an election
I20260709 12:14:10.438895 31360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64"
dest_uuid: "2c10d756449b40a7a756e47931f0cab1"
 from {username='slave'} at 127.0.0.1:36372
I20260709 12:14:10.439437 31360 raft_consensus.cc:493] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:10.439749 31360 raft_consensus.cc:3060] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.446961 31360 raft_consensus.cc:515] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:10.448671 31360 leader_election.cc:290] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 3 election: Requested vote from peers 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421), 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781)
I20260709 12:14:10.449465 31215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66a655080eee468baa6cd2a0cc015020"
I20260709 12:14:10.449717 31288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e3f90ab38b4133a52ef03dba456b64" candidate_uuid: "2c10d756449b40a7a756e47931f0cab1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "77972579842b4256b07d8d95e2026c79"
I20260709 12:14:10.450054 31215 raft_consensus.cc:3055] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:10.450378 31288 raft_consensus.cc:3060] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.450400 31215 raft_consensus.cc:740] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66a655080eee468baa6cd2a0cc015020, State: Running, Role: LEADER
I20260709 12:14:10.451330 31215 consensus_queue.cc:260] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:10.452332 31215 raft_consensus.cc:3060] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:10.456753 31288 raft_consensus.cc:2468] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 3.
I20260709 12:14:10.457890 31327 leader_election.cc:304] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c10d756449b40a7a756e47931f0cab1, 77972579842b4256b07d8d95e2026c79; no voters: 
I20260709 12:14:10.458372 31215 raft_consensus.cc:2468] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c10d756449b40a7a756e47931f0cab1 in term 3.
I20260709 12:14:10.458825 31591 raft_consensus.cc:2804] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:10.459360 31591 raft_consensus.cc:697] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 3 LEADER]: Becoming Leader. State: Replica: 2c10d756449b40a7a756e47931f0cab1, State: Running, Role: LEADER
I20260709 12:14:10.460234 31591 consensus_queue.cc:237] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } }
I20260709 12:14:10.468611 31110 catalog_manager.cc:5697] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 reported cstate change: term changed from 2 to 3, leader changed from 66a655080eee468baa6cd2a0cc015020 (127.20.56.65) to 2c10d756449b40a7a756e47931f0cab1 (127.20.56.67). New cstate: current_term: 3 leader_uuid: "2c10d756449b40a7a756e47931f0cab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c10d756449b40a7a756e47931f0cab1" member_type: VOTER last_known_addr { host: "127.20.56.67" port: 32899 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.853690 31215 raft_consensus.cc:1275] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 3 FOLLOWER]: Refusing update from remote peer 2c10d756449b40a7a756e47931f0cab1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.855000 31591 consensus_queue.cc:1048] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.864427 31286 raft_consensus.cc:1275] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 3 FOLLOWER]: Refusing update from remote peer 2c10d756449b40a7a756e47931f0cab1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.866825 31530 consensus_queue.cc:1048] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:10.943619 31286 raft_consensus.cc:1275] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 3 FOLLOWER]: Refusing update from remote peer 2c10d756449b40a7a756e47931f0cab1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.944880 31671 consensus_queue.cc:1048] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77972579842b4256b07d8d95e2026c79" member_type: VOTER last_known_addr { host: "127.20.56.66" port: 38781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:10.955191 31215 raft_consensus.cc:1275] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 3 FOLLOWER]: Refusing update from remote peer 2c10d756449b40a7a756e47931f0cab1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:10.956744 31591 consensus_queue.cc:1048] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a655080eee468baa6cd2a0cc015020" member_type: VOTER last_known_addr { host: "127.20.56.65" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:11.296316 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:11.301573 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:11.302027 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:12.303004 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:12.307947 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:12.308374 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:13.309397 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:13.314577 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:13.315013 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:14.315914 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:14.322069 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:14.322573 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:15.323555 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:15.328583 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:15.329030 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:16.330461 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:16.337697 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:16.338213 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:17.339367 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.344559 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:17.345057 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:18.345995 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:18.352367 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:18.352937 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:19.353881 20705 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.360091 20705 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:19.360548 20705 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:20.419557 20705 tablet_server.cc:179] TabletServer@127.20.56.65:0 shutting down...
W20260709 12:14:20.431151 31253 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 12:14:20.435286 31253 consensus_peers.cc:597] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 -> Peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Couldn't send request to peer 66a655080eee468baa6cd2a0cc015020. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.445451 31253 consensus_peers.cc:597] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 -> Peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Couldn't send request to peer 66a655080eee468baa6cd2a0cc015020. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.465232 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:20.466284 20705 tablet_replica.cc:333] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.467751 20705 raft_consensus.cc:2243] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.469473 20705 raft_consensus.cc:2272] T 541da387c08e4c19be7e51273946dc64 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.473452 20705 tablet_replica.cc:333] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.474260 20705 raft_consensus.cc:2243] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.475521 20705 raft_consensus.cc:2272] T ff026103535f4354b2e205f423dfa2ca P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.478277 20705 tablet_replica.cc:333] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.479001 20705 raft_consensus.cc:2243] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.479974 20705 raft_consensus.cc:2272] T 88ff89cfbab14579af1338ac175d26af P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.482658 20705 tablet_replica.cc:333] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.483289 20705 raft_consensus.cc:2243] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.483847 20705 raft_consensus.cc:2272] T 3bbc7319e9114b6aa9ccf9e45d139395 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.486490 20705 tablet_replica.cc:333] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.487272 20705 raft_consensus.cc:2243] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.487797 20705 raft_consensus.cc:2272] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.490340 20705 tablet_replica.cc:333] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.490936 20705 raft_consensus.cc:2243] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.491415 20705 raft_consensus.cc:2272] T 606a4579d4324331a1e639105f033a8e P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.493955 20705 tablet_replica.cc:333] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.494731 20705 raft_consensus.cc:2243] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.495472 20705 raft_consensus.cc:2272] T 97dfe0682e4f4047a55dc92a0b5f6831 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.498139 31253 consensus_peers.cc:597] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 -> Peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Couldn't send request to peer 66a655080eee468baa6cd2a0cc015020. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.499046 20705 tablet_replica.cc:333] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.499650 20705 raft_consensus.cc:2243] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.500542 20705 raft_consensus.cc:2272] T 4e92a3344a454901ac15091909781083 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.503600 20705 tablet_replica.cc:333] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.504223 20705 raft_consensus.cc:2243] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.505028 20705 raft_consensus.cc:2272] T 787a18b9766e4344aab94ba5e721fce9 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.507565 20705 tablet_replica.cc:333] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.508122 20705 raft_consensus.cc:2243] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.509042 20705 raft_consensus.cc:2272] T 85c40f40c0484488a8250d628f929df6 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.511757 20705 tablet_replica.cc:333] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.512290 20705 raft_consensus.cc:2243] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.512789 20705 raft_consensus.cc:2272] T 7abb74109ca748499bdcfda11938b772 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.515221 20705 tablet_replica.cc:333] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.515874 20705 raft_consensus.cc:2243] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.516412 20705 raft_consensus.cc:2272] T 21e3f90ab38b4133a52ef03dba456b64 P 66a655080eee468baa6cd2a0cc015020 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.518872 20705 tablet_replica.cc:333] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.519532 20705 raft_consensus.cc:2243] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.520151 20705 raft_consensus.cc:2272] T 985ea95dac1249598cfd3a30f9d516f2 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.522538 20705 tablet_replica.cc:333] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.523100 20705 raft_consensus.cc:2243] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.523630 20705 raft_consensus.cc:2272] T 18f1a2555c7847668ac6afbe2469e361 P 66a655080eee468baa6cd2a0cc015020 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.526121 20705 tablet_replica.cc:333] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.526746 20705 raft_consensus.cc:2243] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.527802 20705 raft_consensus.cc:2272] T 489237d9c34c4f04be8287bef9ddcfa9 P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.530045 20705 tablet_replica.cc:333] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.530571 20705 raft_consensus.cc:2243] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.531090 20705 raft_consensus.cc:2272] T 3763069f09b340458156360dd9eba15a P 66a655080eee468baa6cd2a0cc015020 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.533595 20705 tablet_replica.cc:333] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.534111 20705 raft_consensus.cc:2243] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.534588 20705 raft_consensus.cc:2272] T b3861db98a2c42cea249f3f25dca4490 P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.536926 20705 tablet_replica.cc:333] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020: stopping tablet replica
I20260709 12:14:20.537420 20705 raft_consensus.cc:2243] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.538867 20705 raft_consensus.cc:2272] T fbc151f3076c47c9a28851205ca739af P 66a655080eee468baa6cd2a0cc015020 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.591296 20705 tablet_server.cc:196] TabletServer@127.20.56.65:0 shutdown complete.
W20260709 12:14:20.613922 31327 consensus_peers.cc:597] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 -> Peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Couldn't send request to peer 66a655080eee468baa6cd2a0cc015020. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.622576 31327 consensus_peers.cc:597] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 -> Peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Couldn't send request to peer 66a655080eee468baa6cd2a0cc015020. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.639283 31327 consensus_peers.cc:597] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 -> Peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Couldn't send request to peer 66a655080eee468baa6cd2a0cc015020. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.642297 20705 tablet_server.cc:179] TabletServer@127.20.56.66:0 shutting down...
W20260709 12:14:20.671212 31253 consensus_peers.cc:597] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 -> Peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Couldn't send request to peer 66a655080eee468baa6cd2a0cc015020. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.673098 31327 consensus_peers.cc:597] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 -> Peer 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781): Couldn't send request to peer 77972579842b4256b07d8d95e2026c79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.679585 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:20.680480 20705 tablet_replica.cc:333] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.681334 20705 raft_consensus.cc:2243] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.682322 20705 raft_consensus.cc:2272] T 3bbc7319e9114b6aa9ccf9e45d139395 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.684890 20705 tablet_replica.cc:333] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.685573 20705 raft_consensus.cc:2243] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.686203 20705 raft_consensus.cc:2272] T ff026103535f4354b2e205f423dfa2ca P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.688647 20705 tablet_replica.cc:333] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.689273 20705 raft_consensus.cc:2243] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.689810 20705 raft_consensus.cc:2272] T 88ff89cfbab14579af1338ac175d26af P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.692098 20705 tablet_replica.cc:333] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.692700 20705 raft_consensus.cc:2243] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.693238 20705 raft_consensus.cc:2272] T 541da387c08e4c19be7e51273946dc64 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.695609 20705 tablet_replica.cc:333] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.696183 20705 raft_consensus.cc:2243] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.697089 20705 raft_consensus.cc:2272] T 787a18b9766e4344aab94ba5e721fce9 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.699338 20705 tablet_replica.cc:333] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.699913 20705 raft_consensus.cc:2243] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.700768 20705 raft_consensus.cc:2272] T 7abb74109ca748499bdcfda11938b772 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.702984 20705 tablet_replica.cc:333] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.703558 20705 raft_consensus.cc:2243] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.704202 20705 raft_consensus.cc:2272] T 85c40f40c0484488a8250d628f929df6 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.707301 20705 tablet_replica.cc:333] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.708189 20705 raft_consensus.cc:2243] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.708834 20705 raft_consensus.cc:2272] T fbc151f3076c47c9a28851205ca739af P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.711460 20705 tablet_replica.cc:333] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.712034 20705 raft_consensus.cc:2243] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.712543 20705 raft_consensus.cc:2272] T 21e3f90ab38b4133a52ef03dba456b64 P 77972579842b4256b07d8d95e2026c79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.714795 20705 tablet_replica.cc:333] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.715281 20705 raft_consensus.cc:2243] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.716123 20705 raft_consensus.cc:2272] T 985ea95dac1249598cfd3a30f9d516f2 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.718362 20705 tablet_replica.cc:333] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.718945 20705 raft_consensus.cc:2243] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.719363 20705 raft_consensus.cc:2272] T 489237d9c34c4f04be8287bef9ddcfa9 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.721596 20705 tablet_replica.cc:333] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.722066 20705 raft_consensus.cc:2243] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.722486 20705 raft_consensus.cc:2272] T 18f1a2555c7847668ac6afbe2469e361 P 77972579842b4256b07d8d95e2026c79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.724514 20705 tablet_replica.cc:333] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.724980 20705 raft_consensus.cc:2243] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.725401 20705 raft_consensus.cc:2272] T 3763069f09b340458156360dd9eba15a P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.727535 20705 tablet_replica.cc:333] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.728076 20705 raft_consensus.cc:2243] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.728988 20705 raft_consensus.cc:2272] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.731186 20705 tablet_replica.cc:333] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.731707 20705 raft_consensus.cc:2243] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.732524 20705 raft_consensus.cc:2272] T 606a4579d4324331a1e639105f033a8e P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.734750 20705 tablet_replica.cc:333] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.735280 20705 raft_consensus.cc:2243] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.735778 20705 raft_consensus.cc:2272] T 97dfe0682e4f4047a55dc92a0b5f6831 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.737872 20705 tablet_replica.cc:333] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
I20260709 12:14:20.738592 20705 raft_consensus.cc:2243] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.739305 20705 raft_consensus.cc:2272] T 4e92a3344a454901ac15091909781083 P 77972579842b4256b07d8d95e2026c79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.742627 20705 tablet_replica.cc:333] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79: stopping tablet replica
W20260709 12:14:20.743276 31327 consensus_peers.cc:597] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 -> Peer 66a655080eee468baa6cd2a0cc015020 (127.20.56.65:41421): Couldn't send request to peer 66a655080eee468baa6cd2a0cc015020. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.65:41421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.743368 20705 raft_consensus.cc:2243] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.744520 20705 raft_consensus.cc:2272] T b3861db98a2c42cea249f3f25dca4490 P 77972579842b4256b07d8d95e2026c79 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.765672 31327 consensus_peers.cc:597] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 -> Peer 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781): Couldn't send request to peer 77972579842b4256b07d8d95e2026c79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.789052 20705 tablet_server.cc:196] TabletServer@127.20.56.66:0 shutdown complete.
I20260709 12:14:20.828769 20705 tablet_server.cc:179] TabletServer@127.20.56.67:0 shutting down...
I20260709 12:14:20.863549 20705 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:20.864341 20705 tablet_replica.cc:333] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.865216 20705 raft_consensus.cc:2243] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.866003 20705 raft_consensus.cc:2272] T 88ff89cfbab14579af1338ac175d26af P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.869704 20705 tablet_replica.cc:333] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
W20260709 12:14:20.870311 31327 consensus_peers.cc:597] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 -> Peer 77972579842b4256b07d8d95e2026c79 (127.20.56.66:38781): Couldn't send request to peer 77972579842b4256b07d8d95e2026c79. Status: Network error: Client connection negotiation failed: client connection to 127.20.56.66:38781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.870568 20705 raft_consensus.cc:2243] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.871246 20705 raft_consensus.cc:2272] T 541da387c08e4c19be7e51273946dc64 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.873515 20705 tablet_replica.cc:333] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.874151 20705 raft_consensus.cc:2243] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.874718 20705 raft_consensus.cc:2272] T ff026103535f4354b2e205f423dfa2ca P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.877069 20705 tablet_replica.cc:333] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.877679 20705 raft_consensus.cc:2243] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.878152 20705 raft_consensus.cc:2272] T b3861db98a2c42cea249f3f25dca4490 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.880410 20705 tablet_replica.cc:333] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.881031 20705 raft_consensus.cc:2243] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.881529 20705 raft_consensus.cc:2272] T 985ea95dac1249598cfd3a30f9d516f2 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.883700 20705 tablet_replica.cc:333] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.884321 20705 raft_consensus.cc:2243] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.884815 20705 raft_consensus.cc:2272] T 489237d9c34c4f04be8287bef9ddcfa9 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.887118 20705 tablet_replica.cc:333] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.887692 20705 raft_consensus.cc:2243] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.888540 20705 raft_consensus.cc:2272] T 18f1a2555c7847668ac6afbe2469e361 P 2c10d756449b40a7a756e47931f0cab1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.890733 20705 tablet_replica.cc:333] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.891369 20705 raft_consensus.cc:2243] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.892184 20705 raft_consensus.cc:2272] T 21e3f90ab38b4133a52ef03dba456b64 P 2c10d756449b40a7a756e47931f0cab1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.894344 20705 tablet_replica.cc:333] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.895002 20705 raft_consensus.cc:2243] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.895546 20705 raft_consensus.cc:2272] T 787a18b9766e4344aab94ba5e721fce9 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.897661 20705 tablet_replica.cc:333] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.898236 20705 raft_consensus.cc:2243] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.898772 20705 raft_consensus.cc:2272] T 7abb74109ca748499bdcfda11938b772 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.900977 20705 tablet_replica.cc:333] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.901566 20705 raft_consensus.cc:2243] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.902060 20705 raft_consensus.cc:2272] T 85c40f40c0484488a8250d628f929df6 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.904197 20705 tablet_replica.cc:333] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.904744 20705 raft_consensus.cc:2243] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.905200 20705 raft_consensus.cc:2272] T fbc151f3076c47c9a28851205ca739af P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.907388 20705 tablet_replica.cc:333] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.907920 20705 raft_consensus.cc:2243] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.908417 20705 raft_consensus.cc:2272] T a1bea3c6ec0340dbbf8c05fd5b0620b9 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.910735 20705 tablet_replica.cc:333] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.911280 20705 raft_consensus.cc:2243] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.911752 20705 raft_consensus.cc:2272] T 606a4579d4324331a1e639105f033a8e P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.913684 20705 tablet_replica.cc:333] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.914175 20705 raft_consensus.cc:2243] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.915077 20705 raft_consensus.cc:2272] T 97dfe0682e4f4047a55dc92a0b5f6831 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.917153 20705 tablet_replica.cc:333] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.917690 20705 raft_consensus.cc:2243] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.918141 20705 raft_consensus.cc:2272] T 4e92a3344a454901ac15091909781083 P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.920307 20705 tablet_replica.cc:333] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.920791 20705 raft_consensus.cc:2243] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.921298 20705 raft_consensus.cc:2272] T 3bbc7319e9114b6aa9ccf9e45d139395 P 2c10d756449b40a7a756e47931f0cab1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.923311 20705 tablet_replica.cc:333] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1: stopping tablet replica
I20260709 12:14:20.923792 20705 raft_consensus.cc:2243] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.924706 20705 raft_consensus.cc:2272] T 3763069f09b340458156360dd9eba15a P 2c10d756449b40a7a756e47931f0cab1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.986766 20705 tablet_server.cc:196] TabletServer@127.20.56.67:0 shutdown complete.
I20260709 12:14:21.024077 20705 master.cc:562] Master@127.20.56.126:46635 shutting down...
I20260709 12:14:21.049032 20705 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.049626 20705 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.049927 20705 tablet_replica.cc:333] T 00000000000000000000000000000000 P f3ecfdce122347649353e66cf8ff3f8c: stopping tablet replica
I20260709 12:14:21.071079 20705 master.cc:584] Master@127.20.56.126:46635 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21215 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41940 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (365330 ms total)
[  PASSED  ] 8 tests.
I20260709 12:14:21.131666 20705 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2234 messages since previous log ~32 seconds ago
I20260709 12:14:21.131979 20705 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2234 messages since previous log ~32 seconds ago
I20260709 12:14:21.132229 20705 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2232 messages since previous log ~32 seconds ago
I20260709 12:14:21.132510 20705 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:14:21.132779 20705 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:14:21.133131 20705 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:14:21.133507 20705 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
